00000800:00000200:3.1F:1746064461.496686:0:3763:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff88012e520c00] -> 12345-192.168.202.108@tcp (2) 00000800:00000200:0.1F:1746064461.496969:0:3754:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff88012e520c00] -> 12345-192.168.202.108@tcp (2) 00000800:00000200:0.1:1746064461.496976:0:3754:0:(socklnd.c:186:ksocknal_destroy_peer()) peer_ni 12345-192.168.202.108@tcp ffff8800a43be3c0 deleted 00000800:00000010:0.1:1746064461.496978:0:3754:0:(socklnd.c:195:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff8800a43be3c0. 00000800:00000200:0.1:1746064461.496981:0:3754:0:(socklnd.c:395:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:0.1:1746064461.496987:0:3754:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.108@tcp ip 192.168.202.108:1023 00000800:00000200:0.1:1746064461.496990:0:3754:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800b5241f00 type 2, nob 96 niov 1 nkiov 0 00000800:00000200:1.1F:1746064461.497047:0:3753:0:(socklnd.c:395:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:1.1:1746064461.497317:0:3755:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff88012e520c00] -> 12345-192.168.202.108@tcp (4) 00000800:00000200:1.1:1746064461.497320:0:3755:0:(socklnd.c:186:ksocknal_destroy_peer()) peer_ni 12345-192.168.202.108@tcp ffff8800ac129000 deleted 00000800:00000010:1.1:1746064461.497322:0:3755:0:(socklnd.c:195:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff8800ac129000. 00000800:00000200:1.1:1746064461.497324:0:3755:0:(socklnd.c:395:ksocknal_incr_conn_count()) Add conn type 3, ksnr_connected a ksnr_max_conns 1 00000800:00000200:1.1:1746064461.497621:0:3753:0:(socklnd.c:395:ksocknal_incr_conn_count()) Add conn type 2, ksnr_connected e ksnr_max_conns 1 00010000:00000010:0.1:1746064461.555839:0:27:0:(ldlm_resource.c:1331:__ldlm_resource_free()) slab-freed '(res)': 248 at ffff88009eeaf100. 00010000:00000010:0.1:1746064461.555845:0:27:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 512 at ffff8800b39afc00. 00010000:00000010:0.1:1746064461.618144:0:34:0:(ldlm_resource.c:1331:__ldlm_resource_free()) slab-freed '(res)': 248 at ffff88009eeafd00. 00010000:00000010:0.1:1746064461.618157:0:34:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 512 at ffff88008b959600. 00010000:00000010:1.1:1746064461.624206:0:11:0:(ldlm_resource.c:1331:__ldlm_resource_free()) slab-freed '(res)': 248 at ffff88006e372800. 00010000:00000010:1.1:1746064461.624211:0:11:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 512 at ffff8800a7e63000. 00010000:00000010:0.1:1746064461.627244:0:20:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 512 at ffff88012a2b9000. 00080000:00000010:1.1:1746064461.632171:0:27:0:(osd_handler.c:1608:osd_oxc_free()) kfreed 'oxe': 68 at ffff8800b188cc00. 00010000:00010000:0.0:1746065111.064910:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fba00/0x392ae0376f87c370 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2382 expref: 122 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.064921:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013077b480 00000100:00100000:0.0:1746065111.066794:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.068022:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.069842:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.073686:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.073730:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.076596:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.084833:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.088677:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+125:2002:x1830881271797632:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3661us (3842us total) trans 4294970451 rc 0/0 00000100:00100000:0.0:1746065111.088688:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1394 00002000:00100000:0.0:1746065111.088699:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306f0380 x1830881271797632/t4294970451(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.088707:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0380 with x1830881271797632 ext(0->7) 00010000:00010000:0.0:1746065111.088716:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5600/0x392ae0376f87c37e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2390 expref: 125 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.088729:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5600/0x392ae0376f87c37e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2390 expref: 125 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.088735:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306f0380 00000100:00100000:0.0:1746065111.094599:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.098616:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.104503:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271798144 00000100:00100000:0.0:1746065111.104509:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271798144 00002000:00100000:0.0:1746065111.104542:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f93a680 x1830881271798144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.104550:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93a680 with x1830881271798144 ext(0->4095) 00010000:00010000:0.0:1746065111.104557:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c385 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2397 expref: 125 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.104568:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c385 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2397 expref: 125 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.104573:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f93a680 00000100:00100000:0.0:1746065111.104596:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1395 00000100:00100000:0.0:1746065111.104602:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+125:2005:x1830881271798144:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.104707:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+125:2005:x1830881271798144:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 103us (259us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.104712:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1395 00002000:00100000:0.0:1746065111.104716:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f93a680 x1830881271798144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.104723:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93a680 with x1830881271798144 ext(0->4095) 00010000:00010000:0.0:1746065111.104727:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c385 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2397 expref: 125 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.104735:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c385 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2397 expref: 125 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.104740:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f93a680 00000100:00100000:0.0:1746065111.106289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.107620:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.111415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.113602:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.122534:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+126:2002:x1830881271798912:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 8103us (8928us total) trans 4294970452 rc 0/0 00000100:00100000:0.0:1746065111.122545:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1397 00002000:00100000:0.0:1746065111.122556:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306f1180 x1830881271798912/t4294970452(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.122564:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f1180 with x1830881271798912 ext(0->7) 00010000:00010000:0.0:1746065111.122573:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4e00/0x392ae0376f87c38c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e239e expref: 126 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.122587:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4e00/0x392ae0376f87c38c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e239e expref: 126 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.122593:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306f1180 00000100:00100000:0.0:1746065111.127741:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.140176:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271799168 00000100:00100000:0.0:1746065111.140198:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271799168 00000100:00100000:0.0:1746065111.140238:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28260 00000100:00100000:0.0:1746065111.140244:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+126:1140:x1830881271799168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065111.140258:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.140271:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87c39a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e23ac expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.140294:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c393 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23a5 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.140304:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.140306:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.140308:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87c39a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23ac expref: 127 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.140331:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c393 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23a5 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.140340:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c393 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23a5 expref: 5 pid: 21550 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.140350:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267157376:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065111.140424:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.141857:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.144818:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.149167:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.153226:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.160308:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.166124:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+128:2002:x1830881271800064:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 4018us (5817us total) trans 4294970453 rc 0/0 00000100:00100000:0.0:1746065111.166134:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1399 00002000:00100000:0.0:1746065111.166141:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306f0e00 x1830881271800064/t4294970453(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.166150:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0e00 with x1830881271800064 ext(0->7) 00010000:00010000:0.0:1746065111.166158:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87c39a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23ac expref: 128 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.166170:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87c39a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23ac expref: 128 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.166176:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306f0e00 00000100:00100000:0.0:1746065111.167472:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.169721:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.169780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.175781:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.178920:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.183663:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271801088 00000100:00100000:0.0:1746065111.183670:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271801088 00000100:00100000:0.0:1746065111.183699:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28263 00000100:00100000:0.0:1746065111.183705:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271801088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065111.183719:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.183731:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f02c800/0x392ae0376f87c3af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e23c1 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.183753:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c3a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23ba expref: 127 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.183760:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065111.183761:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065111.183764:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f02c800/0x392ae0376f87c3af lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23c1 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.183785:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c3a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23ba expref: 127 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.183798:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c3a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23ba expref: 127 pid: 9642 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.183807:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267158144:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065111.185005:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.186476:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.187950:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+130:2005:x1830881271801216:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 759us (1476us total) trans 4294970454 rc 0/0 00000100:00100000:0.0:1746065111.187956:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1401 00002000:00100000:0.0:1746065111.187961:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306f3480 x1830881271801216/t4294970454(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.187968:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3480 with x1830881271801216 ext(0->7) 00010000:00010000:0.0:1746065111.187974:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c3a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23ba expref: 130 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.187983:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c3a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23ba expref: 130 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.187989:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306f3480 00000100:00100000:0.0:1746065111.189308:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.194189:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.196640:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.199199:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.209633:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.209670:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.209708:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.212940:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.215349:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.216412:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a093a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+132:2004:x1830881271803264:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 827us (1064us total) trans 4294970455 rc 0/0 00000100:00100000:0.0:1746065111.216419:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1403 00002000:00100000:0.0:1746065111.216424:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a093a300 x1830881271803264/t4294970455(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.216431:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a093a300 with x1830881271803264 ext(0->7) 00010000:00010000:0.0:1746065111.216435:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fae00/0x392ae0376f87c3bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23cf expref: 132 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.216444:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fae00/0x392ae0376f87c3bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23cf expref: 132 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.216449:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a093a300 00000100:00100000:0.0:1746065111.219379:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.221787:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.221828:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271803648 00000100:00100000:0.0:1746065111.221832:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271803648 00002000:00100000:0.0:1746065111.221857:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f4ea300 x1830881271803648/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.221864:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ea300 with x1830881271803648 ext(0->4095) 00002000:00010000:0.0:1746065111.221868:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4ea300 00000100:00100000:0.0:1746065111.221895:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12533 00000100:00100000:0.0:1746065111.221900:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881271803648:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.222727:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881271803648:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 825us (939us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.222733:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12533 00002000:00100000:0.0:1746065111.222738:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f4ea300 x1830881271803648/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.222745:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ea300 with x1830881271803648 ext(0->4095) 00002000:00010000:0.0:1746065111.222748:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4ea300 00000100:00100000:0.0:1746065111.224432:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.226347:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.228510:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.229043:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.230613:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.230651:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.233530:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.236481:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.238914:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+134:2004:x1830881271805056:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2243us (2431us total) trans 4294970456 rc 0/0 00000100:00100000:0.0:1746065111.238923:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1406 00002000:00100000:0.0:1746065111.238931:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f4e8e00 x1830881271805056/t4294970456(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.238939:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8e00 with x1830881271805056 ext(0->7) 00010000:00010000:0.0:1746065111.238951:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fae00/0x392ae0376f87c3d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23e4 expref: 134 pid: 9559 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.239036:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fae00/0x392ae0376f87c3d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23e4 expref: 134 pid: 9559 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.239042:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f4e8e00 00000100:00100000:0.0:1746065111.240727:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.245409:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.250940:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.252446:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271805696 00000100:00100000:0.0:1746065111.252451:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271805696 00000100:00100000:0.0:1746065111.252590:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28271 00000100:00100000:0.0:1746065111.252596:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+134:1140:x1830881271805696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065111.252603:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.252612:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081d07400/0x392ae0376f87c3e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e23f9 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.252629:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f87c3d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23eb expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.252636:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130640800/0x392ae0376f87c3e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23f2 expref: 135 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.252641:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.252642:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.252645:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081d07400/0x392ae0376f87c3e7 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23f9 expref: 135 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.252668:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130640800/0x392ae0376f87c3e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23f2 expref: 135 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.252678:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130640800/0x392ae0376f87c3e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23f2 expref: 135 pid: 9559 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.252688:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267159680:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065111.252756:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f87c3d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23eb expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.252762:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f87c3d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23eb expref: 5 pid: 9559 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.252769:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267159808:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065111.252782:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.253121:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.254894:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.255607:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.256530:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.263527:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+136:2005:x1830881271806848:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 691us (1641us total) trans 4294970457 rc 0/0 00000100:00100000:0.0:1746065111.263533:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1409 00002000:00100000:0.0:1746065111.263539:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009c322680 x1830881271806848/t4294970457(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.263545:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322680 with x1830881271806848 ext(0->7) 00010000:00010000:0.0:1746065111.263550:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880081d07400/0x392ae0376f87c3e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23f9 expref: 136 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.263558:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880081d07400/0x392ae0376f87c3e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e23f9 expref: 136 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.263567:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c322680 00000100:00100000:0.0:1746065111.267332:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.271783:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.279830:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.279902:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.283245:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28274 00000100:00100000:0.0:1746065111.283251:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+136:1140:x1830881271807488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065111.283258:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.283263:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8600/0x392ae0376f87c3fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e240e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.283281:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c3ee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2400 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.283288:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f87c3f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2407 expref: 137 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.283292:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.283293:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.283296:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8600/0x392ae0376f87c3fc lrc: 5/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e240e expref: 137 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.283319:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f87c3f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2407 expref: 137 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.284963:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f87c3f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2407 expref: 137 pid: 9642 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.284979:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267160320:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065111.286163:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c3ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2400 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.286175:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5800/0x392ae0376f87c3ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2400 expref: 5 pid: 9642 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.286194:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267160448:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065111.286226:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.288813:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.288852:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.292199:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.292233:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.295467:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.295488:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271808384 00000100:00100000:0.0:1746065111.295494:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271808384 00002000:00100000:0.0:1746065111.295526:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012f084a80 x1830881271808384/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.295534:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084a80 with x1830881271808384 ext(0->4095) 00010000:00010000:0.0:1746065111.295542:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8600/0x392ae0376f87c3fc lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e240e expref: 137 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.295553:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8600/0x392ae0376f87c3fc lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e240e expref: 137 pid: 9560 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.295563:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f084a80 00000100:00100000:0.0:1746065111.295578:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1411 00000100:00100000:0.0:1746065111.295583:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+137:2005:x1830881271808384:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.295682:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+137:2005:x1830881271808384:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 99us (220us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.295688:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1411 00002000:00100000:0.0:1746065111.295693:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012f084a80 x1830881271808384/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.295700:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084a80 with x1830881271808384 ext(0->4095) 00010000:00010000:0.0:1746065111.295704:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8600/0x392ae0376f87c3fc lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e240e expref: 137 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.295712:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8600/0x392ae0376f87c3fc lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e240e expref: 137 pid: 9560 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.295717:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f084a80 00000100:00100000:0.0:1746065111.298034:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.299251:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+138:2002:x1830881271808640:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 972us (1221us total) trans 4294970458 rc 0/0 00000100:00100000:0.0:1746065111.299257:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1412 00002000:00100000:0.0:1746065111.299263:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f084700 x1830881271808640/t4294970458(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.299270:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084700 with x1830881271808640 ext(0->7) 00010000:00010000:0.0:1746065111.299275:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8600/0x392ae0376f87c3fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e240e expref: 138 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.299284:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8600/0x392ae0376f87c3fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e240e expref: 138 pid: 9560 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.299289:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f084700 00000100:00100000:0.0:1746065111.301612:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.304804:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.307538:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.313738:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.314609:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.316667:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.317152:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.317653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.319926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.322405:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.323688:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+140:2005:x1830881271810432:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1059us (1283us total) trans 4294970459 rc 0/0 00000100:00100000:0.0:1746065111.323697:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1415 00002000:00100000:0.0:1746065111.323703:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a09fdc00 x1830881271810432/t4294970459(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.323712:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fdc00 with x1830881271810432 ext(0->7) 00010000:00010000:0.0:1746065111.323718:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c411 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2423 expref: 140 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.323730:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c411 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2423 expref: 140 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.323737:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a09fdc00 00000100:00100000:0.0:1746065111.326456:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.332277:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.333015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.333050:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271810816 00000100:00100000:0.0:1746065111.333056:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271810816 00002000:00100000:0.0:1746065111.333100:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800a09fd180 x1830881271810816/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.333108:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fd180 with x1830881271810816 ext(0->4095) 00002000:00010000:0.0:1746065111.333112:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a09fd180 00000100:00100000:0.0:1746065111.333126:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12537 00000100:00100000:0.0:1746065111.333132:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271810816:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.333235:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271810816:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 103us (965us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.333240:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12537 00002000:00100000:0.0:1746065111.333244:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800a09fd180 x1830881271810816/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.333250:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fd180 with x1830881271810816 ext(0->4095) 00002000:00010000:0.0:1746065111.333253:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a09fd180 00000100:00100000:0.0:1746065111.335381:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.336711:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.346215:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.349601:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+143:2005:x1830881271811712:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3204us (3384us total) trans 4294970460 rc 0/0 00000100:00100000:0.0:1746065111.349614:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1417 00002000:00100000:0.0:1746065111.349625:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a09fce00 x1830881271811712/t4294970460(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.349633:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fce00 with x1830881271811712 ext(0->7) 00010000:00010000:0.0:1746065111.349641:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c41f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2431 expref: 143 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.349656:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c41f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2431 expref: 143 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.349663:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a09fce00 00000100:00100000:0.0:1746065111.355014:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.361881:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.365415:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.369533:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.371752:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.376102:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.376157:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.376709:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.379736:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.383777:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.385740:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+144:2002:x1830881271813504:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1775us (1965us total) trans 4294970461 rc 0/0 00000100:00100000:0.0:1746065111.385747:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1419 00002000:00100000:0.0:1746065111.385754:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072a07100 x1830881271813504/t4294970461(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.385768:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a07100 with x1830881271813504 ext(0->7) 00010000:00010000:0.0:1746065111.385775:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f87c434 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2446 expref: 144 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.385786:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f87c434 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2446 expref: 144 pid: 9560 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.385792:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a07100 00000100:00100000:0.0:1746065111.387507:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.390052:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.394066:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.397074:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.398558:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.401823:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.403443:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.403500:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.403518:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271814784 00000100:00100000:0.0:1746065111.403521:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271814784 00000100:00100000:0.0:1746065111.403545:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28286 00000100:00100000:0.0:1746065111.403551:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1141:x1830881271814784:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065111.403563:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.403573:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe71200/0x392ae0376f87c450 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2462 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.403586:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.403591:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5a00/0x392ae0376f87c449 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e245b expref: 145 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.403597:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065111.403600:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe71200/0x392ae0376f87c450 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2462 expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.403626:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5a00/0x392ae0376f87c449 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e245b expref: 145 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.403637:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe71200/0x392ae0376f87c450 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2462 expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.403645:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe71200, rc 0) 00000100:00100000:0.0:1746065111.403669:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1141:x1830881271814784:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 118us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.403674:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28286 00000100:00100000:0.0:1746065111.406149:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.409511:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.413668:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+146:2002:x1830881271815296:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2726us (4156us total) trans 4294970462 rc 0/0 00000100:00100000:0.0:1746065111.413678:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1422 00002000:00100000:0.0:1746065111.413686:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009dc38a80 x1830881271815296/t4294970462(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.413694:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc38a80 with x1830881271815296 ext(0->7) 00010000:00010000:0.0:1746065111.413703:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5a00/0x392ae0376f87c449 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e245b expref: 146 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.413721:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e5a00/0x392ae0376f87c449 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e245b expref: 146 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.413727:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009dc38a80 00000100:00100000:0.0:1746065111.421994:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.428192:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.428543:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.428562:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271815808 00000100:00100000:0.0:1746065111.428564:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271815808 00002000:00100000:0.0:1746065111.428584:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d1e2d80 x1830881271815808/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.428592:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2d80 with x1830881271815808 ext(0->4095) 00010000:00010000:0.0:1746065111.428597:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe71200/0x392ae0376f87c450 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2462 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.428603:0:27161:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff88009fe71200/0x392ae0376f87c450 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2462 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065111.428607:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e2d80 00000100:00100000:0.0:1746065111.428618:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1423 00000100:00100000:0.0:1746065111.428622:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271815808:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.429017:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271815808:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 393us (472us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.429023:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1423 00002000:00100000:0.0:1746065111.429027:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d1e2d80 x1830881271815808/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.429034:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2d80 with x1830881271815808 ext(0->4095) 00010000:00010000:0.0:1746065111.429038:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe71200/0x392ae0376f87c450 lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2462 expref: 6 pid: 9559 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.429046:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe71200/0x392ae0376f87c450 lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2462 expref: 6 pid: 9559 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.429051:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e2d80 00000100:00100000:0.0:1746065111.431008:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.431067:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.434457:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.434475:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271816320 00000100:00100000:0.0:1746065111.434480:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271816320 00002000:00100000:0.0:1746065111.434510:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d1e0000 x1830881271816320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.434518:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0000 with x1830881271816320 ext(0->4095) 00010000:00010000:0.0:1746065111.434523:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2469 expref: 147 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.434694:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2469 expref: 147 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.434701:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e0000 00000100:00100000:0.0:1746065111.434727:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1424 00000100:00100000:0.0:1746065111.434733:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+147:2004:x1830881271816320:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.434844:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+147:2004:x1830881271816320:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 111us (387us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.434849:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1424 00002000:00100000:0.0:1746065111.434853:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d1e0000 x1830881271816320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.434860:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0000 with x1830881271816320 ext(0->4095) 00010000:00010000:0.0:1746065111.434864:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2469 expref: 147 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.434871:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2469 expref: 147 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.434876:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e0000 00000100:00100000:0.0:1746065111.436338:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.437638:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+149:2002:x1830881271816576:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 874us (1301us total) trans 4294970463 rc 0/0 00000100:00100000:0.0:1746065111.437644:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1425 00002000:00100000:0.0:1746065111.437650:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d1e0380 x1830881271816576/t4294970463(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.437656:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0380 with x1830881271816576 ext(0->7) 00010000:00010000:0.0:1746065111.437660:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2469 expref: 149 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.437669:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2469 expref: 149 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.437679:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e0380 00000100:00100000:0.0:1746065111.442466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.449524:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.453154:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.453248:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.458196:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.460586:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.464590:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.467173:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+150:2005:x1830881271817856:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2329us (2584us total) trans 4294970464 rc 0/0 00000100:00100000:0.0:1746065111.467192:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1427 00002000:00100000:0.0:1746065111.467200:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d1e2300 x1830881271817856/t4294970464(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.467208:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2300 with x1830881271817856 ext(0->7) 00010000:00010000:0.0:1746065111.467216:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4c00/0x392ae0376f87c465 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e247e expref: 150 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.467228:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4c00/0x392ae0376f87c465 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e247e expref: 150 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.467235:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e2300 00000100:00100000:0.0:1746065111.471526:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.479751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.479796:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.479820:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271818368 00000100:00100000:0.0:1746065111.479825:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271818368 00002000:00100000:0.0:1746065111.479858:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8801306a0e00 x1830881271818368/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.479866:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0e00 with x1830881271818368 ext(0->4095) 00002000:00010000:0.0:1746065111.479869:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801306a0e00 00000100:00100000:0.0:1746065111.479883:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12542 00000100:00100000:0.0:1746065111.479888:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271818368:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.479972:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271818368:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 84us (176us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.479977:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12542 00002000:00100000:0.0:1746065111.479981:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8801306a0e00 x1830881271818368/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.479987:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0e00 with x1830881271818368 ext(0->4095) 00002000:00010000:0.0:1746065111.479989:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801306a0e00 00000100:00100000:0.0:1746065111.482371:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.484292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.489049:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.493643:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.495333:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+153:2005:x1830881271819136:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 672us (1693us total) trans 4294970465 rc 0/0 00000100:00100000:0.0:1746065111.495340:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1429 00002000:00100000:0.0:1746065111.495346:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306a0000 x1830881271819136/t4294970465(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.495353:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0000 with x1830881271819136 ext(0->7) 00010000:00010000:0.0:1746065111.495360:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4600/0x392ae0376f87c473 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2485 expref: 153 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.495370:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4600/0x392ae0376f87c473 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2485 expref: 153 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.495376:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306a0000 00000100:00100000:0.0:1746065111.501604:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.504254:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.506810:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.510378:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.521591:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.536642:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271820416 00000100:00100000:0.0:1746065111.536650:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271820416 00000100:00100000:0.0:1746065111.536660:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271820544 00000100:00100000:0.0:1746065111.536661:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271820544 00010000:00010000:0.0:1746065111.536686:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c481 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2493 expref: 6 pid: 21550 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.536715:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12267 00000100:00100000:0.0:1746065111.536721:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271820544:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.536731:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.536748:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c481 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2493 expref: 6 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.536757:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c481 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2493 expref: 6 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.536786:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4400/0x392ae0376f87c481 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2493 expref: 6 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.536799:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065111.537112:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881271820544:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 389us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.537119:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12267 00010000:00010000:0.0:1746065111.537140:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7fa200/0x392ae0376f87c47a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e248c expref: 153 pid: 9560 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.537153:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12268 00000100:00100000:0.0:1746065111.537158:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+153:2004:x1830881271820416:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.537164:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.537170:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fa200/0x392ae0376f87c47a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e248c expref: 153 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.537190:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7fa200/0x392ae0376f87c47a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e248c expref: 153 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.537201:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fa200/0x392ae0376f87c47a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e248c expref: 153 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.537209:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.537211:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.537216:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4a00/0x392ae0376f87c488 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e249a expref: 152 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.537226:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4a00/0x392ae0376f87c488 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e249a expref: 152 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.537252:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4a00/0x392ae0376f87c488 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e249a expref: 152 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065111.537265:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267165184:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065111.538392:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.539910:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.540257:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28295 00000100:00100000:0.0:1746065111.540265:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271820672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065111.540281:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.540294:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8a00/0x392ae0376f87c48f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e24a1 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.540318:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4a00/0x392ae0376f87c488 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e249a expref: 152 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.540324:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065111.540325:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065111.540328:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8a00/0x392ae0376f87c48f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24a1 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.540349:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4a00/0x392ae0376f87c488 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e249a expref: 152 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.540362:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4a00/0x392ae0376f87c488 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e249a expref: 152 pid: 9642 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.540372:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267165312:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065111.540574:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.542737:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.545374:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.547392:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+154:2005:x1830881271821184:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1003us (2022us total) trans 4294970466 rc 0/0 00000100:00100000:0.0:1746065111.547399:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1431 00002000:00100000:0.0:1746065111.547405:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88013017ad80 x1830881271821184/t4294970466(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.547411:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017ad80 with x1830881271821184 ext(0->7) 00010000:00010000:0.0:1746065111.547417:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4a00/0x392ae0376f87c488 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e249a expref: 154 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.547428:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4a00/0x392ae0376f87c488 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e249a expref: 154 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.547432:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013017ad80 00000100:00100000:0.0:1746065111.551931:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.557127:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.560887:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271821696 00000100:00100000:0.0:1746065111.560893:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271821696 00000100:00100000:0.0:1746065111.560936:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28296 00000100:00100000:0.0:1746065111.560942:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+153:1141:x1830881271821696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065111.560957:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.560990:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f88e400/0x392ae0376f87c496 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e24a8 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.561011:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.561013:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.561020:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f88e400/0x392ae0376f87c496 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24a8 expref: 154 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.561032:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f88e400/0x392ae0376f87c496 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24a8 expref: 154 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.561041:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f88e400, rc 0) 00000100:00100000:0.0:1746065111.561221:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+154:1141:x1830881271821696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 278us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.561227:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28296 00000100:00100000:0.0:1746065111.564514:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.565419:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.568681:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.568715:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.571485:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.571571:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.574862:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.579558:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.582050:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+157:2004:x1830881271823232:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2018us (2493us total) trans 4294970467 rc 0/0 00000100:00100000:0.0:1746065111.582062:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1435 00002000:00100000:0.0:1746065111.582070:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880130178380 x1830881271823232/t4294970467(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.582078:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130178380 with x1830881271823232 ext(0->7) 00010000:00010000:0.0:1746065111.582373:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f87c49d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24af expref: 157 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.582386:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f87c49d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24af expref: 157 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.582392:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130178380 00000100:00100000:0.0:1746065111.586976:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.592632:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.592737:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271823616 00000100:00100000:0.0:1746065111.592743:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271823616 00002000:00100000:0.0:1746065111.592774:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800729d6a00 x1830881271823616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.592783:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d6a00 with x1830881271823616 ext(0->4095) 00002000:00010000:0.0:1746065111.592786:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800729d6a00 00000100:00100000:0.0:1746065111.594170:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12547 00000100:00100000:0.0:1746065111.594400:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+156:2005:x1830881271823616:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.595388:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+156:2005:x1830881271823616:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 1208us (2754us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.595394:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12547 00002000:00100000:0.0:1746065111.595403:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800729d6a00 x1830881271823616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.595411:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d6a00 with x1830881271823616 ext(0->4095) 00002000:00010000:0.0:1746065111.595414:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800729d6a00 00000100:00100000:0.0:1746065111.606604:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.617365:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.617785:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.617882:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.623053:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.627979:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.632736:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+159:2002:x1830881271825024:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 4007us (4754us total) trans 4294970468 rc 0/0 00000100:00100000:0.0:1746065111.632751:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1438 00002000:00100000:0.0:1746065111.632760:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729d5180 x1830881271825024/t4294970468(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.632769:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d5180 with x1830881271825024 ext(0->7) 00010000:00010000:0.0:1746065111.632778:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fba00/0x392ae0376f87c4b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24c4 expref: 159 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.632791:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fba00/0x392ae0376f87c4b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24c4 expref: 159 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.633058:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729d5180 00000100:00100000:0.0:1746065111.634911:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.640501:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.644199:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.647309:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.651070:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.651835:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.657187:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271826176 00000100:00100000:0.0:1746065111.657195:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271826176 00010000:00010000:0.0:1746065111.657226:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11200/0x392ae0376f87c4c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24d2 expref: 6 pid: 21550 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.657891:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12277 00000100:00100000:0.0:1746065111.657899:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881271826176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.657914:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.657930:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11200/0x392ae0376f87c4c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24d2 expref: 6 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.657942:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb11200/0x392ae0376f87c4c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24d2 expref: 6 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.657961:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11200/0x392ae0376f87c4c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24d2 expref: 6 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.658045:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.658047:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.658053:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c4c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24d9 expref: 157 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.658061:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24d9 expref: 157 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.658105:0:9574:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24d9 expref: 157 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065111.658114:0:9574:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267167104:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065111.658688:0:9574:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.663775:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.671688:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.678906:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.679751:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+160:2005:x1830881271826688:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 694us (844us total) trans 4294970469 rc 0/0 00000100:00100000:0.0:1746065111.679758:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1440 00002000:00100000:0.0:1746065111.679763:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729d4380 x1830881271826688/t4294970469(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.679770:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d4380 with x1830881271826688 ext(0->7) 00010000:00010000:0.0:1746065111.679775:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24d9 expref: 160 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.679784:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24d9 expref: 160 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.679790:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729d4380 00000100:00100000:0.0:1746065111.681229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.682859:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.686341:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.688420:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.690684:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.695521:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.711794:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.713038:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+163:2003:x1830881271827968:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1030us (1248us total) trans 4294970470 rc 0/0 00000100:00100000:0.0:1746065111.713045:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1442 00002000:00100000:0.0:1746065111.713051:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d5a1c00 x1830881271827968/t4294970470(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.713057:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1c00 with x1830881271827968 ext(0->7) 00010000:00010000:0.0:1746065111.713062:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fae00/0x392ae0376f87c4d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24e7 expref: 163 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.713071:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fae00/0x392ae0376f87c4d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24e7 expref: 163 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.713075:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a1c00 00000100:00100000:0.0:1746065111.714328:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.716882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.720794:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271828480 00000100:00100000:0.0:1746065111.720800:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271828480 00002000:00100000:0.0:1746065111.720834:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f93bb80 x1830881271828480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.720842:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93bb80 with x1830881271828480 ext(0->4095) 00010000:00010000:0.0:1746065111.720850:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0400/0x392ae0376f87c4dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24ee expref: 163 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.720861:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0400/0x392ae0376f87c4dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24ee expref: 163 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.720867:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f93bb80 00000100:00100000:0.0:1746065111.720891:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1443 00000100:00100000:0.0:1746065111.720897:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+163:2004:x1830881271828480:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.721010:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+163:2004:x1830881271828480:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 113us (273us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.721016:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1443 00002000:00100000:0.0:1746065111.721021:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f93bb80 x1830881271828480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.721027:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93bb80 with x1830881271828480 ext(0->4095) 00010000:00010000:0.0:1746065111.721032:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0400/0x392ae0376f87c4dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24ee expref: 163 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.721039:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0400/0x392ae0376f87c4dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24ee expref: 163 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.721044:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f93bb80 00000100:00100000:0.0:1746065111.724443:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.725015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.729452:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.734163:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.736005:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+164:2005:x1830881271829248:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1633us (1845us total) trans 4294970471 rc 0/0 00000100:00100000:0.0:1746065111.736013:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1445 00002000:00100000:0.0:1746065111.736020:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d5a1f80 x1830881271829248/t4294970471(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.736028:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1f80 with x1830881271829248 ext(0->7) 00010000:00010000:0.0:1746065111.736034:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fba00/0x392ae0376f87c4e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24f5 expref: 164 pid: 21550 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.736045:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fba00/0x392ae0376f87c4e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24f5 expref: 164 pid: 21550 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.736050:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a1f80 00000100:00100000:0.0:1746065111.737458:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.739236:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.746883:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.753963:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.756223:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.764758:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.764793:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.764840:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.764862:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271830528 00000100:00100000:0.0:1746065111.764868:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271830528 00010000:00010000:0.0:1746065111.764897:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10e00/0x392ae0376f87c4f1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2503 expref: 166 pid: 9560 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.764918:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271830784 00000100:00100000:0.0:1746065111.764920:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271830784 00010000:00010000:0.0:1746065111.764930:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c4ea lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24fc expref: 6 pid: 9560 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.764945:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12283 00000100:00100000:0.0:1746065111.764951:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+166:2004:x1830881271830528:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.764963:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.764980:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10e00/0x392ae0376f87c4f1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2503 expref: 166 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.764989:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10e00/0x392ae0376f87c4f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2503 expref: 166 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.765008:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065111.765039:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+166:2004:x1830881271830528:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 87us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.765045:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12283 00000100:00100000:0.0:1746065111.765059:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12284 00000100:00100000:0.0:1746065111.765064:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271830784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.765071:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.765078:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c4ea lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24fc expref: 6 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.765112:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c4ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e24fc expref: 6 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.765123:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.765125:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.765131:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fac00/0x392ae0376f87c4f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e250a expref: 165 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.765138:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7fac00/0x392ae0376f87c4f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e250a expref: 165 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.765162:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7fac00/0x392ae0376f87c4f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e250a expref: 165 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065111.765182:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880079c35180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267168768:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065111.765227:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.769529:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.769573:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271831040 00000100:00100000:0.0:1746065111.769578:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271831040 00002000:00100000:0.0:1746065111.769609:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880079c37100 x1830881271831040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.769618:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880079c37100 with x1830881271831040 ext(0->4095) 00010000:00010000:0.0:1746065111.769624:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fac00/0x392ae0376f87c4f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e250a expref: 165 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.769633:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fac00/0x392ae0376f87c4f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e250a expref: 165 pid: 9560 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.769638:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880079c37100 00000100:00100000:0.0:1746065111.769668:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1446 00000100:00100000:0.0:1746065111.769674:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+165:2004:x1830881271831040:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.769783:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+165:2004:x1830881271831040:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 109us (254us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.769789:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1446 00002000:00100000:0.0:1746065111.769793:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880079c37100 x1830881271831040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.769801:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880079c37100 with x1830881271831040 ext(0->4095) 00010000:00010000:0.0:1746065111.769805:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fac00/0x392ae0376f87c4f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e250a expref: 165 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.769813:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fac00/0x392ae0376f87c4f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e250a expref: 165 pid: 9560 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.769817:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880079c37100 00000100:00100000:0.0:1746065111.778587:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.781200:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+167:2005:x1830881271831296:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2409us (2614us total) trans 4294970472 rc 0/0 00000100:00100000:0.0:1746065111.781208:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1447 00002000:00100000:0.0:1746065111.781216:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880079c34000 x1830881271831296/t4294970472(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.781224:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880079c34000 with x1830881271831296 ext(0->7) 00010000:00010000:0.0:1746065111.781231:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fac00/0x392ae0376f87c4f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e250a expref: 167 pid: 9560 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.781242:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fac00/0x392ae0376f87c4f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e250a expref: 167 pid: 9560 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.781248:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880079c34000 00000100:00100000:0.0:1746065111.796447:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.800468:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.805759:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.805804:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.807724:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.811299:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.811336:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.811373:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.811400:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271832320 00000100:00100000:0.0:1746065111.811406:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271832320 00010000:00010000:0.0:1746065111.811431:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0e00/0x392ae0376f87c4ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2511 expref: 167 pid: 9642 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.811460:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271832576 00000100:00100000:0.0:1746065111.811463:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271832576 00010000:00010000:0.0:1746065111.811473:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87c506 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2518 expref: 6 pid: 9642 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.811485:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12286 00000100:00100000:0.0:1746065111.811491:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+167:2005:x1830881271832320:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.811501:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.811516:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0e00/0x392ae0376f87c4ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2511 expref: 167 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.811524:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0e00/0x392ae0376f87c4ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2511 expref: 167 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.811543:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0e00/0x392ae0376f87c4ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2511 expref: 167 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.811557:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065111.811581:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+166:2005:x1830881271832320:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 90us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.811587:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12286 00000100:00100000:0.0:1746065111.811600:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12287 00000100:00100000:0.0:1746065111.811605:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271832576:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.811610:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.811616:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87c506 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2518 expref: 6 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.811623:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87c506 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2518 expref: 6 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.811633:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87c506 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2518 expref: 6 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.811641:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.811643:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.811648:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c50d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e251f expref: 165 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.811654:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c50d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e251f expref: 165 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.811679:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c50d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e251f expref: 165 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065111.811688:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267169408:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065111.811740:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.815154:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267169408:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065111.815182:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065111.815217:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881271832576:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3610us (3841us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.815225:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12287 00000100:00100000:0.0:1746065111.815791:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c321180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267169536:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065111.815808:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c514 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2526 expref: 167 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.815819:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8c0000, rc 0) 00000100:00100000:0.0:1746065111.815839:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+167:1141:x1830881271832448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3785us (4503us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.815845:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28314 00000100:00100000:0.0:1746065111.820465:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.823635:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+169:2003:x1830881271833088:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 694us (3175us total) trans 4294970473 rc 0/0 00000100:00100000:0.0:1746065111.823642:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1450 00002000:00100000:0.0:1746065111.823648:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fbbc380 x1830881271833088/t4294970473(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.823654:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc380 with x1830881271833088 ext(0->7) 00010000:00010000:0.0:1746065111.823659:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c50d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e251f expref: 169 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.823667:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c50d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e251f expref: 169 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.823672:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbc380 00000100:00100000:0.0:1746065111.835658:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.835702:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.845573:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271833600 00000100:00100000:0.0:1746065111.845580:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271833600 00002000:00100000:0.0:1746065111.845610:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c320700 x1830881271833600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.845618:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320700 with x1830881271833600 ext(0->4095) 00010000:00010000:0.0:1746065111.845626:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c514 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2526 expref: 170 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.845637:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c514 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2526 expref: 170 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.845642:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c320700 00000100:00100000:0.0:1746065111.845655:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1451 00000100:00100000:0.0:1746065111.845661:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+170:2005:x1830881271833600:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.845750:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+170:2005:x1830881271833600:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 89us (234us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.845755:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1451 00002000:00100000:0.0:1746065111.845759:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c320700 x1830881271833600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.845765:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320700 with x1830881271833600 ext(0->4095) 00010000:00010000:0.0:1746065111.845769:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c514 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2526 expref: 170 pid: 9642 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.845777:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c514 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2526 expref: 170 pid: 9642 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.845782:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c320700 00000100:00100000:0.0:1746065111.852045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.852310:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.852986:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271833728 00000100:00100000:0.0:1746065111.852994:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271833728 00000100:00100000:0.0:1746065111.853028:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28316 00000100:00100000:0.0:1746065111.853035:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271833728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065111.853051:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.853064:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f87c522 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2534 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.853096:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.853101:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0e00/0x392ae0376f87c51b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e252d expref: 168 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.853107:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065111.853110:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f87c522 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2534 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.853136:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0e00/0x392ae0376f87c51b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e252d expref: 168 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.853146:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f87c522 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2534 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.853159:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98f200, rc 0) 00000100:00100000:0.0:1746065111.853203:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1141:x1830881271833728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 168us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.853209:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28316 00000100:00100000:0.0:1746065111.868426:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.882869:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.886680:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+170:2004:x1830881271834368:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1691us (3812us total) trans 4294970474 rc 0/0 00000100:00100000:0.0:1746065111.886688:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1453 00002000:00100000:0.0:1746065111.886695:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012dffdf80 x1830881271834368/t4294970474(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.886703:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffdf80 with x1830881271834368 ext(0->7) 00010000:00010000:0.0:1746065111.886710:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0e00/0x392ae0376f87c51b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e252d expref: 170 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065111.886720:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0e00/0x392ae0376f87c51b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e252d expref: 170 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065111.886726:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dffdf80 00000100:00100000:0.0:1746065111.899987:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.902420:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.907398:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271834880 00000100:00100000:0.0:1746065111.907404:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271834880 00002000:00100000:0.0:1746065111.907435:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c323800 x1830881271834880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.907450:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323800 with x1830881271834880 ext(0->4095) 00010000:00010000:0.0:1746065111.907457:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f87c522 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2534 expref: 6 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065111.907468:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f87c522 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2534 expref: 6 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065111.907475:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c323800 00000100:00100000:0.0:1746065111.907499:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1454 00000100:00100000:0.0:1746065111.907505:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271834880:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065111.907593:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271834880:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 88us (513us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065111.907598:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1454 00002000:00100000:0.0:1746065111.907603:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c323800 x1830881271834880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.907610:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323800 with x1830881271834880 ext(0->4095) 00010000:00010000:0.0:1746065111.907614:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f87c522 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2534 expref: 6 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065111.907621:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f87c522 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2534 expref: 6 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065111.907627:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c323800 00000100:00100000:0.0:1746065111.909860:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.912223:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.927871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.932995:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.936053:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+172:2004:x1830881271835520:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2860us (3055us total) trans 4294970475 rc 0/0 00000100:00100000:0.0:1746065111.936062:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1455 00002000:00100000:0.0:1746065111.936070:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012dffc000 x1830881271835520/t4294970475(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.936078:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffc000 with x1830881271835520 ext(0->7) 00010000:00010000:0.0:1746065111.936102:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10400/0x392ae0376f87c529 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e253b expref: 172 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065111.936114:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10400/0x392ae0376f87c529 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e253b expref: 172 pid: 21550 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065111.936120:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dffc000 00000100:00100000:0.0:1746065111.936733:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.938253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.941562:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.945364:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.950035:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.959988:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.962187:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+174:2002:x1830881271836672:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1819us (2191us total) trans 4294970476 rc 0/0 00000100:00100000:0.0:1746065111.962195:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1457 00002000:00100000:0.0:1746065111.962203:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d79dc00 x1830881271836672/t4294970476(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:27/0 lens 496/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.962217:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79dc00 with x1830881271836672 ext(0->7) 00010000:00010000:0.0:1746065111.962224:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x392ae0376f87c537 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2549 expref: 174 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065111.962234:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x392ae0376f87c537 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2549 expref: 174 pid: 21550 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065111.962240:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d79dc00 00000100:00100000:0.0:1746065111.964193:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.972989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.977263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.979876:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.982703:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.986969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.989724:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.993778:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.994646:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.997224:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.997260:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065111.999076:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.001702:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.002589:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+179:2005:x1830881271839104:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 714us (889us total) trans 4294970478 rc 0/0 00000100:00100000:0.0:1746065112.002595:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1461 00002000:00100000:0.0:1746065112.002600:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fff7800 x1830881271839104/t4294970478(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.002611:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7800 with x1830881271839104 ext(0->7) 00010000:00010000:0.0:1746065112.002615:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4600/0x392ae0376f87c553 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2565 expref: 179 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.002623:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b3e4600/0x392ae0376f87c553 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2565 expref: 179 pid: 21550 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.002628:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff7800 00000100:00100000:0.0:1746065112.003890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.005687:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.007632:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.010736:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.015019:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.020241:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.020892:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.026773:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.026829:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.026866:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.027247:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12300 00000100:00100000:0.0:1746065112.027254:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+179:2004:x1830881271840768:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.027261:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.027279:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7fba00/0x392ae0376f87c55a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e256c expref: 179 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.027288:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7fba00/0x392ae0376f87c55a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e256c expref: 179 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.027300:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7fba00/0x392ae0376f87c55a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e256c expref: 179 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.027628:0:9574:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.027645:0:9574:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+178:2004:x1830881271840768:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 392us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.027651:0:9574:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12300 00000100:00100000:0.0:1746065112.030258:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.037847:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.045684:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+180:2002:x1830881271841408:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 7598us (7838us total) trans 4294970479 rc 0/0 00000100:00100000:0.0:1746065112.045695:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1463 00002000:00100000:0.0:1746065112.045703:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fff5c00 x1830881271841408/t4294970479(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.045711:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5c00 with x1830881271841408 ext(0->7) 00010000:00010000:0.0:1746065112.045718:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0a00/0x392ae0376f87c568 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e257a expref: 180 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.045732:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0a00/0x392ae0376f87c568 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e257a expref: 180 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.045900:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff5c00 00000100:00100000:0.0:1746065112.049697:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.051720:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.055561:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.057943:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.059914:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.065764:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.067641:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.070694:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+182:2005:x1830881271842560:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2919us (3046us total) trans 4294970480 rc 0/0 00000100:00100000:0.0:1746065112.070704:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1465 00002000:00100000:0.0:1746065112.070711:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072a1fb80 x1830881271842560/t4294970480(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.070720:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1fb80 with x1830881271842560 ext(0->7) 00010000:00010000:0.0:1746065112.070727:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c576 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2588 expref: 182 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.070740:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c576 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2588 expref: 182 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.070747:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a1fb80 00000100:00100000:0.0:1746065112.075523:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.075612:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.078398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.078417:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271843072 00000100:00100000:0.0:1746065112.078421:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271843072 00002000:00100000:0.0:1746065112.078445:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072a1e680 x1830881271843072/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.078454:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1e680 with x1830881271843072 ext(0->4095) 00010000:00010000:0.0:1746065112.078460:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c57d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e258f expref: 6 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.078475:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c57d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e258f expref: 6 pid: 21550 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.078480:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a1e680 00000100:00100000:0.0:1746065112.078491:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1466 00000100:00100000:0.0:1746065112.078495:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881271843072:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065112.081364:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.088925:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271843456 00000100:00100000:0.0:1746065112.088932:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271843456 00002000:00100000:0.0:1746065112.088962:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f93b800 x1830881271843456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.088970:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b800 with x1830881271843456 ext(0->4095) 00002000:00010000:0.0:1746065112.088974:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f93b800 00000100:00100000:0.0:1746065112.089000:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12564 00000100:00100000:0.0:1746065112.089006:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+182:2004:x1830881271843456:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065112.089123:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+182:2004:x1830881271843456:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 117us (746us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065112.089129:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12564 00002000:00100000:0.0:1746065112.089134:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f93b800 x1830881271843456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.089140:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b800 with x1830881271843456 ext(0->4095) 00002000:00010000:0.0:1746065112.089143:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f93b800 00000100:00100000:0.0:1746065112.092056:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.098709:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.110771:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.118397:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.119183:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271844224 00000100:00100000:0.0:1746065112.119187:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271844224 00000100:00100000:0.0:1746065112.119210:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28332 00000100:00100000:0.0:1746065112.119215:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+183:1140:x1830881271844224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065112.119222:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.119234:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801307fee00/0x392ae0376f87c592 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e25a4 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.119384:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c58b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e259d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.119391:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.119393:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.119396:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801307fee00/0x392ae0376f87c592 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25a4 expref: 184 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.119417:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c58b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e259d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.119425:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c58b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e259d expref: 5 pid: 21550 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.119432:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267174016:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065112.119484:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.120257:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.124185:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.132876:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.136604:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.140161:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+187:2004:x1830881271844992:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1093us (3557us total) trans 4294970482 rc 0/0 00000100:00100000:0.0:1746065112.140180:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1469 00002000:00100000:0.0:1746065112.140188:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d6c8a80 x1830881271844992/t4294970482(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.140195:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8a80 with x1830881271844992 ext(0->7) 00010000:00010000:0.0:1746065112.140201:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801307fee00/0x392ae0376f87c592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25a4 expref: 187 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.140212:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801307fee00/0x392ae0376f87c592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25a4 expref: 187 pid: 21550 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.140218:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d6c8a80 00000100:00100000:0.0:1746065112.145166:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.149048:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271845376 00000100:00100000:0.0:1746065112.149055:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271845376 00002000:00100000:0.0:1746065112.149114:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f939c00 x1830881271845376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.149122:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881271845376 ext(0->4095) 00002000:00010000:0.0:1746065112.149126:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f939c00 00000100:00100000:0.0:1746065112.149146:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12566 00000100:00100000:0.0:1746065112.149157:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+187:2005:x1830881271845376:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065112.149253:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+186:2005:x1830881271845376:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 101us (263us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065112.149258:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12566 00002000:00100000:0.0:1746065112.149263:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f939c00 x1830881271845376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.149268:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881271845376 ext(0->4095) 00002000:00010000:0.0:1746065112.149270:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f939c00 00000100:00100000:0.0:1746065112.162607:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.162655:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.167940:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.173140:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.187176:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271846272 00000100:00100000:0.0:1746065112.187184:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271846272 00002000:00100000:0.0:1746065112.187216:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f938000 x1830881271846272/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.187225:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938000 with x1830881271846272 ext(0->7) 00010000:00010000:0.0:1746065112.187232:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10e00/0x392ae0376f87c5a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25b9 expref: 186 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.187244:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10e00/0x392ae0376f87c5a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25b9 expref: 186 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.187250:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f938000 00000100:00100000:0.0:1746065112.187265:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1471 00000100:00100000:0.0:1746065112.187271:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+186:2003:x1830881271846272:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065112.192466:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+188:2003:x1830881271846272:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 5186us (5526us total) trans 4294970483 rc 0/0 00000100:00100000:0.0:1746065112.192480:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1471 00002000:00100000:0.0:1746065112.192488:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f938000 x1830881271846272/t4294970483(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.192497:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938000 with x1830881271846272 ext(0->7) 00010000:00010000:0.0:1746065112.192504:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10e00/0x392ae0376f87c5a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25b9 expref: 188 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.192519:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10e00/0x392ae0376f87c5a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25b9 expref: 188 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.192525:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f938000 00000100:00100000:0.0:1746065112.194882:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.195274:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.197992:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.199410:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.201271:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.203148:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.206731:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.207874:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+190:2004:x1830881271847424:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 829us (1147us total) trans 4294970484 rc 0/0 00000100:00100000:0.0:1746065112.207880:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1473 00002000:00100000:0.0:1746065112.207885:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729b3480 x1830881271847424/t4294970484(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.207892:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b3480 with x1830881271847424 ext(0->7) 00010000:00010000:0.0:1746065112.207897:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11400/0x392ae0376f87c5ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25c0 expref: 190 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.207906:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11400/0x392ae0376f87c5ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25c0 expref: 190 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.207912:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729b3480 00000100:00100000:0.0:1746065112.209068:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.214753:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.215641:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.217297:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.218507:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.222134:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.224791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.228523:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+193:2003:x1830881271848704:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3392us (3730us total) trans 4294970485 rc 0/0 00000100:00100000:0.0:1746065112.228533:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1475 00002000:00100000:0.0:1746065112.228541:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729b0700 x1830881271848704/t4294970485(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.228549:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0700 with x1830881271848704 ext(0->7) 00010000:00010000:0.0:1746065112.228557:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11400/0x392ae0376f87c5bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25ce expref: 193 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.228570:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11400/0x392ae0376f87c5bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25ce expref: 193 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.228575:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729b0700 00000100:00100000:0.0:1746065112.232946:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.237416:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.241936:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.245505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.258849:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.263524:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271849984 00000100:00100000:0.0:1746065112.263528:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271849984 00010000:00010000:0.0:1746065112.263543:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f87c5ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25dc expref: 6 pid: 9642 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.263567:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12315 00000100:00100000:0.0:1746065112.263572:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881271849984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.263579:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.263593:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f87c5ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25dc expref: 6 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.263603:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f87c5ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25dc expref: 6 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.263617:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f87c5ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25dc expref: 6 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.263636:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.263638:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.263643:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f835600/0x392ae0376f87c5d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25e3 expref: 192 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.263650:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f835600/0x392ae0376f87c5d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25e3 expref: 192 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.263672:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f835600/0x392ae0376f87c5d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25e3 expref: 192 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.263682:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f835600/0x392ae0376f87c5d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25e3 expref: 192 pid: 9560 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.263692:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267176448:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065112.264923:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.274212:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.275128:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+195:2004:x1830881271850496:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 729us (920us total) trans 4294970486 rc 0/0 00000100:00100000:0.0:1746065112.275135:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1478 00002000:00100000:0.0:1746065112.275140:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729b1880 x1830881271850496/t4294970486(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.275147:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1880 with x1830881271850496 ext(0->7) 00010000:00010000:0.0:1746065112.275152:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f835600/0x392ae0376f87c5d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25e3 expref: 195 pid: 9560 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.275162:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f835600/0x392ae0376f87c5d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25e3 expref: 195 pid: 9560 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.275179:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729b1880 00000100:00100000:0.0:1746065112.280188:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.281487:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.283729:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.285898:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271851136 00000100:00100000:0.0:1746065112.285903:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271851136 00000100:00100000:0.0:1746065112.285940:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28344 00000100:00100000:0.0:1746065112.285946:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271851136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065112.285956:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.285968:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f87c5e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e25f8 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.285984:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.285989:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd74400/0x392ae0376f87c5df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25f1 expref: 194 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.285994:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065112.285997:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f87c5e6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25f8 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.286021:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd74400/0x392ae0376f87c5df lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25f1 expref: 194 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.286030:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f87c5e6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25f8 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.286038:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072615200, rc 0) 00000100:00100000:0.0:1746065112.286064:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1141:x1830881271851136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 118us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.286068:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28344 00000100:00100000:0.0:1746065112.288314:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.291221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.292157:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+196:2003:x1830881271851776:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 612us (941us total) trans 4294970487 rc 0/0 00000100:00100000:0.0:1746065112.292163:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1481 00002000:00100000:0.0:1746065112.292175:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88013077aa00 x1830881271851776/t4294970487(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.292182:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077aa00 with x1830881271851776 ext(0->7) 00010000:00010000:0.0:1746065112.292187:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bd74400/0x392ae0376f87c5df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25f1 expref: 196 pid: 9560 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.292195:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bd74400/0x392ae0376f87c5df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25f1 expref: 196 pid: 9560 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.292200:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013077aa00 00000100:00100000:0.0:1746065112.295261:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.298104:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.301841:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.301887:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.303991:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.305903:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.312378:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.314819:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+199:2002:x1830881271853056:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 698us (2444us total) trans 4294970488 rc 0/0 00000100:00100000:0.0:1746065112.314826:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1483 00002000:00100000:0.0:1746065112.314831:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f982680 x1830881271853056/t4294970488(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.314843:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982680 with x1830881271853056 ext(0->7) 00010000:00010000:0.0:1746065112.314848:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c5ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25ff expref: 199 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.314856:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c5ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e25ff expref: 199 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.314861:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f982680 00000100:00100000:0.0:1746065112.316121:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.323600:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.336660:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.339252:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.341837:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.344855:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.352870:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.354874:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.356399:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+200:2005:x1830881271854720:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1382us (1522us total) trans 4294970489 rc 0/0 00000100:00100000:0.0:1746065112.356406:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1485 00002000:00100000:0.0:1746065112.356412:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800979a4380 x1830881271854720/t4294970489(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.356420:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4380 with x1830881271854720 ext(0->7) 00010000:00010000:0.0:1746065112.356426:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09fa000/0x392ae0376f87c602 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2614 expref: 200 pid: 9560 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.356441:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09fa000/0x392ae0376f87c602 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2614 expref: 200 pid: 9560 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.356446:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979a4380 00000100:00100000:0.0:1746065112.359972:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.373197:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.383415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.385277:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.385583:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.388251:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.395416:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.399614:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+203:2003:x1830881271856000:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3987us (4200us total) trans 4294970490 rc 0/0 00000100:00100000:0.0:1746065112.399625:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1487 00002000:00100000:0.0:1746065112.399632:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009dc13100 x1830881271856000/t4294970490(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.399640:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc13100 with x1830881271856000 ext(0->7) 00010000:00010000:0.0:1746065112.399648:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb200/0x392ae0376f87c610 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2622 expref: 203 pid: 9560 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.399659:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb200/0x392ae0376f87c610 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2622 expref: 203 pid: 9560 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.399665:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009dc13100 00000100:00100000:0.0:1746065112.402046:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.403977:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.408444:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.410779:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.411535:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.413881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.416833:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.420501:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.422958:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+204:2003:x1830881271857792:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1611us (2458us total) trans 4294970491 rc 0/0 00000100:00100000:0.0:1746065112.422965:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1490 00002000:00100000:0.0:1746065112.422973:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009dc10000 x1830881271857792/t4294970491(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.422980:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10000 with x1830881271857792 ext(0->7) 00010000:00010000:0.0:1746065112.422986:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09fa000/0x392ae0376f87c625 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2637 expref: 204 pid: 9560 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.422996:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09fa000/0x392ae0376f87c625 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2637 expref: 204 pid: 9560 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.424105:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009dc10000 00000100:00100000:0.0:1746065112.436895:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.441010:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.444356:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.450189:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.454252:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271858944 00000100:00100000:0.0:1746065112.454256:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271858944 00002000:00100000:0.0:1746065112.454278:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c321f80 x1830881271858944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.454287:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321f80 with x1830881271858944 ext(0->4095) 00002000:00010000:0.0:1746065112.454291:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c321f80 00000100:00100000:0.0:1746065112.454315:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12577 00000100:00100000:0.0:1746065112.454322:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881271858944:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065112.454420:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881271858944:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 98us (860us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065112.454425:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12577 00002000:00100000:0.0:1746065112.454430:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c321f80 x1830881271858944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.454437:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321f80 with x1830881271858944 ext(0->4095) 00002000:00010000:0.0:1746065112.454439:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c321f80 00000100:00100000:0.0:1746065112.458839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.458871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.458903:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.461326:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.465872:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.467397:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+207:2002:x1830881271859840:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1280us (1527us total) trans 4294970492 rc 0/0 00000100:00100000:0.0:1746065112.467405:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1492 00002000:00100000:0.0:1746065112.467412:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009549d500 x1830881271859840/t4294970492(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.467419:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d500 with x1830881271859840 ext(0->7) 00010000:00010000:0.0:1746065112.467426:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09fa800/0x392ae0376f87c63a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e264c expref: 207 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.467436:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09fa800/0x392ae0376f87c63a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e264c expref: 207 pid: 21550 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.467441:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009549d500 00000100:00100000:0.0:1746065112.469585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.472806:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.478369:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.484237:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271860480 00000100:00100000:0.0:1746065112.484245:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271860480 00000100:00100000:0.0:1746065112.484284:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28359 00000100:00100000:0.0:1746065112.484290:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+206:1140:x1830881271860480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065112.484303:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.484317:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87c64f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2661 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.484338:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd74000/0x392ae0376f87c641 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2653 expref: 207 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.484345:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c648 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e265a expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.484350:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.484352:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.484354:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87c64f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2661 expref: 207 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.484377:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e265a expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.484386:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c648 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e265a expref: 5 pid: 21550 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.484395:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009549d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267180160:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065112.484788:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd74000/0x392ae0376f87c641 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2653 expref: 207 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.484796:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bd74000/0x392ae0376f87c641 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2653 expref: 207 pid: 21550 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.484804:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009549c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267180288:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065112.484822:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.489640:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.490253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.492267:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.492308:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.494551:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.497032:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.499549:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+208:2004:x1830881271861888:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2338us (2513us total) trans 4294970493 rc 0/0 00000100:00100000:0.0:1746065112.499558:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1496 00002000:00100000:0.0:1746065112.499566:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009549e680 x1830881271861888/t4294970493(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.499574:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549e680 with x1830881271861888 ext(0->7) 00010000:00010000:0.0:1746065112.499581:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87c64f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2661 expref: 208 pid: 9560 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.499595:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87c64f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2661 expref: 208 pid: 9560 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.499602:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009549e680 00000100:00100000:0.0:1746065112.502138:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.505051:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.507945:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.511527:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.514371:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.514729:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.518263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.518902:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.518933:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.525607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.527857:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.529197:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+211:2003:x1830881271863936:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1084us (1342us total) trans 4294970494 rc 0/0 00000100:00100000:0.0:1746065112.529204:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1499 00002000:00100000:0.0:1746065112.529210:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f18d880 x1830881271863936/t4294970494(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.529217:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18d880 with x1830881271863936 ext(0->7) 00010000:00010000:0.0:1746065112.529222:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb200/0x392ae0376f87c664 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2676 expref: 211 pid: 9560 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.529237:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb200/0x392ae0376f87c664 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2676 expref: 211 pid: 9560 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.529241:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f18d880 00000100:00100000:0.0:1746065112.532661:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.538048:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271864320 00000100:00100000:0.0:1746065112.538055:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271864320 00002000:00100000:0.0:1746065112.538110:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c321500 x1830881271864320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.538119:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321500 with x1830881271864320 ext(0->4095) 00002000:00010000:0.0:1746065112.538123:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c321500 00000100:00100000:0.0:1746065112.538678:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12581 00000100:00100000:0.0:1746065112.538686:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+210:2005:x1830881271864320:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065112.539692:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+210:2005:x1830881271864320:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 1004us (2177us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065112.539699:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12581 00002000:00100000:0.0:1746065112.539705:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c321500 x1830881271864320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.539712:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321500 with x1830881271864320 ext(0->4095) 00002000:00010000:0.0:1746065112.539716:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c321500 00000100:00100000:0.0:1746065112.544204:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.558234:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271864704 00000100:00100000:0.0:1746065112.558239:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271864704 00010000:00010000:0.0:1746065112.558261:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c66b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e267d expref: 212 pid: 21550 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.558312:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12338 00000100:00100000:0.0:1746065112.558319:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+212:2002:x1830881271864704:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.558328:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.558343:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c66b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e267d expref: 212 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.558352:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c66b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e267d expref: 212 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.558369:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c66b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e267d expref: 212 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.558390:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.559728:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+211:2002:x1830881271864704:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1406us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.559736:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12338 00000100:00100000:0.0:1746065112.559758:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271864960 00000100:00100000:0.0:1746065112.559762:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271864960 00002000:00100000:0.0:1746065112.559782:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800729b2a00 x1830881271864960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.559790:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2a00 with x1830881271864960 ext(0->4095) 00010000:00010000:0.0:1746065112.559795:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87c672 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2684 expref: 6 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.559806:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87c672 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2684 expref: 6 pid: 21550 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.559812:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729b2a00 00000100:00100000:0.0:1746065112.560998:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1500 00000100:00100000:0.0:1746065112.561462:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c4d7531-7474-4559-997c-c1b3824c301a:3766:1830881267181696:0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.561696:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065112.561715:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267182208:0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.561731:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065112.561744:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dffce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267182720:0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.561760:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065112.561770:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267183232:0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.561781:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065112.561801:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267182208:0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.561811:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746065112.561815:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3766:1830881267182080:0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.561829:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065112.561839:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267182592:0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.561852:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065112.561861:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dfffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267183104:0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.561873:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065112.561884:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c4d7531-7474-4559-997c-c1b3824c301a:3766:1830881267181696:0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.561901:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267183232 00000100:00100000:0.0:1746065112.561903:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267183232 00000100:00100000:0.0:1746065112.561947:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267183104 00000100:00100000:0.0:1746065112.561949:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267183104 00000100:00100000:0.0:1746065112.561960:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1746065112.561963:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267182592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.561981:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267182592:12345-0@lo:400:kworker.0 Request processed in 17us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.561987:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1746065112.561994:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:0.0:1746065112.561997:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267183104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.562012:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267183104:12345-0@lo:400:kworker.0 Request processed in 14us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.563163:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:0.0:1746065112.563186:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267181824 00000100:00100000:0.0:1746065112.563189:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267181824 00000100:00100000:0.0:1746065112.563202:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1746065112.563206:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3767:x1830881267181824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.563226:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3767:x1830881267181824:12345-0@lo:400:kworker.0 Request processed in 20us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.563231:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1746065112.563237:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267182336 00000100:00100000:0.0:1746065112.563239:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267182336 00000100:00100000:0.0:1746065112.563250:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267182848 00000100:00100000:0.0:1746065112.563251:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267182848 00000100:00100000:0.0:1746065112.563259:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1746065112.563262:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3767:x1830881267182848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065112.563280:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3767:x1830881267182848:12345-0@lo:400:kworker.0 Request processed in 17us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.563292:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1746065112.564973:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.567678:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.571538:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.574599:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.575572:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+212:2005:x1830881271865600:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 633us (973us total) trans 4294970495 rc 0/0 00000100:00100000:0.0:1746065112.575578:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1501 00002000:00100000:0.0:1746065112.575583:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d4a0700 x1830881271865600/t4294970495(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.575589:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0700 with x1830881271865600 ext(0->7) 00010000:00010000:0.0:1746065112.575593:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87c679 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e268b expref: 212 pid: 21550 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.575601:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87c679 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e268b expref: 212 pid: 21550 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.575606:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d4a0700 00000100:00100000:0.0:1746065112.577328:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.580505:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.580527:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271865984 00000100:00100000:0.0:1746065112.580532:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271865984 00002000:00100000:0.0:1746065112.580561:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d4a1500 x1830881271865984/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.580569:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1500 with x1830881271865984 ext(0->4095) 00002000:00010000:0.0:1746065112.580574:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d4a1500 00000100:00100000:0.0:1746065112.581400:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12583 00000100:00100000:0.0:1746065112.581407:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881271865984:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065112.581506:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881271865984:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 100us (1005us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065112.581511:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12583 00002000:00100000:0.0:1746065112.581515:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d4a1500 x1830881271865984/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.581520:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1500 with x1830881271865984 ext(0->4095) 00002000:00010000:0.0:1746065112.581523:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d4a1500 00000100:00100000:0.0:1746065112.583753:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.583833:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.584553:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28368 00000100:00100000:0.0:1746065112.584559:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+212:1141:x1830881271866240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065112.584572:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.584585:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb6d400/0x392ae0376f87c687 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e26a0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.584606:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.584608:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.584895:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb6d400/0x392ae0376f87c687 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26a0 expref: 214 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.585276:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb6d400/0x392ae0376f87c687 lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26a0 expref: 214 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.585287:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb6d400/0x392ae0376f87c687 lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26a0 expref: 214 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.585298:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb6d400, rc 0) 00000100:00100000:0.0:1746065112.585322:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+214:1141:x1830881271866240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 764us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.585328:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28368 00000100:00100000:0.0:1746065112.587780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.587879:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.591405:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.592026:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.594786:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.600280:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.603755:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+214:2005:x1830881271867392:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3206us (3471us total) trans 4294970496 rc 0/0 00000100:00100000:0.0:1746065112.603765:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1504 00002000:00100000:0.0:1746065112.603774:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d79d180 x1830881271867392/t4294970496(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.603782:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d180 with x1830881271867392 ext(0->7) 00010000:00010000:0.0:1746065112.603789:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c68e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2699 expref: 214 pid: 9560 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.603802:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c68e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2699 expref: 214 pid: 9560 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.603808:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d79d180 00000100:00100000:0.0:1746065112.607608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.610733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.615110:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.618229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.620790:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.625017:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.626021:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+217:2004:x1830881271868672:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 857us (1004us total) trans 4294970497 rc 0/0 00000100:00100000:0.0:1746065112.626027:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1506 00002000:00100000:0.0:1746065112.626032:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800979a5500 x1830881271868672/t4294970497(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.626038:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5500 with x1830881271868672 ext(0->7) 00010000:00010000:0.0:1746065112.626042:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09fae00/0x392ae0376f87c69c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26ae expref: 217 pid: 9560 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.626050:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09fae00/0x392ae0376f87c69c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26ae expref: 217 pid: 9560 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.626055:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979a5500 00000100:00100000:0.0:1746065112.627508:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.630436:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.632549:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.633811:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.635461:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.638281:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.640675:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.642114:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271870208 00000100:00100000:0.0:1746065112.642117:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271870208 00010000:00010000:0.0:1746065112.642130:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10400/0x392ae0376f87c6a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26b5 expref: 217 pid: 21550 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.644591:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.646653:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.649445:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+218:2003:x1830881271870720:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2593us (2791us total) trans 4294970498 rc 0/0 00000100:00100000:0.0:1746065112.649454:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1508 00002000:00100000:0.0:1746065112.649461:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a0918a80 x1830881271870720/t4294970498(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.649469:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918a80 with x1830881271870720 ext(0->7) 00010000:00010000:0.0:1746065112.649476:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c6b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26c3 expref: 218 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.649490:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c6b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26c3 expref: 218 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.649496:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0918a80 00000100:00100000:0.0:1746065112.650677:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.653319:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.656666:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.657495:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.659709:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.659790:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.661130:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.661389:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271871872 00000100:00100000:0.0:1746065112.661392:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271871872 00010000:00010000:0.0:1746065112.661404:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c6bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26d1 expref: 219 pid: 9559 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.661429:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12350 00000100:00100000:0.0:1746065112.661434:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+219:2002:x1830881271871872:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.661440:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.661449:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c6bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26d1 expref: 219 pid: 9559 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.661456:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c6bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26d1 expref: 219 pid: 9559 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.661474:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c6bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26d1 expref: 219 pid: 9559 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.661486:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.661487:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.661492:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x392ae0376f87c6c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26d8 expref: 218 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.661498:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x392ae0376f87c6c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26d8 expref: 218 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.661518:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x392ae0376f87c6c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26d8 expref: 218 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.661527:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x392ae0376f87c6c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26d8 expref: 218 pid: 9642 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.661540:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0918380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267186048:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065112.661838:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.664056:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.666849:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.667648:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+220:2005:x1830881271872512:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 636us (804us total) trans 4294970499 rc 0/0 00000100:00100000:0.0:1746065112.667655:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1511 00002000:00100000:0.0:1746065112.667660:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a0918380 x1830881271872512/t4294970499(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.667667:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918380 with x1830881271872512 ext(0->7) 00010000:00010000:0.0:1746065112.667670:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x392ae0376f87c6c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26d8 expref: 220 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.667679:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x392ae0376f87c6c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26d8 expref: 220 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.667683:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0918380 00000100:00100000:0.0:1746065112.669291:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.674003:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.678210:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.686997:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.687045:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.689950:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.691380:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.691416:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.694255:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.698071:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.699575:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+222:2002:x1830881271874560:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 864us (1507us total) trans 4294970500 rc 0/0 00000100:00100000:0.0:1746065112.699582:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1513 00002000:00100000:0.0:1746065112.699587:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f7c3b80 x1830881271874560/t4294970500(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.699594:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3b80 with x1830881271874560 ext(0->7) 00010000:00010000:0.0:1746065112.699600:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c6db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26ed expref: 222 pid: 9559 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.699609:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c6db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e26ed expref: 222 pid: 9559 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.699614:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7c3b80 00000100:00100000:0.0:1746065112.702833:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.706413:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.709240:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.711748:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.714641:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.714675:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.720386:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.720420:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.722633:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.727687:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.730554:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.732540:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+225:2002:x1830881271876608:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1582us (1988us total) trans 4294970501 rc 0/0 00000100:00100000:0.0:1746065112.732548:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1516 00002000:00100000:0.0:1746065112.732555:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f9faa00 x1830881271876608/t4294970501(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.732562:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9faa00 with x1830881271876608 ext(0->7) 00010000:00010000:0.0:1746065112.732568:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e400/0x392ae0376f87c6f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2702 expref: 225 pid: 9559 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.732579:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e400/0x392ae0376f87c6f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2702 expref: 225 pid: 9559 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.732584:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9faa00 00000100:00100000:0.0:1746065112.738300:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.740497:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.742183:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.744438:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.753792:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.756372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.757051:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.761021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.761058:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.761854:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.761867:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271878144 00000100:00100000:0.0:1746065112.761869:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271878144 00010000:00010000:0.0:1746065112.762022:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1200/0x392ae0376f87c6fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2710 expref: 7 pid: 9642 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.762038:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12359 00000100:00100000:0.0:1746065112.762044:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881271878144:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.762050:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.762057:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1200/0x392ae0376f87c6fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2710 expref: 7 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.762064:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1200/0x392ae0376f87c6fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2710 expref: 7 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.762074:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1200/0x392ae0376f87c6fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2710 expref: 7 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.762099:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.762101:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.762106:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2717 expref: 223 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.762113:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c705 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2717 expref: 223 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.762130:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c705 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2717 expref: 223 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.762139:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c705 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2717 expref: 223 pid: 9642 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.762148:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130693b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267188096:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065112.762188:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.764007:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.765673:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.768679:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+226:2002:x1830881271878912:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2603us (3002us total) trans 4294970502 rc 0/0 00000100:00100000:0.0:1746065112.768688:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1518 00002000:00100000:0.0:1746065112.768694:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880130693b80 x1830881271878912/t4294970502(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.768701:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130693b80 with x1830881271878912 ext(0->7) 00010000:00010000:0.0:1746065112.768707:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c705 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2717 expref: 226 pid: 9642 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.768718:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0000/0x392ae0376f87c705 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2717 expref: 226 pid: 9642 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.768723:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130693b80 00000100:00100000:0.0:1746065112.771290:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.782463:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.789569:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.794220:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.796791:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.800470:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267188736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065112.803269:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.811785:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.812757:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+229:2004:x1830881271880192:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 808us (975us total) trans 4294970503 rc 0/0 00000100:00100000:0.0:1746065112.812763:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1520 00002000:00100000:0.0:1746065112.812769:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729d4700 x1830881271880192/t4294970503(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.812775:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d4700 with x1830881271880192 ext(0->7) 00010000:00010000:0.0:1746065112.812779:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c713 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2725 expref: 229 pid: 9559 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.812788:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10600/0x392ae0376f87c713 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2725 expref: 229 pid: 9559 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.812792:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729d4700 00000100:00100000:0.0:1746065112.814669:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.828336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.834642:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.834687:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.836926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.836969:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.836995:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271881216 00000100:00100000:0.0:1746065112.836998:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271881216 00002000:00100000:0.0:1746065112.837020:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d5a2a00 x1830881271881216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.837029:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2a00 with x1830881271881216 ext(0->4095) 00010000:00010000:0.0:1746065112.837035:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f400/0x392ae0376f87c721 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2733 expref: 6 pid: 9559 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.837044:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f400/0x392ae0376f87c721 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2733 expref: 6 pid: 9559 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.837054:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a2a00 00000100:00100000:0.0:1746065112.837077:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1521 00000100:00100000:0.0:1746065112.837101:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271881216:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065112.837199:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271881216:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 116us (229us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065112.837204:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1521 00002000:00100000:0.0:1746065112.837208:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d5a2a00 x1830881271881216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.837214:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2a00 with x1830881271881216 ext(0->4095) 00010000:00010000:0.0:1746065112.837218:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f400/0x392ae0376f87c721 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2733 expref: 6 pid: 9559 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.837226:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f400/0x392ae0376f87c721 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2733 expref: 6 pid: 9559 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.837232:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a2a00 00000100:00100000:0.0:1746065112.838500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.841630:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.843997:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.846935:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.847821:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+230:2004:x1830881271881856:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 706us (885us total) trans 4294970504 rc 0/0 00000100:00100000:0.0:1746065112.847828:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1522 00002000:00100000:0.0:1746065112.847833:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d5a2d80 x1830881271881856/t4294970504(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.847841:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2d80 with x1830881271881856 ext(0->7) 00010000:00010000:0.0:1746065112.847846:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fc00/0x392ae0376f87c728 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e273a expref: 230 pid: 9559 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.847856:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fc00/0x392ae0376f87c728 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e273a expref: 230 pid: 9559 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.847861:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a2d80 00000100:00100000:0.0:1746065112.849350:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.854403:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.854958:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.857492:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.857552:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.861708:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.868362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.869214:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+233:2004:x1830881271883136:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 676us (854us total) trans 4294970505 rc 0/0 00000100:00100000:0.0:1746065112.869221:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1524 00002000:00100000:0.0:1746065112.869226:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d1e1c00 x1830881271883136/t4294970505(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.869233:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1c00 with x1830881271883136 ext(0->7) 00010000:00010000:0.0:1746065112.869237:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c736 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2748 expref: 233 pid: 9559 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.869245:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c736 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2748 expref: 233 pid: 9559 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.869251:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e1c00 00000100:00100000:0.0:1746065112.872149:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.879263:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.881848:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.882374:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.885524:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.885750:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.888131:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.890607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.893505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.893659:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28396 00000100:00100000:0.0:1746065112.893667:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271884672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065112.893684:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.893699:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013138c200/0x392ae0376f87c752 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2764 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.893725:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c74b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e275d expref: 231 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.893732:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065112.893734:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065112.893737:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013138c200/0x392ae0376f87c752 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2764 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.893760:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c74b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e275d expref: 231 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.893775:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c74b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e275d expref: 231 pid: 9560 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065112.893785:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267190528:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065112.893887:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.899284:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.907074:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+234:2004:x1830881271884800:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 5453us (7791us total) trans 4294970506 rc 0/0 00000100:00100000:0.0:1746065112.907098:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1526 00002000:00100000:0.0:1746065112.907109:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306a2680 x1830881271884800/t4294970506(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.907117:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a2680 with x1830881271884800 ext(0->7) 00010000:00010000:0.0:1746065112.907125:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c74b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e275d expref: 234 pid: 9560 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065112.907138:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c74b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e275d expref: 234 pid: 9560 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065112.907144:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306a2680 00000100:00100000:0.0:1746065112.913536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.917041:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.917150:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.922616:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.922695:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.922729:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271885568 00000100:00100000:0.0:1746065112.922736:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271885568 00010000:00010000:0.0:1746065112.922760:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013138c200/0x392ae0376f87c752 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2764 expref: 6 pid: 9642 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065112.922793:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12371 00000100:00100000:0.0:1746065112.922799:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271885568:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.922810:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.922825:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013138c200/0x392ae0376f87c752 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2764 expref: 6 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065112.922835:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013138c200/0x392ae0376f87c752 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2764 expref: 6 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065112.922854:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.922856:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.922862:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c759 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e276b expref: 234 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.922869:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c759 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e276b expref: 234 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.922891:0:9574:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c759 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e276b expref: 234 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065112.922901:0:9574:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267190912:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065112.922955:0:9574:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.926553:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.930789:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.932023:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+237:2002:x1830881271886080:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 625us (1238us total) trans 4294970507 rc 0/0 00000100:00100000:0.0:1746065112.932030:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1528 00002000:00100000:0.0:1746065112.932035:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88008fb94380 x1830881271886080/t4294970507(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.932041:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb94380 with x1830881271886080 ext(0->7) 00010000:00010000:0.0:1746065112.932045:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c759 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e276b expref: 237 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065112.932054:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c759 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e276b expref: 237 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065112.932058:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fb94380 00000100:00100000:0.0:1746065112.934913:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.940310:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.946453:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.949952:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.954050:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.954989:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.956651:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.956726:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.959072:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.962615:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+238:2004:x1830881271888128:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 919us (1078us total) trans 4294970508 rc 0/0 00000100:00100000:0.0:1746065112.962623:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1531 00002000:00100000:0.0:1746065112.962629:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fbbd500 x1830881271888128/t4294970508(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.962636:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbd500 with x1830881271888128 ext(0->7) 00010000:00010000:0.0:1746065112.962641:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f87c76e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2780 expref: 238 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065112.962650:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f87c76e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2780 expref: 238 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065112.962655:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbd500 00000100:00100000:0.0:1746065112.968277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.972901:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.976271:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.976295:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271888640 00000100:00100000:0.0:1746065112.976300:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271888640 00000100:00100000:0.0:1746065112.976345:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28402 00000100:00100000:0.0:1746065112.976352:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+237:1140:x1830881271888640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065112.976365:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.976384:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87c77c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e278e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.976405:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c775 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2787 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.976411:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.976413:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.976415:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87c77c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e278e expref: 238 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.976443:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c775 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2787 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.976483:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c775 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2787 expref: 5 pid: 9642 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065112.976494:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d651c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267191936:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065112.976718:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.977780:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.979358:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.984241:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.986539:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.988251:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+241:2005:x1830881271889408:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1293us (1714us total) trans 4294970509 rc 0/0 00000100:00100000:0.0:1746065112.988258:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1533 00002000:00100000:0.0:1746065112.988265:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d652300 x1830881271889408/t4294970509(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:28/0 lens 496/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.988272:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652300 with x1830881271889408 ext(0->7) 00010000:00010000:0.0:1746065112.988278:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87c77c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e278e expref: 241 pid: 9560 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065112.988287:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87c77c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e278e expref: 241 pid: 9560 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065112.988292:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d652300 00000100:00100000:0.0:1746065112.989542:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065112.995439:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.005839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.011541:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.011853:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.016999:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.019393:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.025539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.026734:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+242:2003:x1830881271891200:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 888us (1201us total) trans 4294970510 rc 0/0 00000100:00100000:0.0:1746065113.026741:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1536 00002000:00100000:0.0:1746065113.026747:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072978000 x1830881271891200/t4294970510(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.026753:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978000 with x1830881271891200 ext(0->7) 00010000:00010000:0.0:1746065113.026758:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27a3 expref: 242 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.026767:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27a3 expref: 242 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.026772:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072978000 00000100:00100000:0.0:1746065113.030253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.030283:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271891328 00000100:00100000:0.0:1746065113.030289:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271891328 00010000:00010000:0.0:1746065113.030314:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27a3 expref: 242 pid: 9642 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.030341:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12380 00000100:00100000:0.0:1746065113.030348:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+242:2005:x1830881271891328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065113.030358:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065113.030373:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27a3 expref: 242 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.030382:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27a3 expref: 242 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.030399:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c791 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27a3 expref: 242 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.030413:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.030414:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.030420:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87c798 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27aa expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.030427:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87c798 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27aa expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.030453:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87c798 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27aa expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065113.030462:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f84b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267192960:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065113.030712:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065113.031901:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.034414:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.036212:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.038415:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.038455:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.040128:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.041648:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.041711:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.044400:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.047310:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.048781:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+245:2003:x1830881271893248:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 910us (1474us total) trans 4294970511 rc 0/0 00000100:00100000:0.0:1746065113.048787:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1538 00002000:00100000:0.0:1746065113.048796:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012fbfbb80 x1830881271893248/t4294970511(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.048803:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfbb80 with x1830881271893248 ext(0->7) 00010000:00010000:0.0:1746065113.048808:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e400/0x392ae0376f87c7a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27b8 expref: 245 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.048818:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e400/0x392ae0376f87c7a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27b8 expref: 245 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.048824:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fbfbb80 00000100:00100000:0.0:1746065113.056658:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.060640:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.063375:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271893760 00000100:00100000:0.0:1746065113.063380:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271893760 00002000:00100000:0.0:1746065113.063405:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800729b1f80 x1830881271893760/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.063414:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1f80 with x1830881271893760 ext(0->4095) 00010000:00010000:0.0:1746065113.063421:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c7ad lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27bf expref: 246 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.063431:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c7ad lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27bf expref: 246 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.063437:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729b1f80 00000100:00100000:0.0:1746065113.063727:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1539 00000100:00100000:0.0:1746065113.063733:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+246:2005:x1830881271893760:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065113.063832:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+246:2005:x1830881271893760:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 99us (639us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065113.063837:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1539 00002000:00100000:0.0:1746065113.063842:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800729b1f80 x1830881271893760/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 488/4536 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.063848:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1f80 with x1830881271893760 ext(0->4095) 00010000:00010000:0.0:1746065113.063852:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c7ad lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27bf expref: 246 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.063860:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c7ad lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27bf expref: 246 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.063866:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729b1f80 00000100:00100000:0.0:1746065113.066072:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.066626:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.067018:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271894016 00000100:00100000:0.0:1746065113.067021:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271894016 00010000:00010000:0.0:1746065113.067037:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c7ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27bf expref: 245 pid: 9642 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.067054:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12384 00000100:00100000:0.0:1746065113.067058:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+245:2004:x1830881271894016:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065113.067065:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065113.067078:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c7ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27bf expref: 245 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.067100:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c7ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27bf expref: 245 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.067113:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87c7ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27bf expref: 245 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.067123:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.067124:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.067128:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f87c7b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27c6 expref: 244 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.067133:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f87c7b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27c6 expref: 244 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.067149:0:9574:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f87c7b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27c6 expref: 244 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.067158:0:9574:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f87c7b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27c6 expref: 244 pid: 9642 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.067184:0:9574:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267193984:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065113.067219:0:9574:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065113.069557:0:9574:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267193984:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065113.069571:0:9574:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065113.069602:0:9574:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+244:2004:x1830881271894016:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2543us (2976us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.069610:0:9574:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12384 00000100:00100000:0.0:1746065113.070341:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.073767:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.077449:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+246:2003:x1830881271894528:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3427us (3679us total) trans 4294970512 rc 0/0 00000100:00100000:0.0:1746065113.077460:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1541 00002000:00100000:0.0:1746065113.077469:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88007253ca80 x1830881271894528/t4294970512(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.077478:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253ca80 with x1830881271894528 ext(0->7) 00010000:00010000:0.0:1746065113.077486:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f87c7b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27c6 expref: 246 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.077500:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f87c7b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27c6 expref: 246 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.077506:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007253ca80 00000100:00100000:0.0:1746065113.080608:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.085021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.090372:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.093808:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.094030:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.095797:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.096728:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.097158:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.099817:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.102611:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.104525:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+248:2004:x1830881271896320:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1137us (1919us total) trans 4294970513 rc 0/0 00000100:00100000:0.0:1746065113.104533:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1544 00002000:00100000:0.0:1746065113.104539:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072978700 x1830881271896320/t4294970513(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.104546:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978700 with x1830881271896320 ext(0->7) 00010000:00010000:0.0:1746065113.104552:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f87c7c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27db expref: 248 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.104563:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f87c7c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27db expref: 248 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.104568:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072978700 00000100:00100000:0.0:1746065113.115772:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271896704 00000100:00100000:0.0:1746065113.115779:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271896704 00002000:00100000:0.0:1746065113.115812:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fbbc000 x1830881271896704/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.115821:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc000 with x1830881271896704 ext(0->4095) 00002000:00010000:0.0:1746065113.115825:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbbc000 00000100:00100000:0.0:1746065113.115853:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12613 00000100:00100000:0.0:1746065113.115859:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881271896704:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065113.117402:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881271896704:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 1538us (1838us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065113.117410:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12613 00002000:00100000:0.0:1746065113.117418:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fbbc000 x1830881271896704/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:29/0 lens 488/4536 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.117426:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc000 with x1830881271896704 ext(0->4095) 00002000:00010000:0.0:1746065113.117429:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbbc000 00000100:00100000:0.0:1746065113.124372:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.124456:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.129256:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.136302:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.146346:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.149234:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+251:2005:x1830881271897600:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2689us (2887us total) trans 4294970514 rc 0/0 00000100:00100000:0.0:1746065113.149243:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1546 00002000:00100000:0.0:1746065113.149250:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f7c3100 x1830881271897600/t4294970514(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.149258:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3100 with x1830881271897600 ext(0->7) 00010000:00010000:0.0:1746065113.149265:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87c7d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27e9 expref: 251 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.149278:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87c7d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27e9 expref: 251 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.149288:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7c3100 00000100:00100000:0.0:1746065113.152742:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.160372:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.165413:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.166924:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.166970:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28417 00000100:00100000:0.0:1746065113.166977:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271898112:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065113.166991:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.167006:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f87c7e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e27f7 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.167026:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.167027:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.167033:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f87c7e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27f7 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.167046:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f87c7e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27f7 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.167054:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a8ae00, rc 0) 00000100:00100000:0.0:1746065113.167105:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1141:x1830881271898112:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 129us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.171857:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28417 00000100:00100000:0.0:1746065113.177000:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.177291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.177628:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.180607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.193406:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.196528:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+253:2004:x1830881271899392:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1149us (3126us total) trans 4294970515 rc 0/0 00000100:00100000:0.0:1746065113.196536:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1548 00002000:00100000:0.0:1746065113.196542:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a091b480 x1830881271899392/t4294970515(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.196550:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091b480 with x1830881271899392 ext(0->7) 00010000:00010000:0.0:1746065113.196555:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f87c7ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27fe expref: 253 pid: 21550 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.196566:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f87c7ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e27fe expref: 253 pid: 21550 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.196572:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091b480 00000100:00100000:0.0:1746065113.197993:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.206435:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.210527:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.212787:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.213240:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.221631:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.225200:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.227226:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+254:2003:x1830881271900672:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1832us (2025us total) trans 4294970516 rc 0/0 00000100:00100000:0.0:1746065113.227234:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1551 00002000:00100000:0.0:1746065113.227242:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880130690380 x1830881271900672/t4294970516(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.227254:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130690380 with x1830881271900672 ext(0->7) 00010000:00010000:0.0:1746065113.227261:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fa00/0x392ae0376f87c7fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e280c expref: 254 pid: 21550 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.227273:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fa00/0x392ae0376f87c7fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e280c expref: 254 pid: 21550 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.227279:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130690380 00000100:00100000:0.0:1746065113.233701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.238833:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.240717:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.243421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.248286:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.250419:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.261804:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271901952 00000100:00100000:0.0:1746065113.261811:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271901952 00010000:00010000:0.0:1746065113.261833:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c808 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e281a expref: 256 pid: 9642 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.261958:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12397 00000100:00100000:0.0:1746065113.262544:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+256:2005:x1830881271901952:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065113.262554:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065113.262571:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c808 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e281a expref: 256 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.262581:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c808 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e281a expref: 256 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.262600:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c808 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e281a expref: 256 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.262619:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.262621:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.262626:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c80f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2821 expref: 255 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.262633:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c80f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2821 expref: 255 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.262661:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c80f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2821 expref: 255 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.262670:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c80f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2821 expref: 255 pid: 9559 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.262680:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f981880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267196928:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065113.264662:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.268318:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.270458:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+257:2002:x1830881271902720:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1244us (2144us total) trans 4294970517 rc 0/0 00000100:00100000:0.0:1746065113.270465:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1553 00002000:00100000:0.0:1746065113.270471:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009c320a80 x1830881271902720/t4294970517(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.270484:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320a80 with x1830881271902720 ext(0->7) 00010000:00010000:0.0:1746065113.270489:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c80f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2821 expref: 257 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.270499:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c80f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2821 expref: 257 pid: 9559 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.270505:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c320a80 00000100:00100000:0.0:1746065113.272409:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.276713:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.279990:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.286918:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.289427:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.292434:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.295413:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.295455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.295518:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.295560:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12399 00000100:00100000:0.0:1746065113.295565:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+257:2004:x1830881271904256:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065113.295573:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065113.295587:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f525800/0x392ae0376f87c816 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2828 expref: 257 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.295604:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f525800/0x392ae0376f87c816 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2828 expref: 257 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.295715:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f525800/0x392ae0376f87c816 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2828 expref: 257 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.295815:0:9574:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065113.295833:0:9574:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+256:2004:x1830881271904256:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 268us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.295838:0:9574:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12399 00000100:00100000:0.0:1746065113.297021:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.298826:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.300126:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+258:2002:x1830881271904768:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1098us (1298us total) trans 4294970518 rc 0/0 00000100:00100000:0.0:1746065113.300134:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1555 00002000:00100000:0.0:1746065113.300140:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009549ca80 x1830881271904768/t4294970518(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.300147:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ca80 with x1830881271904768 ext(0->7) 00010000:00010000:0.0:1746065113.300153:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87c824 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2836 expref: 258 pid: 21550 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.300174:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87c824 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2836 expref: 258 pid: 21550 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.300180:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009549ca80 00000100:00100000:0.0:1746065113.310855:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.313061:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.313359:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.316751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.320789:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.324182:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.326327:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+261:2003:x1830881271906048:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1834us (2146us total) trans 4294970519 rc 0/0 00000100:00100000:0.0:1746065113.326335:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1557 00002000:00100000:0.0:1746065113.326344:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f18ea00 x1830881271906048/t4294970519(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.326352:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18ea00 with x1830881271906048 ext(0->7) 00010000:00010000:0.0:1746065113.326359:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c832 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2844 expref: 261 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.326372:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c832 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2844 expref: 261 pid: 9559 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.326378:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f18ea00 00000100:00100000:0.0:1746065113.329279:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.339233:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.341207:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.343141:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.345027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.347737:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.348098:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.348131:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.348147:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271907072 00000100:00100000:0.0:1746065113.348152:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271907072 00010000:00010000:0.0:1746065113.348183:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c840 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2852 expref: 6 pid: 9559 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.348199:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271907328 00000100:00100000:0.0:1746065113.348201:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271907328 00010000:00010000:0.0:1746065113.348210:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524e00/0x392ae0376f87c839 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e284b expref: 261 pid: 9642 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.348233:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12404 00000100:00100000:0.0:1746065113.348238:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271907072:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065113.348247:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065113.348261:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c840 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2852 expref: 6 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.348269:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c840 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2852 expref: 6 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.348947:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c840 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2852 expref: 6 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.348960:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065113.349210:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881271907072:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 971us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.349216:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12404 00000100:00100000:0.0:1746065113.351548:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.355122:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.356877:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+262:2005:x1830881271907840:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1553us (1753us total) trans 4294970520 rc 0/0 00000100:00100000:0.0:1746065113.356888:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1560 00002000:00100000:0.0:1746065113.356894:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88007297a300 x1830881271907840/t4294970520(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.356901:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297a300 with x1830881271907840 ext(0->7) 00010000:00010000:0.0:1746065113.356907:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87c847 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2859 expref: 262 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.356918:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87c847 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2859 expref: 262 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.356923:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007297a300 00000100:00100000:0.0:1746065113.359253:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.366835:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.371243:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.371839:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.373788:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.377107:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.379746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.384253:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+265:2005:x1830881271909120:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 4279us (4505us total) trans 4294970521 rc 0/0 00000100:00100000:0.0:1746065113.384263:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1562 00002000:00100000:0.0:1746065113.384274:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072a05180 x1830881271909120/t4294970521(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.384282:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a05180 with x1830881271909120 ext(0->7) 00010000:00010000:0.0:1746065113.384290:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f400/0x392ae0376f87c855 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2867 expref: 265 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.384304:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f400/0x392ae0376f87c855 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2867 expref: 265 pid: 9559 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.384310:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a05180 00000100:00100000:0.0:1746065113.385660:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.393684:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.395189:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.395225:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.397825:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.402845:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.408855:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.412233:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+266:2005:x1830881271910400:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3156us (3377us total) trans 4294970522 rc 0/0 00000100:00100000:0.0:1746065113.412245:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1564 00002000:00100000:0.0:1746065113.412255:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009dc3b100 x1830881271910400/t4294970522(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.412263:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3b100 with x1830881271910400 ext(0->7) 00010000:00010000:0.0:1746065113.412271:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c863 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e287c expref: 266 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.412285:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c863 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e287c expref: 266 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.412292:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009dc3b100 00000100:00100000:0.0:1746065113.416259:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.422039:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.426383:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.429491:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.433483:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.444860:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271911680 00000100:00100000:0.0:1746065113.444868:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271911680 00002000:00100000:0.0:1746065113.444906:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fbbce00 x1830881271911680/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.444916:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbce00 with x1830881271911680 ext(0->7) 00010000:00010000:0.0:1746065113.444923:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f87c871 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2883 expref: 267 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.444936:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f87c871 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2883 expref: 267 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.444943:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbce00 00000100:00100000:0.0:1746065113.444959:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1566 00000100:00100000:0.0:1746065113.444965:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+267:2005:x1830881271911680:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065113.448846:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+269:2005:x1830881271911680:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3874us (4375us total) trans 4294970523 rc 0/0 00000100:00100000:0.0:1746065113.448857:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1566 00002000:00100000:0.0:1746065113.448866:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fbbce00 x1830881271911680/t4294970523(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.448874:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbce00 with x1830881271911680 ext(0->7) 00010000:00010000:0.0:1746065113.448883:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f87c871 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2883 expref: 269 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.448903:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f87c871 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2883 expref: 269 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.448909:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbce00 00000100:00100000:0.0:1746065113.450635:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.450700:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.456287:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267200512:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065113.456305:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:0.0:1746065113.456615:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+269:1140:x1830881271911808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4899us (5981us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.456623:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28439 00000100:00100000:0.0:1746065113.456935:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271912192 00000100:00100000:0.0:1746065113.456941:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271912192 00002000:00100000:0.0:1746065113.456976:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fbbf800 x1830881271912192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.456986:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881271912192 ext(0->4095) 00010000:00010000:0.0:1746065113.456992:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87c878 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e288a expref: 269 pid: 21550 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.457004:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87c878 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e288a expref: 269 pid: 21550 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.457010:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbf800 00000100:00100000:0.0:1746065113.459228:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.459291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.463130:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.463191:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271912704 00000100:00100000:0.0:1746065113.463196:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271912704 00002000:00100000:0.0:1746065113.463221:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012f087100 x1830881271912704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.463229:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f087100 with x1830881271912704 ext(0->4095) 00010000:00010000:0.0:1746065113.463235:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2891 expref: 268 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.463244:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2891 expref: 268 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.463250:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f087100 00000100:00100000:0.0:1746065113.463263:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1568 00000100:00100000:0.0:1746065113.463268:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+268:2004:x1830881271912704:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065113.463354:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+268:2004:x1830881271912704:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 86us (224us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065113.463359:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1568 00002000:00100000:0.0:1746065113.463363:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012f087100 x1830881271912704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 488/4536 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.463369:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f087100 with x1830881271912704 ext(0->4095) 00010000:00010000:0.0:1746065113.463373:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2891 expref: 268 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.463380:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2891 expref: 268 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.463389:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f087100 00000100:00100000:0.0:1746065113.467372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.468825:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+270:2003:x1830881271912960:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 686us (1460us total) trans 4294970524 rc 0/0 00000100:00100000:0.0:1746065113.468832:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1569 00002000:00100000:0.0:1746065113.468838:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a09fe300 x1830881271912960/t4294970524(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.468845:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fe300 with x1830881271912960 ext(0->7) 00010000:00010000:0.0:1746065113.468850:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2891 expref: 270 pid: 9642 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.468859:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f87c87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2891 expref: 270 pid: 9642 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.468864:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a09fe300 00000100:00100000:0.0:1746065113.477322:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.480443:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.487488:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.487536:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.494457:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.494494:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.497423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.497493:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.499829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.507010:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.515779:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+272:2002:x1830881271914752:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 8533us (8769us total) trans 4294970525 rc 0/0 00000100:00100000:0.0:1746065113.515790:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1572 00002000:00100000:0.0:1746065113.515800:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009ea75f80 x1830881271914752/t4294970525(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.515809:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881271914752 ext(0->7) 00010000:00010000:0.0:1746065113.515817:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524e00/0x392ae0376f87c894 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28a6 expref: 272 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.515830:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524e00/0x392ae0376f87c894 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28a6 expref: 272 pid: 9559 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.515836:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea75f80 00000100:00100000:0.0:1746065113.520850:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.523381:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.538605:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271915264 00000100:00100000:0.0:1746065113.538611:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271915264 00002000:00100000:0.0:1746065113.538642:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fbbe300 x1830881271915264/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.538652:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbe300 with x1830881271915264 ext(0->4095) 00010000:00010000:0.0:1746065113.538660:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c89b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28ad expref: 6 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.538670:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c89b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28ad expref: 6 pid: 9559 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.538676:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbe300 00000100:00100000:0.0:1746065113.538703:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1573 00000100:00100000:0.0:1746065113.538708:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271915264:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065113.538796:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271915264:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 87us (484us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065113.538801:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1573 00002000:00100000:0.0:1746065113.538805:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fbbe300 x1830881271915264/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:29/0 lens 488/4536 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.538812:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbe300 with x1830881271915264 ext(0->4095) 00010000:00010000:0.0:1746065113.538816:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c89b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28ad expref: 6 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.538824:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c89b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28ad expref: 6 pid: 9559 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.538829:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbe300 00000100:00100000:0.0:1746065113.545389:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.548008:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.550228:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.553938:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.556554:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.559578:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.562010:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.564870:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.564910:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.568310:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.568340:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.571655:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.575388:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.579761:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.583128:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.585695:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+276:2005:x1830881271917824:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2390us (2561us total) trans 4294970527 rc 0/0 00000100:00100000:0.0:1746065113.585704:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1576 00002000:00100000:0.0:1746065113.585720:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880124b88e00 x1830881271917824/t4294970527(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.585732:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88e00 with x1830881271917824 ext(0->7) 00010000:00010000:0.0:1746065113.585740:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f525400/0x392ae0376f87c8b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28c9 expref: 276 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.585753:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f525400/0x392ae0376f87c8b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28c9 expref: 276 pid: 9559 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.585759:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880124b88e00 00000100:00100000:0.0:1746065113.587143:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.589384:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.595710:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.597412:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.599076:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.602455:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.608471:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.612175:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+279:2003:x1830881271919104:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1936us (3706us total) trans 4294970528 rc 0/0 00000100:00100000:0.0:1746065113.612183:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1578 00002000:00100000:0.0:1746065113.612192:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a091e680 x1830881271919104/t4294970528(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.612202:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091e680 with x1830881271919104 ext(0->7) 00010000:00010000:0.0:1746065113.612209:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c8c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28d7 expref: 279 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.612222:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c8c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28d7 expref: 279 pid: 9559 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.612228:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091e680 00000100:00100000:0.0:1746065113.622321:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.623597:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.630646:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.633901:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.634393:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.638180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.645057:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.647379:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+280:2004:x1830881271920384:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2051us (2321us total) trans 4294970529 rc 0/0 00000100:00100000:0.0:1746065113.647388:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1581 00002000:00100000:0.0:1746065113.647396:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a091f800 x1830881271920384/t4294970529(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.647404:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f800 with x1830881271920384 ext(0->7) 00010000:00010000:0.0:1746065113.647410:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87c8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28e5 expref: 280 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.647427:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87c8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28e5 expref: 280 pid: 9559 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.647433:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091f800 00000100:00100000:0.0:1746065113.649954:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.653264:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.654475:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.656133:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.657800:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.660829:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.664436:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271921664 00000100:00100000:0.0:1746065113.664444:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271921664 00002000:00100000:0.0:1746065113.664479:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f7c0700 x1830881271921664/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.664488:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0700 with x1830881271921664 ext(0->7) 00010000:00010000:0.0:1746065113.664495:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c8e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28f3 expref: 281 pid: 21550 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.664507:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c8e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28f3 expref: 281 pid: 21550 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.664512:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7c0700 00000100:00100000:0.0:1746065113.664528:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1583 00000100:00100000:0.0:1746065113.664534:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+281:2003:x1830881271921664:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065113.666247:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+283:2003:x1830881271921664:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1706us (1872us total) trans 4294970530 rc 0/0 00000100:00100000:0.0:1746065113.666255:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1583 00002000:00100000:0.0:1746065113.666262:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f7c0700 x1830881271921664/t4294970530(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.666270:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0700 with x1830881271921664 ext(0->7) 00010000:00010000:0.0:1746065113.666277:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c8e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28f3 expref: 283 pid: 21550 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.666289:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87c8e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e28f3 expref: 283 pid: 21550 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.666296:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7c0700 00000100:00100000:0.0:1746065113.668326:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.671682:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.676845:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.680760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.682294:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.685136:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.685391:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.687405:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.692703:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.695594:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.698503:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+285:2002:x1830881271923456:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2293us (2907us total) trans 4294970531 rc 0/0 00000100:00100000:0.0:1746065113.698512:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1585 00002000:00100000:0.0:1746065113.698519:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d5a1880 x1830881271923456/t4294970531(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.698533:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1880 with x1830881271923456 ext(0->7) 00010000:00010000:0.0:1746065113.698540:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f87c8f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2908 expref: 285 pid: 9560 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.698553:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f87c8f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2908 expref: 285 pid: 9560 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.698559:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a1880 00000100:00100000:0.0:1746065113.704894:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.713325:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.719896:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271923968 00000100:00100000:0.0:1746065113.719925:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271923968 00000100:00100000:0.0:1746065113.719964:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28458 00000100:00100000:0.0:1746065113.719970:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271923968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065113.719984:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.719999:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cd6600/0x392ae0376f87c904 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2916 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.720019:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.720021:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.720027:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd6600/0x392ae0376f87c904 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2916 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.720039:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cd6600/0x392ae0376f87c904 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2916 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.720048:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd6600, rc 0) 00000100:00100000:0.0:1746065113.720525:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1141:x1830881271923968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 553us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.720531:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28458 00000100:00100000:0.0:1746065113.723125:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.724375:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.726363:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.726784:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.726823:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.726852:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271924736 00000100:00100000:0.0:1746065113.726854:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271924736 00010000:00010000:0.0:1746065113.726864:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd6600/0x392ae0376f87c904 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2916 expref: 6 pid: 9560 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.726880:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12432 00000100:00100000:0.0:1746065113.726884:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881271924736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065113.726892:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065113.726905:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cd6600/0x392ae0376f87c904 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2916 expref: 6 pid: 9560 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.726920:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cd6600/0x392ae0376f87c904 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2916 expref: 6 pid: 9560 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.727183:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cd6600/0x392ae0376f87c904 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2916 expref: 6 pid: 9560 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.727195:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.727196:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.727202:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c90b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e291d expref: 284 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.727209:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c90b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e291d expref: 284 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.727230:0:9574:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c90b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e291d expref: 284 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065113.727240:0:9574:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130178a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267205248:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065113.727272:0:9574:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065113.728889:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.731474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.733219:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+287:2003:x1830881271925248:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1368us (1746us total) trans 4294970532 rc 0/0 00000100:00100000:0.0:1746065113.733226:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1588 00002000:00100000:0.0:1746065113.733233:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880130178a80 x1830881271925248/t4294970532(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.733241:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130178a80 with x1830881271925248 ext(0->7) 00010000:00010000:0.0:1746065113.733246:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c90b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e291d expref: 287 pid: 9560 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.733257:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x392ae0376f87c90b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e291d expref: 287 pid: 9560 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.733264:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130178a80 00000100:00100000:0.0:1746065113.740841:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.746388:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.749576:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.749636:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.751869:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.753643:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.754778:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.755019:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.757174:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.761816:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.764382:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+289:2003:x1830881271927040:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1631us (2570us total) trans 4294970533 rc 0/0 00000100:00100000:0.0:1746065113.764390:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1591 00002000:00100000:0.0:1746065113.764397:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d79ea00 x1830881271927040/t4294970533(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.764404:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ea00 with x1830881271927040 ext(0->7) 00010000:00010000:0.0:1746065113.764411:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f525400/0x392ae0376f87c920 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2932 expref: 289 pid: 21550 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.764421:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f525400/0x392ae0376f87c920 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2932 expref: 289 pid: 21550 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.764427:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d79ea00 00000100:00100000:0.0:1746065113.771600:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.774667:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.774751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.776450:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.776924:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.780946:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.786335:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.790734:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.793688:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.800594:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.804302:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.804759:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.808393:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.808583:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.811459:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.814373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.815132:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+293:2002:x1830881271929984:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 581us (762us total) trans 4294970535 rc 0/0 00000100:00100000:0.0:1746065113.815138:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1596 00002000:00100000:0.0:1746065113.815144:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fff4000 x1830881271929984/t4294970535(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.815151:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4000 with x1830881271929984 ext(0->7) 00010000:00010000:0.0:1746065113.815168:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c943 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2955 expref: 293 pid: 21550 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.815180:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x392ae0376f87c943 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2955 expref: 293 pid: 21550 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.815185:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff4000 00000100:00100000:0.0:1746065113.816875:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.820012:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.824013:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.827000:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.831631:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.835359:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.839474:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.841303:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.841344:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.847277:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.854733:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.855894:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+294:2002:x1830881271932032:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 967us (1166us total) trans 4294970536 rc 0/0 00000100:00100000:0.0:1746065113.855901:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1598 00002000:00100000:0.0:1746065113.855907:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f4e9f80 x1830881271932032/t4294970536(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.855914:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9f80 with x1830881271932032 ext(0->7) 00010000:00010000:0.0:1746065113.855919:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f525400/0x392ae0376f87c958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e296a expref: 294 pid: 9559 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.855930:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f525400/0x392ae0376f87c958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e296a expref: 294 pid: 9559 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.855936:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f4e9f80 00000100:00100000:0.0:1746065113.862121:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.869453:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.870137:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.880672:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.880715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.883904:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.887404:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267208448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065113.887458:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065113.887982:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267208448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065113.891488:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.895191:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.899363:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.913215:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.916692:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.922775:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.923344:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.924672:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.926046:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.928621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.931070:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.931945:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+298:2002:x1830881271934976:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 718us (878us total) trans 4294970538 rc 0/0 00000100:00100000:0.0:1746065113.931951:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1603 00002000:00100000:0.0:1746065113.931956:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729d7480 x1830881271934976/t4294970538(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.931962:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d7480 with x1830881271934976 ext(0->7) 00010000:00010000:0.0:1746065113.931967:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524e00/0x392ae0376f87c97b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e298d expref: 298 pid: 9559 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065113.931976:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524e00/0x392ae0376f87c97b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e298d expref: 298 pid: 9559 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065113.931985:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729d7480 00000100:00100000:0.0:1746065113.933128:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.939582:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.944849:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.944881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.946694:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.947406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.952065:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.960030:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.966732:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.969986:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.972190:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.973860:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.975195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.978207:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.981239:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.982551:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+302:2004:x1830881271937920:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1020us (1311us total) trans 4294970540 rc 0/0 00000100:00100000:0.0:1746065113.982557:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1608 00002000:00100000:0.0:1746065113.982562:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a091bb80 x1830881271937920/t4294970540(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:29/0 lens 496/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.982569:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091bb80 with x1830881271937920 ext(0->7) 00010000:00010000:0.0:1746065113.982573:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87c99e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e29b0 expref: 302 pid: 9559 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065113.982586:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87c99e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e29b0 expref: 302 pid: 9559 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065113.982591:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091bb80 00000100:00100000:0.0:1746065113.984322:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.990881:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.994187:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.998331:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065113.998973:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.001791:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.004578:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.009675:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.012699:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.024890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.025346:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.028411:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.028877:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.032819:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.036872:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.040252:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.044117:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.051881:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+306:2004:x1830881271940864:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 7383us (7756us total) trans 4294970542 rc 0/0 00000100:00100000:0.0:1746065114.051891:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1613 00002000:00100000:0.0:1746065114.051901:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d653480 x1830881271940864/t4294970542(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.051915:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d653480 with x1830881271940864 ext(0->7) 00010000:00010000:0.0:1746065114.051923:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c9c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e29d3 expref: 306 pid: 9642 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.051937:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1c00/0x392ae0376f87c9c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e29d3 expref: 306 pid: 9642 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.051943:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d653480 00000100:00100000:0.0:1746065114.054178:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.057231:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.061478:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.064547:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.067042:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.072289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.075782:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.078247:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+308:2005:x1830881271942016:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1177us (2465us total) trans 4294970543 rc 0/0 00000100:00100000:0.0:1746065114.078255:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1615 00002000:00100000:0.0:1746065114.078261:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009e889180 x1830881271942016/t4294970543(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.078269:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889180 with x1830881271942016 ext(0->7) 00010000:00010000:0.0:1746065114.078275:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87c9cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e29e1 expref: 308 pid: 9642 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.078286:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87c9cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e29e1 expref: 308 pid: 9642 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.078292:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e889180 00000100:00100000:0.0:1746065114.079458:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.082693:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.085029:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.085445:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.087694:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.089486:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.091199:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.094293:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+311:2003:x1830881271943296:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2979us (3088us total) trans 4294970544 rc 0/0 00000100:00100000:0.0:1746065114.094303:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1617 00002000:00100000:0.0:1746065114.094312:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009e88aa00 x1830881271943296/t4294970544(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.094321:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88aa00 with x1830881271943296 ext(0->7) 00010000:00010000:0.0:1746065114.094328:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0800/0x392ae0376f87c9dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e29ef expref: 311 pid: 9642 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.094343:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0800/0x392ae0376f87c9dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e29ef expref: 311 pid: 9642 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.094349:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e88aa00 00000100:00100000:0.0:1746065114.098579:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.102274:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.104201:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.104638:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.104656:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271943936 00000100:00100000:0.0:1746065114.104659:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271943936 00000100:00100000:0.0:1746065114.104677:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28492 00000100:00100000:0.0:1746065114.104681:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271943936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065114.104687:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.104697:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc200/0x392ae0376f87c9f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2a04 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.104707:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.104710:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cd6a00/0x392ae0376f87c9eb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e29fd expref: 311 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.104715:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.104717:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc200/0x392ae0376f87c9f2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a04 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.104733:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cd6a00/0x392ae0376f87c9eb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e29fd expref: 311 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.104742:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc200/0x392ae0376f87c9f2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a04 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.104750:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc200, rc 0) 00000100:00100000:0.0:1746065114.104767:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1141:x1830881271943936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 86us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.104775:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28492 00000100:00100000:0.0:1746065114.106016:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.109112:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.112978:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000001:00080000:0.0:1746065114.115196:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970545 is committed 00000100:00100000:0.0:1746065114.125213:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.128534:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.129855:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.132336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.132375:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.138737:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.140517:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881271945856:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1595us (1781us total) trans 4294970546 rc 0/0 00000100:00100000:0.0:1746065114.140526:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1621 00002000:00100000:0.0:1746065114.140532:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880094825500 x1830881271945856/t4294970546(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.140540:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094825500 with x1830881271945856 ext(0->7) 00010000:00010000:0.0:1746065114.140546:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87c9f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a0b expref: 9 pid: 9642 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.140558:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87c9f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a0b expref: 9 pid: 9642 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.140564:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094825500 00000100:00100000:0.0:1746065114.152223:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.155334:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.156624:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.156851:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.158948:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.158979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.159013:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.159028:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271946880 00000100:00100000:0.0:1746065114.159032:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271946880 00010000:00010000:0.0:1746065114.159052:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87ca00 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a12 expref: 10 pid: 9560 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.159068:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271947008 00000100:00100000:0.0:1746065114.159070:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271947008 00010000:00010000:0.0:1746065114.159077:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87ca07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a19 expref: 6 pid: 9560 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.159105:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12469 00000100:00100000:0.0:1746065114.159109:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881271946880:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.159117:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.159130:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87ca00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a12 expref: 10 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.159137:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87ca00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a12 expref: 10 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.159166:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f524400/0x392ae0376f87ca00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a12 expref: 10 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.159178:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.159193:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881271946880:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.159197:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12469 00000100:00100000:0.0:1746065114.159208:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12470 00000100:00100000:0.0:1746065114.159213:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881271947008:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.159218:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.159223:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87ca07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a19 expref: 6 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.159230:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87ca07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a19 expref: 6 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.159240:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87ca07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a19 expref: 6 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.159526:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.159528:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.159534:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0a00/0x392ae0376f87ca0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a20 expref: 9 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.159540:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0a00/0x392ae0376f87ca0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a20 expref: 9 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.159572:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0a00/0x392ae0376f87ca0e lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a20 expref: 9 pid: 9642 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.159578:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0a00/0x392ae0376f87ca0e lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a20 expref: 9 pid: 9642 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.159585:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267214336:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065114.159952:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.161728:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.163601:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.165654:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2004:x1830881271947648:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1544us (2056us total) trans 4294970547 rc 0/0 00000100:00100000:0.0:1746065114.165661:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1624 00002000:00100000:0.0:1746065114.165667:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880094827800 x1830881271947648/t4294970547(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.165673:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094827800 with x1830881271947648 ext(0->7) 00010000:00010000:0.0:1746065114.165679:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0a00/0x392ae0376f87ca0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a20 expref: 11 pid: 9642 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.165689:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0a00/0x392ae0376f87ca0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a20 expref: 11 pid: 9642 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.165695:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094827800 00000100:00100000:0.0:1746065114.176989:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.177076:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.181488:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.185247:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.187281:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.193005:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.199433:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.203311:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2003:x1830881271948928:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2004us (3915us total) trans 4294970548 rc 0/0 00000100:00100000:0.0:1746065114.203324:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1627 00002000:00100000:0.0:1746065114.203331:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fb64e00 x1830881271948928/t4294970548(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.203344:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64e00 with x1830881271948928 ext(0->7) 00010000:00010000:0.0:1746065114.203352:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87ca1c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a2e expref: 12 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.203365:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87ca1c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a2e expref: 12 pid: 21550 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.203370:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb64e00 00000100:00100000:0.0:1746065114.210348:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.215500:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.216133:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.224712:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.224759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.228344:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.232572:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.233872:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881271950208:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 835us (1304us total) trans 4294970549 rc 0/0 00000100:00100000:0.0:1746065114.233879:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1630 00002000:00100000:0.0:1746065114.233884:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fb66300 x1830881271950208/t4294970549(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.233892:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb66300 with x1830881271950208 ext(0->7) 00010000:00010000:0.0:1746065114.233897:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0800/0x392ae0376f87ca2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a3c expref: 15 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.233906:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0800/0x392ae0376f87ca2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a3c expref: 15 pid: 9560 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.233912:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb66300 00000100:00100000:0.0:1746065114.235455:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.237725:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.240390:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.240755:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.244716:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.245343:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.248482:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.252031:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.263479:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.267117:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.269383:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881271951872:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1058us (2267us total) trans 4294970550 rc 0/0 00000100:00100000:0.0:1746065114.269389:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1632 00002000:00100000:0.0:1746065114.269395:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880093858380 x1830881271951872/t4294970550(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.269402:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858380 with x1830881271951872 ext(0->7) 00010000:00010000:0.0:1746065114.269407:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0600/0x392ae0376f87ca3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a51 expref: 16 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.269416:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0600/0x392ae0376f87ca3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a51 expref: 16 pid: 9560 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.269421:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093858380 00000100:00100000:0.0:1746065114.270660:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.274033:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.276007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.278419:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.281366:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.281398:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.286120:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.286596:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.286628:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.286642:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271953408 00000100:00100000:0.0:1746065114.286645:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271953408 00000100:00100000:0.0:1746065114.286663:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28507 00000100:00100000:0.0:1746065114.286669:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:1141:x1830881271953408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065114.286680:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.286690:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc800/0x392ae0376f87ca5b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2a6d expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.286702:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.286706:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0400/0x392ae0376f87ca54 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a66 expref: 19 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.286712:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.286715:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc800/0x392ae0376f87ca5b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a6d expref: 19 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.286737:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0400/0x392ae0376f87ca54 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a66 expref: 19 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.286746:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc800/0x392ae0376f87ca5b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a6d expref: 19 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.286757:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc800, rc 0) 00000100:00100000:0.0:1746065114.286772:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:1141:x1830881271953408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 104us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.286777:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28507 00000100:00100000:0.0:1746065114.289491:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.292605:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.293505:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2004:x1830881271953920:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 651us (905us total) trans 4294970551 rc 0/0 00000100:00100000:0.0:1746065114.293512:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1634 00002000:00100000:0.0:1746065114.293517:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009385a300 x1830881271953920/t4294970551(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.293523:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385a300 with x1830881271953920 ext(0->7) 00010000:00010000:0.0:1746065114.293528:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0400/0x392ae0376f87ca54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a66 expref: 19 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.293537:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0400/0x392ae0376f87ca54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a66 expref: 19 pid: 9560 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.293542:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009385a300 00000100:00100000:0.0:1746065114.294921:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.297329:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.299446:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.302032:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.302525:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.304737:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.305549:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.305750:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.307502:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.310253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.312045:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:2002:x1830881271955712:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1321us (1794us total) trans 4294970552 rc 0/0 00000100:00100000:0.0:1746065114.312054:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1637 00002000:00100000:0.0:1746065114.312061:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880093858000 x1830881271955712/t4294970552(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.312069:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858000 with x1830881271955712 ext(0->7) 00010000:00010000:0.0:1746065114.312076:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87ca69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a7b expref: 21 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.312126:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87ca69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a7b expref: 21 pid: 9560 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.312132:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093858000 00000100:00100000:0.0:1746065114.315439:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.318495:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.320689:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.320748:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.320865:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28512 00000100:00100000:0.0:1746065114.320870:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271956224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065114.320876:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.320883:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f87ca77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2a89 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.320900:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.320901:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.320906:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f87ca77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a89 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.320942:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f87ca77 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a89 expref: 6 pid: 9559 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.320948:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f87ca77 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a89 expref: 6 pid: 9559 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.320954:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc400, rc 0) 00000100:00100000:0.0:1746065114.320987:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1141:x1830881271956224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 117us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.320992:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28512 00000100:00100000:0.0:1746065114.322297:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.324519:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.324550:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.324576:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.324588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.324598:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.324621:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.324635:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.324647:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271957888 00000100:00100000:0.0:1746065114.324651:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271957888 00000100:00100000:0.0:1746065114.324669:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271957632 00000100:00100000:0.0:1746065114.324671:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271957632 00000100:00100000:0.0:1746065114.324686:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271957248 00000100:00100000:0.0:1746065114.324687:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271957248 00000100:00100000:0.0:1746065114.324700:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 790 00000100:00100000:0.0:1746065114.324706:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881271957632:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065114.324737:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881271957632:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 32us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.324742:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 790 00000100:00100000:0.0:1746065114.324752:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 791 00000100:00100000:0.0:1746065114.324756:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2002:x1830881271957248:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065114.324775:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2002:x1830881271957248:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 19us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.324778:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 791 00000100:00100000:0.0:1746065114.324785:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28513 00000100:00100000:0.0:1746065114.324789:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:1141:x1830881271957888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065114.324795:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.324804:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc600/0x392ae0376f87ca85 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2a97 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.324816:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.324820:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fa00/0x392ae0376f87ca7e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a90 expref: 21 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.324825:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.324828:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc600/0x392ae0376f87ca85 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a97 expref: 21 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.324848:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fa00/0x392ae0376f87ca7e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a90 expref: 21 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.324857:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc600/0x392ae0376f87ca85 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a97 expref: 21 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.324865:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc600, rc 0) 00000100:00100000:0.0:1746065114.324879:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1141:x1830881271957888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.324883:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28513 00000100:00100000:0.0:1746065114.324909:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.324945:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.324969:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271956992 00000100:00100000:0.0:1746065114.324971:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271956992 00000100:00100000:0.0:1746065114.324985:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1135 00000100:00100000:0.0:1746065114.324988:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2002:x1830881271957120:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065114.325009:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2002:x1830881271957120:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 20us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.325013:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1135 00000100:00100000:0.0:1746065114.325459:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1137 00000100:00100000:0.0:1746065114.325465:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881271956992:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065114.325487:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881271956992:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 22us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.325492:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1137 00000100:00100000:0.0:1746065114.329127:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.334744:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.336874:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2004:x1830881271958400:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1596us (2132us total) trans 4294970553 rc 0/0 00000100:00100000:0.0:1746065114.336883:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1640 00002000:00100000:0.0:1746065114.336889:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a0918000 x1830881271958400/t4294970553(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.336899:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918000 with x1830881271958400 ext(0->7) 00010000:00010000:0.0:1746065114.336906:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fa00/0x392ae0376f87ca7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a90 expref: 23 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.336918:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fa00/0x392ae0376f87ca7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a90 expref: 23 pid: 9560 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.336924:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0918000 00000100:00100000:0.0:1746065114.341293:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.342014:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.344514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.348368:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.348516:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.352943:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.358381:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.360871:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2002:x1830881271959680:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2258us (2490us total) trans 4294970554 rc 0/0 00000100:00100000:0.0:1746065114.360882:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1643 00002000:00100000:0.0:1746065114.360890:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d6cbb80 x1830881271959680/t4294970554(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.360898:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cbb80 with x1830881271959680 ext(0->7) 00010000:00010000:0.0:1746065114.360906:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0600/0x392ae0376f87ca8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a9e expref: 24 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.360920:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0600/0x392ae0376f87ca8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2a9e expref: 24 pid: 9560 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.360926:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d6cbb80 00000100:00100000:0.0:1746065114.365951:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.369223:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.370559:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.372415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.373538:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.376263:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.378657:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.380670:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2003:x1830881271960960:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1527us (2015us total) trans 4294970555 rc 0/0 00000100:00100000:0.0:1746065114.380678:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1645 00002000:00100000:0.0:1746065114.380685:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012fbf8380 x1830881271960960/t4294970555(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.380692:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8380 with x1830881271960960 ext(0->7) 00010000:00010000:0.0:1746065114.380698:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87ca9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2aac expref: 27 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.380715:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87ca9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2aac expref: 27 pid: 9560 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.380720:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fbf8380 00000100:00100000:0.0:1746065114.382738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.384753:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.388585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.390580:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.390733:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.392953:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.393018:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.394630:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.394668:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.399033:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.402271:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.403296:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2004:x1830881271963008:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 792us (1029us total) trans 4294970556 rc 0/0 00000100:00100000:0.0:1746065114.403303:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1648 00002000:00100000:0.0:1746065114.403309:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f7c0380 x1830881271963008/t4294970556(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.403316:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0380 with x1830881271963008 ext(0->7) 00010000:00010000:0.0:1746065114.403321:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fa00/0x392ae0376f87caaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ac1 expref: 28 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.403330:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fa00/0x392ae0376f87caaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ac1 expref: 28 pid: 9560 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.403335:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7c0380 00000100:00100000:0.0:1746065114.412386:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.418753:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.422672:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.423624:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.427729:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.428610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.430931:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.432370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.435036:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.439163:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.447250:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881271964800:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 7570us (8093us total) trans 4294970557 rc 0/0 00000100:00100000:0.0:1746065114.447262:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1651 00002000:00100000:0.0:1746065114.447273:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009e88b800 x1830881271964800/t4294970557(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.447282:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88b800 with x1830881271964800 ext(0->7) 00010000:00010000:0.0:1746065114.447290:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87cac4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ad6 expref: 30 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.447304:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87cac4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ad6 expref: 30 pid: 21550 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.447310:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e88b800 00000100:00100000:0.0:1746065114.450258:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.452798:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.455057:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.458520:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.461964:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.466811:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.472985:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.477819:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2002:x1830881271965952:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1533us (4838us total) trans 4294970558 rc 0/0 00000100:00100000:0.0:1746065114.477829:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1653 00002000:00100000:0.0:1746065114.477837:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009e88bb80 x1830881271965952/t4294970558(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.477845:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88bb80 with x1830881271965952 ext(0->7) 00010000:00010000:0.0:1746065114.477854:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cad2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ae4 expref: 32 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.477866:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cad2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ae4 expref: 32 pid: 21550 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.477872:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e88bb80 00000100:00100000:0.0:1746065114.480963:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271966080 00000100:00100000:0.0:1746065114.480970:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271966080 00000100:00100000:0.0:1746065114.481003:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28526 00000100:00100000:0.0:1746065114.481009:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:1140:x1830881271966080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065114.481023:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.481037:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd800/0x392ae0376f87cae0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2af2 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.481059:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.481064:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87cad9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2aeb expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.481069:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065114.481073:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd800/0x392ae0376f87cae0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2af2 expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.481124:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87cad9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2aeb expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.481133:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd800/0x392ae0376f87cae0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2af2 expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.481141:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd800, rc 0) 00000100:00100000:0.0:1746065114.481320:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1140:x1830881271966080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 310us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.481326:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28526 00000100:00100000:0.0:1746065114.481615:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271966208 00000100:00100000:0.0:1746065114.481619:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271966208 00010000:00010000:0.0:1746065114.481633:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cad2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ae4 expref: 33 pid: 21550 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.481650:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12499 00000100:00100000:0.0:1746065114.481654:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881271966208:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.481662:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.481675:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cad2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ae4 expref: 33 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.481684:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cad2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ae4 expref: 33 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.481697:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cad2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ae4 expref: 33 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.481710:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.481712:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.481717:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87cad9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2aeb expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.481723:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87cad9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2aeb expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.481739:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87cad9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2aeb expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.481748:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f87cad9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2aeb expref: 5 pid: 21550 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.481757:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ea680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267220992:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065114.481798:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.485573:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.487777:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.491977:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.498543:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.513125:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.514598:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2005:x1830881271967104:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1272us (1478us total) trans 4294970559 rc 0/0 00000100:00100000:0.0:1746065114.514604:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1655 00002000:00100000:0.0:1746065114.514609:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88013077a300 x1830881271967104/t4294970559(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.514622:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077a300 with x1830881271967104 ext(0->7) 00010000:00010000:0.0:1746065114.514626:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd800/0x392ae0376f87cae0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2af2 expref: 34 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.514635:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd800/0x392ae0376f87cae0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2af2 expref: 34 pid: 21550 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.514640:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013077a300 00000100:00100000:0.0:1746065114.519077:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.523724:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.527442:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.533181:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.536958:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.537031:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.541197:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.542185:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.542215:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.542241:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271968640 00000100:00100000:0.0:1746065114.542244:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271968640 00010000:00010000:0.0:1746065114.542257:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87cae7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2af9 expref: 6 pid: 9558 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.542273:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12503 00000100:00100000:0.0:1746065114.542278:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881271968640:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.542284:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.542292:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87cae7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2af9 expref: 6 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.542301:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87cae7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2af9 expref: 6 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.542312:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87cae7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2af9 expref: 6 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.542323:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.542325:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.542330:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07400/0x392ae0376f87caf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b07 expref: 33 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.542336:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb07400/0x392ae0376f87caf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b07 expref: 33 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.542359:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb07400/0x392ae0376f87caf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b07 expref: 33 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.542368:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267221760:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065114.545014:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.548828:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.554945:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.555841:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2004:x1830881271969152:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 526us (902us total) trans 4294970560 rc 0/0 00000100:00100000:0.0:1746065114.555848:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1657 00002000:00100000:0.0:1746065114.555854:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d4a1180 x1830881271969152/t4294970560(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.555866:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1180 with x1830881271969152 ext(0->7) 00010000:00010000:0.0:1746065114.555871:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07400/0x392ae0376f87caf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b07 expref: 37 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.555880:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb07400/0x392ae0376f87caf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b07 expref: 37 pid: 9558 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.555885:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d4a1180 00000100:00100000:0.0:1746065114.563273:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.570134:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.574788:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.578215:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.583874:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.583910:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.584005:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.584036:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271970176 00000100:00100000:0.0:1746065114.584041:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271970176 00010000:00010000:0.0:1746065114.584067:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb06a00/0x392ae0376f87cb03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b15 expref: 6 pid: 9558 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.584106:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271970432 00000100:00100000:0.0:1746065114.584108:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271970432 00010000:00010000:0.0:1746065114.584117:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb06c00/0x392ae0376f87cafc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b0e expref: 38 pid: 9558 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.584130:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12505 00000100:00100000:0.0:1746065114.584135:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271970176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.584145:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.584171:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06a00/0x392ae0376f87cb03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b15 expref: 6 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.584180:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb06a00/0x392ae0376f87cb03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b15 expref: 6 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.584197:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06a00/0x392ae0376f87cb03 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b15 expref: 6 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.584213:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.584253:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881271970176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 117us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.584259:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12505 00000100:00100000:0.0:1746065114.584273:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12506 00000100:00100000:0.0:1746065114.584278:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881271970432:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.584283:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.584290:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06c00/0x392ae0376f87cafc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b0e expref: 38 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.584298:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb06c00/0x392ae0376f87cafc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b0e expref: 38 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.584308:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.584309:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.584316:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87cb0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b1c expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.584327:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87cb0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b1c expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.584350:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87cb0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b1c expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.584360:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b88700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267222400:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065114.584406:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.588932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.591421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.603473:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2003:x1830881271970944:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 11157us (12049us total) trans 4294970561 rc 0/0 00000100:00100000:0.0:1746065114.603483:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1660 00002000:00100000:0.0:1746065114.603491:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009ea77100 x1830881271970944/t4294970561(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.603499:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77100 with x1830881271970944 ext(0->7) 00010000:00010000:0.0:1746065114.603507:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87cb0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b1c expref: 38 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.603519:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87cb0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b1c expref: 38 pid: 21550 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.603526:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea77100 00000100:00100000:0.0:1746065114.607615:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271971072 00000100:00100000:0.0:1746065114.608244:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271971072 00000100:00100000:0.0:1746065114.608268:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28534 00000100:00100000:0.0:1746065114.608273:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:1140:x1830881271971072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065114.608284:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.608294:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d185e00/0x392ae0376f87cb18 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2b2a expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.608320:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x392ae0376f87cb11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b23 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.608326:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.608327:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.608329:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d185e00/0x392ae0376f87cb18 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b2a expref: 39 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.608344:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x392ae0376f87cb11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b23 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.608352:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x392ae0376f87cb11 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b23 expref: 5 pid: 9558 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.608359:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ea76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9558:1830881267222784:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065114.610370:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.613919:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.622982:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.628311:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.629338:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2004:x1830881271972096:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 659us (1028us total) trans 4294970562 rc 0/0 00000100:00100000:0.0:1746065114.629347:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1662 00002000:00100000:0.0:1746065114.629352:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009dc39f80 x1830881271972096/t4294970562(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.629358:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39f80 with x1830881271972096 ext(0->7) 00010000:00010000:0.0:1746065114.629362:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d185e00/0x392ae0376f87cb18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b2a expref: 40 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.629371:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d185e00/0x392ae0376f87cb18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b2a expref: 40 pid: 9558 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.629375:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009dc39f80 00000100:00100000:0.0:1746065114.631193:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.635668:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.636644:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.640610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.643180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.648209:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.651141:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.652286:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2003:x1830881271973376:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 910us (1147us total) trans 4294970563 rc 0/0 00000100:00100000:0.0:1746065114.652293:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1664 00002000:00100000:0.0:1746065114.652299:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f085880 x1830881271973376/t4294970563(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.652306:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f085880 with x1830881271973376 ext(0->7) 00010000:00010000:0.0:1746065114.652310:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f87cb26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b38 expref: 43 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.652320:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f87cb26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b38 expref: 43 pid: 9558 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.652325:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f085880 00000100:00100000:0.0:1746065114.667184:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.675014:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.676277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.679824:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.679861:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.683637:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.685423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.692612:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.697850:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.700946:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.703705:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271975296 00000100:00100000:0.0:1746065114.703711:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271975296 00000100:00100000:0.0:1746065114.703875:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28541 00000100:00100000:0.0:1746065114.703882:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1140:x1830881271975296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065114.703894:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.703904:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d185200/0x392ae0376f87cb49 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2b5b expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.703923:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87cb42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b54 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.703929:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.703931:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.703934:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d185200/0x392ae0376f87cb49 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b5b expref: 45 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.703952:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87cb42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b54 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.703961:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0200/0x392ae0376f87cb42 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b54 expref: 5 pid: 9558 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.703969:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9558:1830881267224448:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065114.704454:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.705233:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.706313:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9558:1830881267224448:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065114.706327:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d185200/0x392ae0376f87cb49 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b5b expref: 44 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.706339:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d185200, rc 0) 00000100:00100000:0.0:1746065114.706356:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1140:x1830881271975296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2475us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.706361:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28541 00000100:00100000:0.0:1746065114.708937:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.711319:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.715378:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.720678:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.722906:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2004:x1830881271976192:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1964us (2230us total) trans 4294970565 rc 0/0 00000100:00100000:0.0:1746065114.722918:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1668 00002000:00100000:0.0:1746065114.722925:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d54a300 x1830881271976192/t4294970565(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.722932:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a300 with x1830881271976192 ext(0->7) 00010000:00010000:0.0:1746065114.722938:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d185200/0x392ae0376f87cb49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b5b expref: 46 pid: 9558 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.722950:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d185200/0x392ae0376f87cb49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b5b expref: 46 pid: 9558 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.722956:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d54a300 00000100:00100000:0.0:1746065114.725330:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.730574:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.732396:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.733301:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.735836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.735919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.738391:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.739075:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.740664:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.743718:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.744790:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2002:x1830881271977984:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 802us (1076us total) trans 4294970566 rc 0/0 00000100:00100000:0.0:1746065114.744796:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1671 00002000:00100000:0.0:1746065114.744802:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d549500 x1830881271977984/t4294970566(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.744814:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549500 with x1830881271977984 ext(0->7) 00010000:00010000:0.0:1746065114.744818:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87cb5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b70 expref: 48 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.744827:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87cb5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b70 expref: 48 pid: 21550 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.744832:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d549500 00000100:00100000:0.0:1746065114.747956:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.750973:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.755035:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.758139:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.758191:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.760693:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.760999:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.761893:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.765051:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.770246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.771400:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2004:x1830881271979776:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 999us (1159us total) trans 4294970567 rc 0/0 00000100:00100000:0.0:1746065114.771407:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1674 00002000:00100000:0.0:1746065114.771412:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072f99f80 x1830881271979776/t4294970567(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.771419:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99f80 with x1830881271979776 ext(0->7) 00010000:00010000:0.0:1746065114.771424:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87cb73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b85 expref: 50 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.771433:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06200/0x392ae0376f87cb73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b85 expref: 50 pid: 21550 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.771438:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f99f80 00000100:00100000:0.0:1746065114.778220:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.780012:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.782581:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.785640:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.785809:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.789769:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.789845:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.790829:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12524 00000100:00100000:0.0:1746065114.790835:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2004:x1830881271980928:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.790840:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.790847:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87cb81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b93 expref: 52 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.790854:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87cb81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b93 expref: 52 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.790863:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87cb81 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b93 expref: 52 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.790878:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.790880:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.790885:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06a00/0x392ae0376f87cb88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b9a expref: 51 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.790892:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb06a00/0x392ae0376f87cb88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b9a expref: 51 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.790915:0:9574:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb06a00/0x392ae0376f87cb88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b9a expref: 51 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.790924:0:9574:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f9b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267226496:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065114.791240:0:9574:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.791601:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.793776:0:9574:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f9b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267226496:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065114.793791:0:9574:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.793823:0:9574:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2004:x1830881271980928:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2988us (3977us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.793831:0:9574:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12524 00000100:00100000:0.0:1746065114.794945:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.797163:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.798132:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2005:x1830881271981568:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 851us (970us total) trans 4294970568 rc 0/0 00000100:00100000:0.0:1746065114.798138:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1676 00002000:00100000:0.0:1746065114.798144:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072f98000 x1830881271981568/t4294970568(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.798162:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98000 with x1830881271981568 ext(0->7) 00010000:00010000:0.0:1746065114.798168:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06a00/0x392ae0376f87cb88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b9a expref: 52 pid: 21550 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.798180:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06a00/0x392ae0376f87cb88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2b9a expref: 52 pid: 21550 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.798185:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f98000 00000100:00100000:0.0:1746065114.802369:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.808174:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.811965:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.815863:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.820677:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.820713:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.823231:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.823289:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.824282:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.825681:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.830872:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.831890:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2004:x1830881271983872:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 761us (1022us total) trans 4294970569 rc 0/0 00000100:00100000:0.0:1746065114.831896:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1679 00002000:00100000:0.0:1746065114.831902:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d1e1f80 x1830881271983872/t4294970569(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.831909:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1f80 with x1830881271983872 ext(0->7) 00010000:00010000:0.0:1746065114.831913:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87cb9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2baf expref: 55 pid: 9560 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.831922:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87cb9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2baf expref: 55 pid: 9560 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.831928:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e1f80 00000100:00100000:0.0:1746065114.833221:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.835307:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.835343:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271984256 00000100:00100000:0.0:1746065114.835346:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271984256 00002000:00100000:0.0:1746065114.835369:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800a09ff100 x1830881271984256/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.835376:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09ff100 with x1830881271984256 ext(0->4095) 00002000:00010000:0.0:1746065114.835380:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a09ff100 00000100:00100000:0.0:1746065114.835404:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12683 00000100:00100000:0.0:1746065114.835409:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881271984256:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065114.835489:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881271984256:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 80us (182us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065114.835494:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12683 00002000:00100000:0.0:1746065114.835498:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800a09ff100 x1830881271984256/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 488/4536 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.835503:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09ff100 with x1830881271984256 ext(0->4095) 00002000:00010000:0.0:1746065114.835505:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a09ff100 00000100:00100000:0.0:1746065114.838923:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.838962:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.839136:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28556 00000100:00100000:0.0:1746065114.839142:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271984384:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065114.839157:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.839165:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727df200/0x392ae0376f87cbb2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2bbd expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.839200:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.839203:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07e00/0x392ae0376f87cbab lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bc4 expref: 55 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.839209:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.839211:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727df200/0x392ae0376f87cbb2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bbd expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.840009:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb07e00/0x392ae0376f87cbab lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bc4 expref: 55 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.840027:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727df200/0x392ae0376f87cbb2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bbd expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.840035:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727df200, rc 0) 00000100:00100000:0.0:1746065114.840056:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1141:x1830881271984384:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 915us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.840061:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28556 00000100:00100000:0.0:1746065114.842632:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.844442:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.847275:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271985152 00000100:00100000:0.0:1746065114.847282:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271985152 00002000:00100000:0.0:1746065114.847314:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009c322d80 x1830881271985152/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.847327:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322d80 with x1830881271985152 ext(0->7) 00010000:00010000:0.0:1746065114.847334:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07e00/0x392ae0376f87cbab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bc4 expref: 54 pid: 9642 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.847345:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb07e00/0x392ae0376f87cbab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bc4 expref: 54 pid: 9642 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.847351:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c322d80 00000100:00100000:0.0:1746065114.847379:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1681 00000100:00100000:0.0:1746065114.847385:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881271985152:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065114.850545:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2005:x1830881271985152:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3153us (3335us total) trans 4294970570 rc 0/0 00000100:00100000:0.0:1746065114.850555:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1681 00002000:00100000:0.0:1746065114.850564:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009c322d80 x1830881271985152/t4294970570(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.850571:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322d80 with x1830881271985152 ext(0->7) 00010000:00010000:0.0:1746065114.850579:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07e00/0x392ae0376f87cbab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bc4 expref: 56 pid: 9642 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.850593:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb07e00/0x392ae0376f87cbab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bc4 expref: 56 pid: 9642 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065114.850599:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c322d80 00000100:00100000:0.0:1746065114.853764:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.859296:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.864286:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.864333:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.870424:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.874817:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.878518:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.880532:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2002:x1830881271986432:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1718us (2014us total) trans 4294970571 rc 0/0 00000100:00100000:0.0:1746065114.880542:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1683 00002000:00100000:0.0:1746065114.880550:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072a1c380 x1830881271986432/t4294970571(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.880562:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1c380 with x1830881271986432 ext(0->7) 00010000:00010000:0.0:1746065114.880569:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06400/0x392ae0376f87cbb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bcb expref: 59 pid: 9642 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.880583:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06400/0x392ae0376f87cbb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bcb expref: 59 pid: 9642 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065114.880589:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a1c380 00000100:00100000:0.0:1746065114.891678:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.894540:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.894577:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.897195:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.898133:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.898253:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.898292:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12533 00000100:00100000:0.0:1746065114.898298:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271987712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.898306:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.898321:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb07e00/0x392ae0376f87cbc7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bd9 expref: 6 pid: 9642 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.898338:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb07e00/0x392ae0376f87cbc7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bd9 expref: 6 pid: 9642 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.898375:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07e00/0x392ae0376f87cbc7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bd9 expref: 6 pid: 9642 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.898507:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.898527:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881271987712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 229us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.898532:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12533 00000100:00100000:0.0:1746065114.901432:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.908918:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.911912:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2002:x1830881271988224:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2162us (2998us total) trans 4294970572 rc 0/0 00000100:00100000:0.0:1746065114.911921:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1685 00002000:00100000:0.0:1746065114.911929:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880094824e00 x1830881271988224/t4294970572(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.911937:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094824e00 with x1830881271988224 ext(0->7) 00010000:00010000:0.0:1746065114.911944:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0800/0x392ae0376f87cbce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2be0 expref: 61 pid: 9642 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.913118:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0800/0x392ae0376f87cbce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2be0 expref: 61 pid: 9642 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065114.913125:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094824e00 00000100:00100000:0.0:1746065114.915571:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.919619:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.920423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.923341:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.923391:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.926164:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271989248 00000100:00100000:0.0:1746065114.926170:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271989248 00002000:00100000:0.0:1746065114.926196:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c322300 x1830881271989248/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.926205:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322300 with x1830881271989248 ext(0->4095) 00010000:00010000:0.0:1746065114.926210:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87cbdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bee expref: 60 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.926221:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87cbdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bee expref: 60 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065114.926226:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c322300 00000100:00100000:0.0:1746065114.926240:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1686 00000100:00100000:0.0:1746065114.926245:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881271989248:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065114.926352:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881271989248:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 105us (350us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065114.926357:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1686 00002000:00100000:0.0:1746065114.926362:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c322300 x1830881271989248/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 488/4536 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.926369:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322300 with x1830881271989248 ext(0->4095) 00010000:00010000:0.0:1746065114.926373:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87cbdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bee expref: 60 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.926382:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87cbdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bee expref: 60 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065114.926388:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c322300 00000100:00100000:0.0:1746065114.930016:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.934673:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881271989504:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 4435us (4656us total) trans 4294970573 rc 0/0 00000100:00100000:0.0:1746065114.934685:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1687 00002000:00100000:0.0:1746065114.934695:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729b3800 x1830881271989504/t4294970573(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.934703:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b3800 with x1830881271989504 ext(0->7) 00010000:00010000:0.0:1746065114.934712:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87cbdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bee expref: 62 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.934724:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87cbdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bee expref: 62 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065114.934730:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729b3800 00000100:00100000:0.0:1746065114.955334:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12537 00000100:00100000:0.0:1746065114.955349:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2005:x1830881271989632:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.955365:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.955386:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87cbdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bee expref: 62 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.955404:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87cbdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bee expref: 62 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.955423:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0x392ae0376f87cbdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bee expref: 62 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.955444:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.955446:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.955453:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1200/0x392ae0376f87cbe3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bf5 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.955460:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1200/0x392ae0376f87cbe3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bf5 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.955489:0:9574:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1200/0x392ae0376f87cbe3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bf5 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.955499:0:9574:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267229568:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065114.960650:0:9574:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.962780:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.966183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.971196:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.975173:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.979059:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.980337:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881271990656:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 890us (1281us total) trans 4294970574 rc 0/0 00000100:00100000:0.0:1746065114.980346:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1689 00002000:00100000:0.0:1746065114.980361:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009549df80 x1830881271990656/t4294970574(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:30/0 lens 496/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.980368:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549df80 with x1830881271990656 ext(0->7) 00010000:00010000:0.0:1746065114.980373:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87cbea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bfc expref: 64 pid: 9642 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.980383:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87cbea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2bfc expref: 64 pid: 9642 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065114.980388:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009549df80 00000100:00100000:0.0:1746065114.983444:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.986125:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.991207:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.992511:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.994466:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065114.996488:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.001262:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.003065:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:2004:x1830881271991936:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1569us (1805us total) trans 4294970575 rc 0/0 00000100:00100000:0.0:1746065115.003073:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1691 00002000:00100000:0.0:1746065115.003094:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d549f80 x1830881271991936/t4294970575(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.003101:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549f80 with x1830881271991936 ext(0->7) 00010000:00010000:0.0:1746065115.003107:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f87cbf8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c0a expref: 67 pid: 9642 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.003119:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f87cbf8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c0a expref: 67 pid: 9642 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.003126:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d549f80 00000100:00100000:0.0:1746065115.004478:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.006211:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.008283:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065115.008432:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065115.010411:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.020457:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.023157:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.023202:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.030785:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267230720:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065115.030795:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267230848:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065115.030821:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727df200/0x392ae0376f87cc0d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c1f expref: 67 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.030836:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727df200, rc 0) 00000100:00100000:0.0:1746065115.030877:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:1140:x1830881271993344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5731us (7674us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.030885:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28569 00000100:00100000:0.0:1746065115.030906:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271993728 00000100:00100000:0.0:1746065115.030911:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271993728 00000100:00100000:0.0:1746065115.030933:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28570 00000100:00100000:0.0:1746065115.030938:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:1141:x1830881271993728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.030954:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.030965:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f85dc00/0x392ae0376f87cc14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2c26 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.030979:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.030983:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727df200/0x392ae0376f87cc0d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c1f expref: 68 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.030988:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065115.030991:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f85dc00/0x392ae0376f87cc14 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c26 expref: 68 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.031013:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727df200/0x392ae0376f87cc0d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c1f expref: 69 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.031022:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f85dc00/0x392ae0376f87cc14 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c26 expref: 69 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.031028:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f85dc00, rc 0) 00000100:00100000:0.0:1746065115.031043:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:1141:x1830881271993728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 105us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.031047:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28570 00000100:00100000:0.0:1746065115.033513:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.037162:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.039212:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:2004:x1830881271994240:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1728us (1935us total) trans 4294970576 rc 0/0 00000100:00100000:0.0:1746065115.039360:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1693 00002000:00100000:0.0:1746065115.039368:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d548a80 x1830881271994240/t4294970576(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.039375:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548a80 with x1830881271994240 ext(0->7) 00010000:00010000:0.0:1746065115.039382:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727df200/0x392ae0376f87cc0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c1f expref: 69 pid: 21550 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.039393:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727df200/0x392ae0376f87cc0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c1f expref: 69 pid: 21550 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.039399:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d548a80 00000100:00100000:0.0:1746065115.046375:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.048392:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.053182:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.057671:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.061748:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.061789:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.064907:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.070325:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.078603:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271995776 00000100:00100000:0.0:1746065115.078611:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271995776 00000100:00100000:0.0:1746065115.078654:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28573 00000100:00100000:0.0:1746065115.078661:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881271995776:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.080114:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.080131:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f88e000/0x392ae0376f87cc29 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2c3b expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.080168:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87cc22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c34 expref: 67 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.080175:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065115.080177:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065115.080180:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f88e000/0x392ae0376f87cc29 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c3b expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.080205:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87cc22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c34 expref: 67 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.080217:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87cc22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c34 expref: 67 pid: 9558 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065115.080227:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d548e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9558:1830881267231744:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065115.080320:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.086433:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.098437:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.104652:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.107737:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.110639:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.121534:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.125582:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.126826:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881271997056:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 788us (1242us total) trans 4294970578 rc 0/0 00000100:00100000:0.0:1746065115.126832:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1697 00002000:00100000:0.0:1746065115.126838:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a09fd180 x1830881271997056/t4294970578(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.126850:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fd180 with x1830881271997056 ext(0->7) 00010000:00010000:0.0:1746065115.126855:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87cc30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c42 expref: 72 pid: 9558 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.126864:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87cc30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c42 expref: 72 pid: 9558 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.126869:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a09fd180 00000100:00100000:0.0:1746065115.130560:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.135235:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881271997568 00000100:00100000:0.0:1746065115.135241:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881271997568 00002000:00100000:0.0:1746065115.135277:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072f9a300 x1830881271997568/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.135286:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9a300 with x1830881271997568 ext(0->4095) 00002000:00010000:0.0:1746065115.135290:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f9a300 00000100:00100000:0.0:1746065115.135306:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12697 00000100:00100000:0.0:1746065115.135312:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271997568:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065115.135412:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881271997568:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 100us (233us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065115.135418:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12697 00002000:00100000:0.0:1746065115.135423:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072f9a300 x1830881271997568/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:31/0 lens 488/4536 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.135429:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9a300 with x1830881271997568 ext(0->4095) 00002000:00010000:0.0:1746065115.135432:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f9a300 00000100:00100000:0.0:1746065115.140500:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.143155:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267232512:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065115.143173:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb06c00/0x392ae0376f87cc3e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c50 expref: 73 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.143183:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06c00, rc 0) 00000100:00100000:0.0:1746065115.143576:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1140:x1830881271997312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7470us (8495us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.143582:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28576 00000100:00100000:0.0:1746065115.147347:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.153405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.158409:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2002:x1830881271998336:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1020us (5006us total) trans 4294970579 rc 0/0 00000100:00100000:0.0:1746065115.158417:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1699 00002000:00100000:0.0:1746065115.158422:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a09ff800 x1830881271998336/t4294970579(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.158429:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09ff800 with x1830881271998336 ext(0->7) 00010000:00010000:0.0:1746065115.158434:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06c00/0x392ae0376f87cc3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c50 expref: 75 pid: 9642 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.158445:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06c00/0x392ae0376f87cc3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c50 expref: 75 pid: 9642 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.158450:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a09ff800 00000100:00100000:0.0:1746065115.159862:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.163246:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.168314:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.169114:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.171393:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.171997:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.176166:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.176206:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.178881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.186202:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.190380:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272000128:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3989us (4178us total) trans 4294970580 rc 0/0 00000100:00100000:0.0:1746065115.190389:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1702 00002000:00100000:0.0:1746065115.190397:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009dc3b100 x1830881272000128/t4294970580(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.190404:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3b100 with x1830881272000128 ext(0->7) 00010000:00010000:0.0:1746065115.190411:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87cc53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c65 expref: 77 pid: 9558 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.190425:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e800/0x392ae0376f87cc53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c65 expref: 77 pid: 9558 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.190430:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009dc3b100 00000100:00100000:0.0:1746065115.192388:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.198493:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.203353:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.203402:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.206247:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.209529:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.215062:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.215989:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2004:x1830881272001408:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 723us (932us total) trans 4294970581 rc 0/0 00000100:00100000:0.0:1746065115.215996:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1704 00002000:00100000:0.0:1746065115.216002:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f086a00 x1830881272001408/t4294970581(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.216009:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086a00 with x1830881272001408 ext(0->7) 00010000:00010000:0.0:1746065115.216014:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072539a00/0x392ae0376f87cc61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c73 expref: 78 pid: 9642 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.216023:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072539a00/0x392ae0376f87cc61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c73 expref: 78 pid: 9642 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.216028:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f086a00 00000100:00100000:0.0:1746065115.217395:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.227531:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.239606:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.240440:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.240797:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28584 00000100:00100000:0.0:1746065115.240803:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1141:x1830881272002048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.240809:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.240815:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081d07400/0x392ae0376f87cc76 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2c88 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.240823:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.240827:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f525200/0x392ae0376f87cc6f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c81 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.240836:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065115.240838:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081d07400/0x392ae0376f87cc76 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c88 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.240857:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f525200/0x392ae0376f87cc6f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c81 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.240865:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081d07400/0x392ae0376f87cc76 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c88 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.240873:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081d07400, rc 0) 00000100:00100000:0.0:1746065115.240890:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1141:x1830881272002048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 89us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.240896:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28584 00000100:00100000:0.0:1746065115.243334:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.246259:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.248282:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.249587:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2003:x1830881272002688:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 893us (1308us total) trans 4294970582 rc 0/0 00000100:00100000:0.0:1746065115.249593:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1706 00002000:00100000:0.0:1746065115.249599:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f087b80 x1830881272002688/t4294970582(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.249605:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f087b80 with x1830881272002688 ext(0->7) 00010000:00010000:0.0:1746065115.249610:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f525200/0x392ae0376f87cc6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c81 expref: 81 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.249623:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f525200/0x392ae0376f87cc6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c81 expref: 81 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.249628:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f087b80 00000100:00100000:0.0:1746065115.250648:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.254631:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.262849:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.268589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.270617:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.272851:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.272929:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.283515:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.287622:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881272004480:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3890us (4097us total) trans 4294970583 rc 0/0 00000100:00100000:0.0:1746065115.287634:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1709 00002000:00100000:0.0:1746065115.287643:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f9fa680 x1830881272004480/t4294970583(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.287652:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9fa680 with x1830881272004480 ext(0->7) 00010000:00010000:0.0:1746065115.287660:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fc00/0x392ae0376f87cc84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c96 expref: 83 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.287675:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fc00/0x392ae0376f87cc84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c96 expref: 83 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.287681:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9fa680 00000100:00100000:0.0:1746065115.291706:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.303260:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.310387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.310421:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.315396:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.318596:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.318620:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.318648:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.318667:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272005760 00000100:00100000:0.0:1746065115.318672:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272005760 00000100:00100000:0.0:1746065115.318701:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28590 00000100:00100000:0.0:1746065115.318707:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1141:x1830881272005760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.318718:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.318732:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0b14a00/0x392ae0376f87cca0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2cb2 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.318749:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.318753:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880072b6c800/0x392ae0376f87cc99 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cab expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.318759:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065115.318763:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0b14a00/0x392ae0376f87cca0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cb2 expref: 85 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.318791:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880072b6c800/0x392ae0376f87cc99 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cab expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.318801:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0b14a00/0x392ae0376f87cca0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cb2 expref: 85 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.318812:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0b14a00, rc 0) 00000100:00100000:0.0:1746065115.318841:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:1141:x1830881272005760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 134us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.318846:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28590 00000100:00100000:0.0:1746065115.318913:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12562 00000100:00100000:0.0:1746065115.318918:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:2005:x1830881272005504:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065115.318925:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065115.318939:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87cc8b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c9d expref: 85 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.318947:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87cc8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c9d expref: 85 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.319938:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87cc8b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2c9d expref: 84 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.320168:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.320170:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.320175:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880072b6c800/0x392ae0376f87cc99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cab expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.320182:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072b6c800/0x392ae0376f87cc99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cab expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.320203:0:9574:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880072b6c800/0x392ae0376f87cc99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cab expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.320213:0:9574:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880072b6c800/0x392ae0376f87cc99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cab expref: 83 pid: 9558 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065115.320222:0:9574:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267235712:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065115.320280:0:9574:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.321690:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.323524:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.324905:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:2002:x1830881272006272:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1140us (1379us total) trans 4294970584 rc 0/0 00000100:00100000:0.0:1746065115.324912:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1712 00002000:00100000:0.0:1746065115.324917:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f4e8380 x1830881272006272/t4294970584(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.324924:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8380 with x1830881272006272 ext(0->7) 00010000:00010000:0.0:1746065115.324929:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b6c800/0x392ae0376f87cc99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cab expref: 85 pid: 9558 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.324938:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b6c800/0x392ae0376f87cc99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cab expref: 85 pid: 9558 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.324943:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f4e8380 00000100:00100000:0.0:1746065115.329900:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.336166:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.344840:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.345883:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.350265:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9558:1830881267235968:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065115.350274:0:9558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0b14a00/0x392ae0376f87cca0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cb2 expref: 86 pid: 9642 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065115.350296:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9558:1830881267236096:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065115.350315:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f02ce00/0x392ae0376f87ccae lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cc0 expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.350323:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f02ce00, rc 0) 00000100:00100000:0.0:1746065115.350662:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1140:x1830881272006912:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3832us (4460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.350668:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28592 00000100:00100000:0.0:1746065115.351902:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.352758:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.355608:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.359421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.362323:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272008064:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2696us (2900us total) trans 4294970585 rc 0/0 00000100:00100000:0.0:1746065115.362334:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1715 00002000:00100000:0.0:1746065115.362343:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f4ea680 x1830881272008064/t4294970585(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.362351:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ea680 with x1830881272008064 ext(0->7) 00010000:00010000:0.0:1746065115.362359:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02ce00/0x392ae0376f87ccae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cc0 expref: 87 pid: 9558 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.362373:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02ce00/0x392ae0376f87ccae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cc0 expref: 87 pid: 9558 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.362380:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f4ea680 00000100:00100000:0.0:1746065115.364630:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.371303:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272008448 00000100:00100000:0.0:1746065115.371311:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272008448 00002000:00100000:0.0:1746065115.371350:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072f9b800 x1830881272008448/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.371360:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b800 with x1830881272008448 ext(0->4095) 00002000:00010000:0.0:1746065115.371364:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f9b800 00000100:00100000:0.0:1746065115.371394:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12704 00000100:00100000:0.0:1746065115.371401:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272008448:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065115.371524:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272008448:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 123us (299us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065115.371530:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12704 00002000:00100000:0.0:1746065115.371535:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072f9b800 x1830881272008448/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 488/4536 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.371541:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b800 with x1830881272008448 ext(0->4095) 00002000:00010000:0.0:1746065115.371543:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f9b800 00000100:00100000:0.0:1746065115.373234:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.374607:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.375971:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.381411:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.385484:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.385518:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.385547:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.389299:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.391198:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.392049:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2003:x1830881272010112:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 678us (853us total) trans 4294970586 rc 0/0 00000100:00100000:0.0:1746065115.392055:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1717 00002000:00100000:0.0:1746065115.392061:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f982300 x1830881272010112/t4294970586(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.392066:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982300 with x1830881272010112 ext(0->7) 00010000:00010000:0.0:1746065115.392071:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f525800/0x392ae0376f87ccc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cd5 expref: 88 pid: 9558 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.392109:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f525800/0x392ae0376f87ccc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cd5 expref: 88 pid: 9558 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.392123:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f982300 00000100:00100000:0.0:1746065115.393978:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.398754:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.405557:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.405604:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.409327:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.413308:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.418207:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.419577:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+91:2002:x1830881272011392:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1129us (1375us total) trans 4294970587 rc 0/0 00000100:00100000:0.0:1746065115.419587:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1719 00002000:00100000:0.0:1746065115.419593:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f982680 x1830881272011392/t4294970587(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.419607:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982680 with x1830881272011392 ext(0->7) 00010000:00010000:0.0:1746065115.419615:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87ccd1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ce3 expref: 91 pid: 9558 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.419627:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87ccd1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ce3 expref: 91 pid: 9558 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.419635:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f982680 00000100:00100000:0.0:1746065115.428943:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.429139:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.434589:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.439587:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.439671:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.447730:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.457288:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.463562:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.470420:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.482718:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272013184 00000100:00100000:0.0:1746065115.482729:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272013184 00000100:00100000:0.0:1746065115.482786:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28601 00000100:00100000:0.0:1746065115.482793:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+91:1141:x1830881272013184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.482806:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.482823:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87cced lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2cff expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.482842:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.482845:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.482851:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87cced lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cff expref: 92 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.482862:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87cced lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2cff expref: 92 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.482871:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09e2e00, rc 0) 00000100:00100000:0.0:1746065115.482922:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+92:1141:x1830881272013184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 130us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.482929:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28601 00000100:00100000:0.0:1746065115.487296:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.488396:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.493691:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.494789:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.494842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.498376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.498401:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272014208 00000100:00100000:0.0:1746065115.498407:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272014208 00002000:00100000:0.0:1746065115.498442:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8801306a3100 x1830881272014208/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.498451:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a3100 with x1830881272014208 ext(0->4095) 00002000:00010000:0.0:1746065115.498455:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801306a3100 00000100:00100000:0.0:1746065115.498489:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12709 00000100:00100000:0.0:1746065115.498494:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:2005:x1830881272014208:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065115.499108:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:2005:x1830881272014208:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 612us (737us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065115.499118:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12709 00002000:00100000:0.0:1746065115.499123:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8801306a3100 x1830881272014208/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 488/4536 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.499129:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a3100 with x1830881272014208 ext(0->4095) 00010000:00010000:0.0:1746065115.499134:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ccf4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d06 expref: 92 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.499152:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ccf4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d06 expref: 92 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.499157:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306a3100 00000100:00100000:0.0:1746065115.501764:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272014464 00000100:00100000:0.0:1746065115.501773:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272014464 00002000:00100000:0.0:1746065115.501805:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fb66a00 x1830881272014464/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.501813:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb66a00 with x1830881272014464 ext(0->7) 00010000:00010000:0.0:1746065115.501820:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ccf4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d06 expref: 92 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.501832:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ccf4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d06 expref: 92 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.501838:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb66a00 00000100:00100000:0.0:1746065115.501867:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1724 00000100:00100000:0.0:1746065115.501873:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+92:2003:x1830881272014464:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065115.504732:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2003:x1830881272014464:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2854us (3183us total) trans 4294970589 rc 0/0 00000100:00100000:0.0:1746065115.504739:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1724 00002000:00100000:0.0:1746065115.504746:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fb66a00 x1830881272014464/t4294970589(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.504754:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb66a00 with x1830881272014464 ext(0->7) 00010000:00010000:0.0:1746065115.504761:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ccf4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d06 expref: 94 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.504773:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ccf4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d06 expref: 94 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.504779:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb66a00 00000100:00100000:0.0:1746065115.506267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.511615:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272014848 00000100:00100000:0.0:1746065115.511622:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272014848 00002000:00100000:0.0:1746065115.511659:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009faf9f80 x1830881272014848/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.511668:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9f80 with x1830881272014848 ext(0->4095) 00002000:00010000:0.0:1746065115.511672:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faf9f80 00000100:00100000:0.0:1746065115.511699:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12710 00000100:00100000:0.0:1746065115.511706:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272014848:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065115.511818:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272014848:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 112us (265us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065115.511827:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12710 00002000:00100000:0.0:1746065115.511833:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009faf9f80 x1830881272014848/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:31/0 lens 488/4536 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.511839:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9f80 with x1830881272014848 ext(0->4095) 00002000:00010000:0.0:1746065115.511842:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faf9f80 00000100:00100000:0.0:1746065115.520524:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272014976 00000100:00100000:0.0:1746065115.520532:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272014976 00000100:00100000:0.0:1746065115.520981:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28604 00000100:00100000:0.0:1746065115.520988:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:1141:x1830881272014976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.521002:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.521017:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87cd02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2d14 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.521036:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.521037:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.521044:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87cd02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d14 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.521057:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87cd02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d14 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.521065:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09e2e00, rc 0) 00000100:00100000:0.0:1746065115.523402:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:1141:x1830881272014976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2406us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.523411:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28604 00000100:00100000:0.0:1746065115.523603:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272015104 00000100:00100000:0.0:1746065115.523610:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272015104 00000100:00100000:0.0:1746065115.523966:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28605 00000100:00100000:0.0:1746065115.523972:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:1140:x1830881272015104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.523985:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.524000:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2d1b expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.524022:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f525400/0x392ae0376f87ccfb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d0d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.524029:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87cd02 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d14 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.524035:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.524037:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.524040:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.524064:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87cd02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d14 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.524074:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09e2e00/0x392ae0376f87cd02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d14 expref: 95 pid: 9560 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065115.524214:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267238912:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065115.524442:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f525400/0x392ae0376f87ccfb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d0d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.524455:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f525400/0x392ae0376f87ccfb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d0d expref: 5 pid: 9560 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065115.524463:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267239040:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065115.524485:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.526017:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.527855:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267238912:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065115.527865:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267239040:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065115.527886:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.527900:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800724c5000, rc 0) 00000100:00100000:0.0:1746065115.527927:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1140:x1830881272015104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3956us (4383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.527933:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28605 00000100:00100000:0.0:1746065115.531999:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272015616 00000100:00100000:0.0:1746065115.532007:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272015616 00000100:00100000:0.0:1746065115.532052:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28606 00000100:00100000:0.0:1746065115.532059:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881272015616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.532074:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.532769:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb6ce00/0x392ae0376f87cd10 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2d22 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.532786:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.532792:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065115.532793:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065115.532796:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb6ce00/0x392ae0376f87cd10 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d22 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.532811:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.532820:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 94 pid: 9560 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065115.532827:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267239296:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065115.532850:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.535446:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.535468:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272016000 00000100:00100000:0.0:1746065115.535473:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272016000 00002000:00100000:0.0:1746065115.535503:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8801306a1c00 x1830881272016000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.535511:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1c00 with x1830881272016000 ext(0->4095) 00010000:00010000:0.0:1746065115.535518:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 95 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.535530:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 95 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.535536:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306a1c00 00000100:00100000:0.0:1746065115.535557:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1726 00000100:00100000:0.0:1746065115.535562:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2005:x1830881272016000:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065115.535658:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2005:x1830881272016000:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 94us (217us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065115.535663:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1726 00002000:00100000:0.0:1746065115.535668:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8801306a1c00 x1830881272016000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 488/4536 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.535675:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1c00 with x1830881272016000 ext(0->4095) 00010000:00010000:0.0:1746065115.535679:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 95 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.535687:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 95 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.535692:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306a1c00 00000100:00100000:0.0:1746065115.540600:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.541764:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:2003:x1830881272016256:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 832us (1169us total) trans 4294970590 rc 0/0 00000100:00100000:0.0:1746065115.541771:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1727 00002000:00100000:0.0:1746065115.541777:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306a1880 x1830881272016256/t4294970590(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.541784:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1880 with x1830881272016256 ext(0->7) 00010000:00010000:0.0:1746065115.541788:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 96 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.541802:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d1b expref: 96 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.541808:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306a1880 00000100:00100000:0.0:1746065115.543071:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.544760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.548223:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.552068:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.554163:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.554206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.557275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.557305:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.557351:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.557375:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272017536 00000100:00100000:0.0:1746065115.557381:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272017536 00010000:00010000:0.0:1746065115.557406:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb6ce00/0x392ae0376f87cd10 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d22 expref: 6 pid: 9560 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065115.557425:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272017792 00000100:00100000:0.0:1746065115.557427:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272017792 00010000:00010000:0.0:1746065115.557435:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f02c800/0x392ae0376f87cd17 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d29 expref: 98 pid: 9560 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065115.557448:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12581 00000100:00100000:0.0:1746065115.557453:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272017536:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065115.557463:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065115.557479:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb6ce00/0x392ae0376f87cd10 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d22 expref: 6 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.557487:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb6ce00/0x392ae0376f87cd10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d22 expref: 6 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.557507:0:9574:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065115.557535:0:9574:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272017536:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.557541:0:9574:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12581 00000100:00100000:0.0:1746065115.557555:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12582 00000100:00100000:0.0:1746065115.557559:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272017792:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065115.557565:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065115.557571:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f02c800/0x392ae0376f87cd17 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d29 expref: 98 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.557579:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f02c800/0x392ae0376f87cd17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d29 expref: 98 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.557589:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.557591:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.557596:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87cd1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d30 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.557603:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87cd1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d30 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.557625:0:9574:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87cd1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d30 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065115.557635:0:9574:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d653800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267239808:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065115.557680:0:9574:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.563299:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.565642:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.566908:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272018304:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 903us (1270us total) trans 4294970591 rc 0/0 00000100:00100000:0.0:1746065115.566915:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1729 00002000:00100000:0.0:1746065115.566920:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d650000 x1830881272018304/t4294970591(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.566926:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d650000 with x1830881272018304 ext(0->7) 00010000:00010000:0.0:1746065115.566931:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87cd1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d30 expref: 98 pid: 9558 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.566941:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87cd1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d30 expref: 98 pid: 9558 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.566945:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d650000 00000100:00100000:0.0:1746065115.568431:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.571350:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.573868:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.575885:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.577860:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.588815:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.594555:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.594587:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.594623:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.594650:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272019840 00000100:00100000:0.0:1746065115.594656:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272019840 00000100:00100000:0.0:1746065115.594686:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28612 00000100:00100000:0.0:1746065115.594692:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1141:x1830881272019840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.594706:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.594721:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f87cd3a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2d4c expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.594740:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.594745:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87cd33 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d45 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.594751:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065115.594753:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f87cd3a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d4c expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.594781:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87cd33 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d45 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.594791:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f87cd3a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d4c expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.594800:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb6c000, rc 0) 00000100:00100000:0.0:1746065115.594833:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1141:x1830881272019840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.594838:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28612 00000100:00100000:0.0:1746065115.611415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.612394:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2003:x1830881272020352:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 784us (983us total) trans 4294970592 rc 0/0 00000100:00100000:0.0:1746065115.612400:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1731 00002000:00100000:0.0:1746065115.612406:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009ea76300 x1830881272020352/t4294970592(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.612414:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76300 with x1830881272020352 ext(0->7) 00010000:00010000:0.0:1746065115.612419:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87cd33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d45 expref: 101 pid: 21550 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.612428:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87cd33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d45 expref: 101 pid: 21550 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.612434:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea76300 00000100:00100000:0.0:1746065115.616210:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.616256:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.625779:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.632169:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272020992 00000100:00100000:0.0:1746065115.632174:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272020992 00000100:00100000:0.0:1746065115.635202:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.649526:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:2003:x1830881272021632:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 938us (1119us total) trans 4294970593 rc 0/0 00000100:00100000:0.0:1746065115.649532:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1734 00002000:00100000:0.0:1746065115.649538:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009faf9500 x1830881272021632/t4294970593(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.649544:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9500 with x1830881272021632 ext(0->7) 00010000:00010000:0.0:1746065115.649549:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cd41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d53 expref: 102 pid: 21550 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.649557:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cd41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d53 expref: 102 pid: 21550 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.649562:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009faf9500 00000100:00100000:0.0:1746065115.659863:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.667026:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.677637:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.681975:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.691335:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.703063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.714747:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.720033:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+104:2004:x1830881272022784:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 4592us (5285us total) trans 4294970594 rc 0/0 00000100:00100000:0.0:1746065115.720043:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1736 00002000:00100000:0.0:1746065115.720050:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009ea75f80 x1830881272022784/t4294970594(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.720059:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881272022784 ext(0->7) 00010000:00010000:0.0:1746065115.720067:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87cd4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d61 expref: 104 pid: 9558 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.720101:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0fe00/0x392ae0376f87cd4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d61 expref: 104 pid: 9558 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.720108:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea75f80 00000100:00100000:0.0:1746065115.721603:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.724581:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.727534:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272023296 00000100:00100000:0.0:1746065115.727540:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272023296 00000100:00100000:0.0:1746065115.727579:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28617 00000100:00100000:0.0:1746065115.727584:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+103:1141:x1830881272023296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.727596:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.727611:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727b7800/0x392ae0376f87cd5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2d6f expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.727627:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.727628:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.727635:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727b7800/0x392ae0376f87cd5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d6f expref: 104 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.727645:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727b7800/0x392ae0376f87cd5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d6f expref: 104 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.727653:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727b7800, rc 0) 00000100:00100000:0.0:1746065115.727687:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+104:1141:x1830881272023296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 103us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.727692:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28617 00000100:00100000:0.0:1746065115.730848:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.736779:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.738522:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.738544:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.739272:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.741384:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.743472:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.746565:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:2005:x1830881272024576:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2029us (3091us total) trans 4294970595 rc 0/0 00000100:00100000:0.0:1746065115.746572:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1738 00002000:00100000:0.0:1746065115.746579:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d1e1880 x1830881272024576/t4294970595(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.746587:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1880 with x1830881272024576 ext(0->7) 00010000:00010000:0.0:1746065115.746593:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87cd64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d76 expref: 107 pid: 21550 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.746605:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87cd64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d76 expref: 107 pid: 21550 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.746610:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e1880 00000100:00100000:0.0:1746065115.748595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.751556:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.757417:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.759752:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.760040:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.762482:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.764076:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.764786:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.767541:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.775191:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.776185:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+109:2004:x1830881272026368:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 773us (998us total) trans 4294970596 rc 0/0 00000100:00100000:0.0:1746065115.776191:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1740 00002000:00100000:0.0:1746065115.776197:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012dffe680 x1830881272026368/t4294970596(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.776205:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffe680 with x1830881272026368 ext(0->7) 00010000:00010000:0.0:1746065115.776210:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f525800/0x392ae0376f87cd79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d8b expref: 109 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.776218:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f525800/0x392ae0376f87cd79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d8b expref: 109 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.776224:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dffe680 00000100:00100000:0.0:1746065115.778776:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.781170:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.784447:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.784490:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.786588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.786853:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.792672:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.800702:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.804276:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+110:2004:x1830881272028032:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3330us (3566us total) trans 4294970597 rc 0/0 00000100:00100000:0.0:1746065115.804285:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1742 00002000:00100000:0.0:1746065115.804294:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012dfffb80 x1830881272028032/t4294970597(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.804302:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfffb80 with x1830881272028032 ext(0->7) 00010000:00010000:0.0:1746065115.804309:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0800/0x392ae0376f87cd8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d99 expref: 110 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.804329:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0800/0x392ae0376f87cd8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2d99 expref: 110 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.804335:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dfffb80 00000100:00100000:0.0:1746065115.806981:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.810720:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272028416 00000100:00100000:0.0:1746065115.810727:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272028416 00002000:00100000:0.0:1746065115.810762:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072f9a680 x1830881272028416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.810770:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9a680 with x1830881272028416 ext(0->4095) 00002000:00010000:0.0:1746065115.810774:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f9a680 00000100:00100000:0.0:1746065115.811050:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1743 00000100:00100000:0.0:1746065115.811056:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272028416:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065115.811310:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272028416:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 253us (667us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065115.811316:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1743 00002000:00100000:0.0:1746065115.811321:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072f9a680 x1830881272028416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:31/0 lens 488/4536 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.811327:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9a680 with x1830881272028416 ext(0->4095) 00010000:00010000:0.0:1746065115.811333:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0400/0x392ae0376f87cd95 lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2da7 expref: 6 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.811342:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c0400/0x392ae0376f87cd95 lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2da7 expref: 6 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.811350:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f9a680 00000100:00100000:0.0:1746065115.814481:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.817313:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.826736:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.833164:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+113:2002:x1830881272029312:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2351us (6425us total) trans 4294970598 rc 0/0 00000100:00100000:0.0:1746065115.833174:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1745 00002000:00100000:0.0:1746065115.833183:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012dffdf80 x1830881272029312/t4294970598(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.833191:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffdf80 with x1830881272029312 ext(0->7) 00010000:00010000:0.0:1746065115.833200:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2dae expref: 113 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.833213:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800724c5000/0x392ae0376f87cd9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2dae expref: 113 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.833219:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dffdf80 00000100:00100000:0.0:1746065115.837608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.842946:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.845912:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.845992:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.849987:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.853597:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.855444:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2004:x1830881272030592:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1666us (1848us total) trans 4294970599 rc 0/0 00000100:00100000:0.0:1746065115.855456:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1748 00002000:00100000:0.0:1746065115.855467:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072a1e680 x1830881272030592/t4294970599(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.855475:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1e680 with x1830881272030592 ext(0->7) 00010000:00010000:0.0:1746065115.855482:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87cdaa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2dbc expref: 114 pid: 9560 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.855494:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87cdaa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2dbc expref: 114 pid: 9560 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.855500:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a1e680 00000100:00100000:0.0:1746065115.870931:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.871039:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.871075:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272031104 00000100:00100000:0.0:1746065115.871108:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272031104 00000100:00100000:0.0:1746065115.871158:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28630 00000100:00100000:0.0:1746065115.871165:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:1140:x1830881272031104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065115.871179:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.871194:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727b7e00/0x392ae0376f87cdb8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2dca expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.871217:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f525800/0x392ae0376f87cdb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2dc3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.871223:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.871682:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.871688:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727b7e00/0x392ae0376f87cdb8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2dca expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065115.878979:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.879740:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.883404:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.889020:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.891752:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+117:2002:x1830881272031872:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2522us (2730us total) trans 4294970600 rc 0/0 00000100:00100000:0.0:1746065115.891763:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1751 00002000:00100000:0.0:1746065115.891771:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072a1c380 x1830881272031872/t4294970600(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.891780:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1c380 with x1830881272031872 ext(0->7) 00010000:00010000:0.0:1746065115.891788:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727b7e00/0x392ae0376f87cdb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2dca expref: 117 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.891802:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727b7e00/0x392ae0376f87cdb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2dca expref: 117 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065115.891808:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a1c380 00000100:00100000:0.0:1746065115.895883:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.901528:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.905307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.912613:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.912697:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.915393:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.915640:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.918731:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.918815:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.924065:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.925431:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+118:2005:x1830881272033920:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1190us (1365us total) trans 4294970601 rc 0/0 00000100:00100000:0.0:1746065115.925439:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1754 00002000:00100000:0.0:1746065115.925446:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009c321c00 x1830881272033920/t4294970601(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.925453:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321c00 with x1830881272033920 ext(0->7) 00010000:00010000:0.0:1746065115.925458:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87cdcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ddf expref: 118 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.925539:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87cdcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ddf expref: 118 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065115.925546:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c321c00 00000100:00100000:0.0:1746065115.929199:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.934054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.944552:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.947831:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.947917:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.947946:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272034944 00000100:00100000:0.0:1746065115.947950:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272034944 00010000:00010000:0.0:1746065115.947967:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cdd4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2de6 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065115.947983:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12609 00000100:00100000:0.0:1746065115.947988:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272034944:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065115.947998:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065115.948014:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cdd4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2de6 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.948021:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87cdd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2de6 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.948039:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065115.948070:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272034944:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 82us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.948075:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12609 00000100:00100000:0.0:1746065115.949960:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.949989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.953747:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.956617:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.958272:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+120:2003:x1830881272035712:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1257us (1658us total) trans 4294970602 rc 0/0 00000100:00100000:0.0:1746065115.958279:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1757 00002000:00100000:0.0:1746065115.958284:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729b0a80 x1830881272035712/t4294970602(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.958290:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0a80 with x1830881272035712 ext(0->7) 00010000:00010000:0.0:1746065115.958295:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87cde2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2df4 expref: 120 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.958305:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87cde2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2df4 expref: 120 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065115.958310:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729b0a80 00000100:00100000:0.0:1746065115.961153:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.968894:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.971798:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.975437:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.977456:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.979615:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065115.996538:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+123:2003:x1830881272036992:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1255us (1703us total) trans 4294970603 rc 0/0 00000100:00100000:0.0:1746065115.996547:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1759 00002000:00100000:0.0:1746065115.996553:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072f99f80 x1830881272036992/t4294970603(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:31/0 lens 496/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.996561:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99f80 with x1830881272036992 ext(0->7) 00010000:00010000:0.0:1746065115.996567:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847000/0x392ae0376f87cdf0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e02 expref: 123 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.996576:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847000/0x392ae0376f87cdf0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e02 expref: 123 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065115.996582:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f99f80 00000100:00100000:0.0:1746065116.005181:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.005803:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.009632:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.012170:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272037632 00000100:00100000:0.0:1746065116.012177:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272037632 00010000:00010000:0.0:1746065116.012200:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fecf400/0x392ae0376f87cdf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e09 expref: 123 pid: 21550 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.012224:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12614 00000100:00100000:0.0:1746065116.012229:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+123:2005:x1830881272037632:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.012238:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.012250:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fecf400/0x392ae0376f87cdf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e09 expref: 123 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.012259:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fecf400/0x392ae0376f87cdf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e09 expref: 123 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.012275:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fecf400/0x392ae0376f87cdf7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e09 expref: 123 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.013645:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.013648:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.013656:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f87cdfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e10 expref: 122 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.013664:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f87cdfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e10 expref: 122 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.013694:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f87cdfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e10 expref: 122 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.013704:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267247232:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065116.013760:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.017390:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.021911:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.026159:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+124:2005:x1830881272038272:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3365us (4244us total) trans 4294970604 rc 0/0 00000100:00100000:0.0:1746065116.026169:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1762 00002000:00100000:0.0:1746065116.026178:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729b1500 x1830881272038272/t4294970604(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.026186:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1500 with x1830881272038272 ext(0->7) 00010000:00010000:0.0:1746065116.026194:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f87cdfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e10 expref: 124 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.026209:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f87cdfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e10 expref: 124 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.026215:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729b1500 00000100:00100000:0.0:1746065116.030724:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.035014:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.039332:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.040483:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.042024:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.044474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.046502:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.051321:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+127:2002:x1830881272039552:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 4494us (4813us total) trans 4294970605 rc 0/0 00000100:00100000:0.0:1746065116.051332:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1764 00002000:00100000:0.0:1746065116.051342:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88007297b100 x1830881272039552/t4294970605(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.051350:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297b100 with x1830881272039552 ext(0->7) 00010000:00010000:0.0:1746065116.051358:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02d600/0x392ae0376f87ce0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e1e expref: 127 pid: 9558 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.051372:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02d600/0x392ae0376f87ce0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e1e expref: 127 pid: 9558 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.051377:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007297b100 00000100:00100000:0.0:1746065116.055933:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.059608:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.061692:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.061755:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.064277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.064739:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.067537:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.070433:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.073220:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.076420:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.078447:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+128:2005:x1830881272041216:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1836us (2026us total) trans 4294970606 rc 0/0 00000100:00100000:0.0:1746065116.078456:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1766 00002000:00100000:0.0:1746065116.078464:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072978000 x1830881272041216/t4294970606(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.078472:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978000 with x1830881272041216 ext(0->7) 00010000:00010000:0.0:1746065116.078480:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87ce1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e2c expref: 128 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.078492:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87ce1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e2c expref: 128 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.078498:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072978000 00000100:00100000:0.0:1746065116.080159:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.082520:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.085934:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.086127:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.086324:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28648 00000100:00100000:0.0:1746065116.086329:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+129:1141:x1830881272041856:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065116.086334:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065116.086339:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f87ce36 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2e48 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.086349:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.086351:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f02ce00/0x392ae0376f87ce2f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e41 expref: 130 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.086355:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065116.086357:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f87ce36 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e48 expref: 130 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.086433:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f02ce00/0x392ae0376f87ce2f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e41 expref: 130 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.086448:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f87ce36 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e48 expref: 130 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.086456:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09fb000, rc 0) 00000100:00100000:0.0:1746065116.088016:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.091675:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272042240 00000100:00100000:0.0:1746065116.091680:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272042240 00002000:00100000:0.0:1746065116.091775:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072f98380 x1830881272042240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.091783:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98380 with x1830881272042240 ext(0->4095) 00010000:00010000:0.0:1746065116.091789:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02ce00/0x392ae0376f87ce2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e41 expref: 129 pid: 9558 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.091800:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02ce00/0x392ae0376f87ce2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e41 expref: 129 pid: 9558 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.091805:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f98380 00000100:00100000:0.0:1746065116.094117:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.094987:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+131:2003:x1830881272042496:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 660us (901us total) trans 4294970607 rc 0/0 00000100:00100000:0.0:1746065116.094994:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1768 00002000:00100000:0.0:1746065116.095000:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009549ea00 x1830881272042496/t4294970607(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.095007:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ea00 with x1830881272042496 ext(0->7) 00010000:00010000:0.0:1746065116.095012:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02ce00/0x392ae0376f87ce2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e41 expref: 131 pid: 9558 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.095022:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02ce00/0x392ae0376f87ce2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e41 expref: 131 pid: 9558 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.095027:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009549ea00 00000100:00100000:0.0:1746065116.097965:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.104564:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.109346:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.109427:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.112537:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.112605:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.114159:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.116805:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.121038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.125971:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.126840:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+132:2005:x1830881272044160:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 603us (873us total) trans 4294970608 rc 0/0 00000100:00100000:0.0:1746065116.126847:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1770 00002000:00100000:0.0:1746065116.126853:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009549c000 x1830881272044160/t4294970608(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.126864:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549c000 with x1830881272044160 ext(0->7) 00010000:00010000:0.0:1746065116.126869:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f87ce44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e56 expref: 132 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.126878:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f87ce44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e56 expref: 132 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.126887:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009549c000 00000100:00100000:0.0:1746065116.131347:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.134227:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.141298:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.144743:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.147505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.148417:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.152008:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.152058:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.155992:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.160029:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.169662:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+134:2005:x1830881272045952:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 8827us (9633us total) trans 4294970609 rc 0/0 00000100:00100000:0.0:1746065116.169672:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1773 00002000:00100000:0.0:1746065116.169680:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a091b800 x1830881272045952/t4294970609(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.169688:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091b800 with x1830881272045952 ext(0->7) 00010000:00010000:0.0:1746065116.169696:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87ce59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e6b expref: 134 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.169709:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87ce59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e6b expref: 134 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.169715:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091b800 00000100:00100000:0.0:1746065116.173434:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.178144:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.178667:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.178785:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb67b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267250432:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065116.178797:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.178818:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+135:2002:x1830881272046080:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4510us (5392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.178825:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12628 00000100:00100000:0.0:1746065116.183457:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.186448:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.191658:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.193840:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.195063:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+136:2004:x1830881272047104:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 905us (1225us total) trans 4294970610 rc 0/0 00000100:00100000:0.0:1746065116.195070:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1775 00002000:00100000:0.0:1746065116.195076:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a0918e00 x1830881272047104/t4294970610(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.195101:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918e00 with x1830881272047104 ext(0->7) 00010000:00010000:0.0:1746065116.195107:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87ce67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e79 expref: 136 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.195116:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87ce67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e79 expref: 136 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.195121:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0918e00 00000100:00100000:0.0:1746065116.196527:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.201729:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.201767:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.206215:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.206265:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.209886:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.211801:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.213312:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+139:2004:x1830881272048384:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1323us (1511us total) trans 4294970611 rc 0/0 00000100:00100000:0.0:1746065116.213319:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1777 00002000:00100000:0.0:1746065116.213325:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306f0000 x1830881272048384/t4294970611(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.213331:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0000 with x1830881272048384 ext(0->7) 00010000:00010000:0.0:1746065116.213336:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f87ce75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e87 expref: 139 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.213346:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f87ce75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e87 expref: 139 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.213351:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306f0000 00000100:00100000:0.0:1746065116.217172:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.224279:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.226537:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.228119:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.235705:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.243304:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.245950:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.245982:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.248689:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.251227:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.252514:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+140:2003:x1830881272050176:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1051us (1288us total) trans 4294970612 rc 0/0 00000100:00100000:0.0:1746065116.252521:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1779 00002000:00100000:0.0:1746065116.252527:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306f2d80 x1830881272050176/t4294970612(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.252534:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2d80 with x1830881272050176 ext(0->7) 00010000:00010000:0.0:1746065116.252540:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f87ce8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e9c expref: 140 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.252550:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f87ce8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2e9c expref: 140 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.252555:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306f2d80 00000100:00100000:0.0:1746065116.254929:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.257190:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.260263:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.262751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.266940:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.267013:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.268529:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272051072 00000100:00100000:0.0:1746065116.268534:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272051072 00000100:00100000:0.0:1746065116.268830:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28663 00000100:00100000:0.0:1746065116.268836:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+140:1140:x1830881272051072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065116.268845:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065116.268858:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ce9f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e2eb1 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.268883:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87ce91 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ea3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.268904:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87ce98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eaa expref: 141 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.268910:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.268911:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.268914:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ce9f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eb1 expref: 141 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.268935:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87ce98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eaa expref: 141 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.268945:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87ce98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eaa expref: 141 pid: 21550 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.268954:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267252224:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065116.269795:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87ce91 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ea3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.269804:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87ce91 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ea3 expref: 5 pid: 9560 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.269812:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267252352:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065116.269830:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.274108:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.274181:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.274206:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272051584 00000100:00100000:0.0:1746065116.274211:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272051584 00010000:00010000:0.0:1746065116.274236:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87ce91 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ea3 expref: 6 pid: 9560 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.275013:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272051456 00000100:00100000:0.0:1746065116.275017:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272051456 00010000:00010000:0.0:1746065116.275029:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87ce98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eaa expref: 142 pid: 21550 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.275243:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12637 00000100:00100000:0.0:1746065116.275249:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+142:2004:x1830881272051456:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.275256:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.275263:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87ce98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eaa expref: 142 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.275271:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87ce98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eaa expref: 142 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.275281:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87ce98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eaa expref: 142 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.275745:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.275747:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.275753:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ce9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eb1 expref: 140 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.275764:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ce9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eb1 expref: 140 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.275787:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ce9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eb1 expref: 140 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.275797:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267252480:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065116.276036:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.280654:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.282264:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.283110:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267252608:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065116.283123:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880072b21800/0x392ae0376f87cea6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eb8 expref: 141 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.283142:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b21800, rc 0) 00000100:00100000:0.0:1746065116.283159:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+141:1141:x1830881272051712:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2116us (2513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.283164:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28664 00000100:00100000:0.0:1746065116.284826:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.285959:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+143:2003:x1830881272052224:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 734us (1136us total) trans 4294970613 rc 0/0 00000100:00100000:0.0:1746065116.285966:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1781 00002000:00100000:0.0:1746065116.285971:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f18d880 x1830881272052224/t4294970613(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.285984:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18d880 with x1830881272052224 ext(0->7) 00010000:00010000:0.0:1746065116.285989:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ce9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eb1 expref: 143 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.285998:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ee00/0x392ae0376f87ce9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2eb1 expref: 143 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.286003:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f18d880 00000100:00100000:0.0:1746065116.287485:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.293732:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.293788:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272052608 00000100:00100000:0.0:1746065116.293794:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272052608 00002000:00100000:0.0:1746065116.293830:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f7c2d80 x1830881272052608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.293839:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2d80 with x1830881272052608 ext(0->4095) 00002000:00010000:0.0:1746065116.293843:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7c2d80 00000100:00100000:0.0:1746065116.293861:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12743 00000100:00100000:0.0:1746065116.293868:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+142:2002:x1830881272052608:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065116.293970:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+142:2002:x1830881272052608:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 102us (244us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065116.293975:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12743 00002000:00100000:0.0:1746065116.293980:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f7c2d80 x1830881272052608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.293987:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2d80 with x1830881272052608 ext(0->4095) 00002000:00010000:0.0:1746065116.293990:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7c2d80 00000100:00100000:0.0:1746065116.295760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.298600:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.303057:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.313990:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.323181:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.323786:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.323841:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.327800:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.330610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.331791:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+144:2005:x1830881272054272:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 887us (1185us total) trans 4294970614 rc 0/0 00000100:00100000:0.0:1746065116.331798:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1783 00002000:00100000:0.0:1746065116.331803:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f7c1880 x1830881272054272/t4294970614(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.331810:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1880 with x1830881272054272 ext(0->7) 00010000:00010000:0.0:1746065116.331816:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f87ceb4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ec6 expref: 144 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.331826:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f87ceb4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ec6 expref: 144 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.331831:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7c1880 00000100:00100000:0.0:1746065116.337840:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.341831:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.341871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.344385:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.344440:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.346566:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.348415:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.349313:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+147:2004:x1830881272055552:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 738us (898us total) trans 4294970615 rc 0/0 00000100:00100000:0.0:1746065116.349319:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1786 00002000:00100000:0.0:1746065116.349324:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f7c0000 x1830881272055552/t4294970615(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.349330:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0000 with x1830881272055552 ext(0->7) 00010000:00010000:0.0:1746065116.349334:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847a00/0x392ae0376f87cec2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ed4 expref: 147 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.349341:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847a00/0x392ae0376f87cec2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ed4 expref: 147 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.349346:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7c0000 00000100:00100000:0.0:1746065116.350751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.353039:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.356820:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.359154:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.360847:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.367214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.373512:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.382618:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.383299:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.385575:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.387490:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.387531:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.396299:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+150:2002:x1830881272058880:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1846us (2022us total) trans 4294970617 rc 0/0 00000100:00100000:0.0:1746065116.396306:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1791 00002000:00100000:0.0:1746065116.396312:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072f99500 x1830881272058880/t4294970617(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.396320:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99500 with x1830881272058880 ext(0->7) 00010000:00010000:0.0:1746065116.396326:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847000/0x392ae0376f87cee5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ef7 expref: 150 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.396337:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847000/0x392ae0376f87cee5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ef7 expref: 150 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.396342:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f99500 00000100:00100000:0.0:1746065116.409692:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.415268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.424341:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.428268:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.430760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.435360:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.437256:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+152:2004:x1830881272060032:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1726us (1893us total) trans 4294970618 rc 0/0 00000100:00100000:0.0:1746065116.437264:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1793 00002000:00100000:0.0:1746065116.437271:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88007253ca80 x1830881272060032/t4294970618(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.437278:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253ca80 with x1830881272060032 ext(0->7) 00010000:00010000:0.0:1746065116.437285:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b21800/0x392ae0376f87cef3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f05 expref: 152 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.437296:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b21800/0x392ae0376f87cef3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f05 expref: 152 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.437303:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007253ca80 00000100:00100000:0.0:1746065116.441268:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.444342:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.447802:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.450958:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.452255:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.459937:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.460018:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.460054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.460116:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272061056 00000100:00100000:0.0:1746065116.460124:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272061056 00010000:00010000:0.0:1746065116.460161:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f87cefa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f0c expref: 6 pid: 9560 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.460192:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272061312 00000100:00100000:0.0:1746065116.460195:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272061312 00010000:00010000:0.0:1746065116.460204:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cf01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f13 expref: 153 pid: 9560 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.460218:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12651 00000100:00100000:0.0:1746065116.460223:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272061056:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.460234:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.460251:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f87cefa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f0c expref: 6 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.460260:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f87cefa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f0c expref: 6 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.460278:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f87cefa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f0c expref: 6 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.461201:0:9574:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.461221:0:9574:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272061056:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 997us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.461228:0:9574:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12651 00000100:00100000:0.0:1746065116.467578:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.470672:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.474341:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+154:2002:x1830881272061824:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2887us (3668us total) trans 4294970619 rc 0/0 00000100:00100000:0.0:1746065116.474351:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1796 00002000:00100000:0.0:1746065116.474359:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f938700 x1830881272061824/t4294970619(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.474367:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938700 with x1830881272061824 ext(0->7) 00010000:00010000:0.0:1746065116.474374:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f87cf08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f1a expref: 154 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.474386:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f87cf08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f1a expref: 154 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.474397:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f938700 00000100:00100000:0.0:1746065116.476612:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.479163:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.482476:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.486737:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.491445:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.505423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.513021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.513069:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.516607:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.516638:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272063616 00000100:00100000:0.0:1746065116.516643:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272063616 00002000:00100000:0.0:1746065116.516671:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f939c00 x1830881272063616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.516679:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881272063616 ext(0->4095) 00010000:00010000:0.0:1746065116.516685:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cf1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f2f expref: 154 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.516694:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cf1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f2f expref: 154 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.516700:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f939c00 00000100:00100000:0.0:1746065116.516714:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1797 00000100:00100000:0.0:1746065116.516720:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+154:2004:x1830881272063616:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065116.516809:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+154:2004:x1830881272063616:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 89us (334us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065116.516815:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1797 00002000:00100000:0.0:1746065116.516819:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f939c00 x1830881272063616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.516824:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881272063616 ext(0->4095) 00010000:00010000:0.0:1746065116.516827:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cf1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f2f expref: 154 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.516834:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cf1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f2f expref: 154 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.516839:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f939c00 00000100:00100000:0.0:1746065116.536019:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+156:2003:x1830881272063872:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1569us (6568us total) trans 4294970620 rc 0/0 00000100:00100000:0.0:1746065116.536027:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1798 00002000:00100000:0.0:1746065116.536033:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072f99c00 x1830881272063872/t4294970620(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.536040:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99c00 with x1830881272063872 ext(0->7) 00010000:00010000:0.0:1746065116.536046:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cf1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f2f expref: 156 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.536058:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cf1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f2f expref: 156 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.536064:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f99c00 00000100:00100000:0.0:1746065116.537436:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.539555:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.541619:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.544325:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.550354:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.558401:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.567330:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.568215:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+158:2004:x1830881272065024:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 645us (890us total) trans 4294970621 rc 0/0 00000100:00100000:0.0:1746065116.568221:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1800 00002000:00100000:0.0:1746065116.568226:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fbbdf80 x1830881272065024/t4294970621(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.568232:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdf80 with x1830881272065024 ext(0->7) 00010000:00010000:0.0:1746065116.568236:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cf2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f3d expref: 158 pid: 9560 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.568245:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cf2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f3d expref: 158 pid: 9560 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.568249:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbdf80 00000100:00100000:0.0:1746065116.575300:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.577424:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.577603:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.580388:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.582456:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272066048 00000100:00100000:0.0:1746065116.582462:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272066048 00002000:00100000:0.0:1746065116.582492:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fb67480 x1830881272066048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.582505:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67480 with x1830881272066048 ext(0->4095) 00010000:00010000:0.0:1746065116.582512:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b20200/0x392ae0376f87cf39 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f4b expref: 159 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.582522:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b20200/0x392ae0376f87cf39 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f4b expref: 159 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.582527:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb67480 00000100:00100000:0.0:1746065116.582540:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1801 00000100:00100000:0.0:1746065116.582545:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+159:2004:x1830881272066048:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065116.582648:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+159:2004:x1830881272066048:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 102us (259us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065116.582653:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1801 00002000:00100000:0.0:1746065116.582659:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fb67480 x1830881272066048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.582665:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67480 with x1830881272066048 ext(0->4095) 00010000:00010000:0.0:1746065116.582669:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b20200/0x392ae0376f87cf39 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f4b expref: 159 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.582677:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b20200/0x392ae0376f87cf39 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f4b expref: 159 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.582682:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb67480 00000100:00100000:0.0:1746065116.584734:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.588447:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+161:2003:x1830881272066304:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2876us (3708us total) trans 4294970622 rc 0/0 00000100:00100000:0.0:1746065116.588457:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1802 00002000:00100000:0.0:1746065116.588465:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fbbc000 x1830881272066304/t4294970622(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.588474:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc000 with x1830881272066304 ext(0->7) 00010000:00010000:0.0:1746065116.588481:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b20200/0x392ae0376f87cf39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f4b expref: 161 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.588494:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b20200/0x392ae0376f87cf39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f4b expref: 161 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.588499:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbc000 00000100:00100000:0.0:1746065116.596486:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.596573:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.605349:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.608344:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.615779:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.619012:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.631833:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+162:2003:x1830881272067584:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 10413us (12819us total) trans 4294970623 rc 0/0 00000100:00100000:0.0:1746065116.631843:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1805 00002000:00100000:0.0:1746065116.631853:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d79ca80 x1830881272067584/t4294970623(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.631862:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ca80 with x1830881272067584 ext(0->7) 00010000:00010000:0.0:1746065116.631869:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847000/0x392ae0376f87cf47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f59 expref: 162 pid: 9642 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.631882:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847000/0x392ae0376f87cf47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f59 expref: 162 pid: 9642 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.631887:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d79ca80 00000100:00100000:0.0:1746065116.632514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.632534:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272067712 00000100:00100000:0.0:1746065116.632540:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272067712 00000100:00100000:0.0:1746065116.636063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.638913:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.644231:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.649622:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.654143:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.658589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.659787:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+164:2002:x1830881272068736:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1004us (1202us total) trans 4294970624 rc 0/0 00000100:00100000:0.0:1746065116.659794:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1807 00002000:00100000:0.0:1746065116.659799:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d79c380 x1830881272068736/t4294970624(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.659806:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79c380 with x1830881272068736 ext(0->7) 00010000:00010000:0.0:1746065116.659812:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b21e00/0x392ae0376f87cf55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f67 expref: 164 pid: 9642 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.659821:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b21e00/0x392ae0376f87cf55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f67 expref: 164 pid: 9642 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.659826:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d79c380 00000100:00100000:0.0:1746065116.667498:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.667565:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.677798:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272069248 00000100:00100000:0.0:1746065116.677804:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272069248 00002000:00100000:0.0:1746065116.677838:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fb64e00 x1830881272069248/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.677846:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64e00 with x1830881272069248 ext(0->4095) 00010000:00010000:0.0:1746065116.677852:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b21c00/0x392ae0376f87cf5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f6e expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.677861:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b21c00/0x392ae0376f87cf5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f6e expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.677866:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb64e00 00000100:00100000:0.0:1746065116.677881:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1808 00000100:00100000:0.0:1746065116.678358:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272069248:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065116.678457:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272069248:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 569us (706us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065116.678462:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1808 00002000:00100000:0.0:1746065116.678467:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fb64e00 x1830881272069248/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.678474:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64e00 with x1830881272069248 ext(0->4095) 00010000:00010000:0.0:1746065116.678478:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b21c00/0x392ae0376f87cf5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f6e expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.678486:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b21c00/0x392ae0376f87cf5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f6e expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.678492:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb64e00 00000100:00100000:0.0:1746065116.680412:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.685449:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.704218:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.704646:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.705214:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+167:2004:x1830881272069888:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 767us (997us total) trans 4294970625 rc 0/0 00000100:00100000:0.0:1746065116.705220:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1809 00002000:00100000:0.0:1746065116.705226:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729d7800 x1830881272069888/t4294970625(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.705233:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d7800 with x1830881272069888 ext(0->7) 00010000:00010000:0.0:1746065116.705237:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846000/0x392ae0376f87cf63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f75 expref: 167 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.705246:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846000/0x392ae0376f87cf63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f75 expref: 167 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.705251:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729d7800 00000100:00100000:0.0:1746065116.706299:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.714212:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.717797:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.724669:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.730835:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.732173:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+168:2004:x1830881272071040:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 997us (1336us total) trans 4294970626 rc 0/0 00000100:00100000:0.0:1746065116.732182:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1811 00002000:00100000:0.0:1746065116.732188:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729d4380 x1830881272071040/t4294970626(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.732196:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d4380 with x1830881272071040 ext(0->7) 00010000:00010000:0.0:1746065116.732201:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87cf71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f83 expref: 168 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.732211:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87cf71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f83 expref: 168 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.732218:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729d4380 00000100:00100000:0.0:1746065116.733246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.735803:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.741340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.747297:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.753912:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.753959:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.758986:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.759067:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.759112:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272072192 00000100:00100000:0.0:1746065116.759116:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272072192 00010000:00010000:0.0:1746065116.759142:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cf7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f91 expref: 169 pid: 21550 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.759166:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12670 00000100:00100000:0.0:1746065116.759171:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+169:2005:x1830881272072192:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.759180:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.759492:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cf7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f91 expref: 169 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.759503:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cf7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f91 expref: 169 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.759526:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cf7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f91 expref: 169 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.759544:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.759545:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.759550:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f846a00/0x392ae0376f87cf86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f98 expref: 168 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.759557:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846a00/0x392ae0376f87cf86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f98 expref: 168 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.759875:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f846a00/0x392ae0376f87cf86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f98 expref: 168 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.759884:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f846a00/0x392ae0376f87cf86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f98 expref: 168 pid: 21550 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.759893:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267260416:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065116.763878:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.774007:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272072832 00000100:00100000:0.0:1746065116.774015:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272072832 00002000:00100000:0.0:1746065116.774050:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072f9b100 x1830881272072832/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.774059:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b100 with x1830881272072832 ext(0->7) 00010000:00010000:0.0:1746065116.774067:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846a00/0x392ae0376f87cf86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f98 expref: 168 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.774109:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846a00/0x392ae0376f87cf86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f98 expref: 168 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.774115:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f9b100 00000100:00100000:0.0:1746065116.774142:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1814 00000100:00100000:0.0:1746065116.774148:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+168:2002:x1830881272072832:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065116.775725:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+170:2002:x1830881272072832:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1570us (2282us total) trans 4294970627 rc 0/0 00000100:00100000:0.0:1746065116.775734:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1814 00002000:00100000:0.0:1746065116.775743:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072f9b100 x1830881272072832/t4294970627(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.775752:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b100 with x1830881272072832 ext(0->7) 00010000:00010000:0.0:1746065116.775759:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846a00/0x392ae0376f87cf86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f98 expref: 170 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.775771:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846a00/0x392ae0376f87cf86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f98 expref: 170 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.775777:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f9b100 00000100:00100000:0.0:1746065116.777757:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.786477:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb65180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267260544:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065116.786493:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.787295:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+169:2003:x1830881272072960:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5761us (9540us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.787304:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12671 00000100:00100000:0.0:1746065116.787336:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272073216 00000100:00100000:0.0:1746065116.787340:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272073216 00002000:00100000:0.0:1746065116.787371:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072f9bb80 x1830881272073216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.787380:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9bb80 with x1830881272073216 ext(0->4095) 00002000:00010000:0.0:1746065116.787384:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f9bb80 00000100:00100000:0.0:1746065116.787404:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12761 00000100:00100000:0.0:1746065116.787409:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272073216:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065116.787509:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272073216:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 99us (1270us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065116.787515:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12761 00002000:00100000:0.0:1746065116.787519:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072f9bb80 x1830881272073216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.787526:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9bb80 with x1830881272073216 ext(0->4095) 00002000:00010000:0.0:1746065116.787528:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f9bb80 00000100:00100000:0.0:1746065116.789458:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.792168:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.793765:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.793790:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272073600 00000100:00100000:0.0:1746065116.793796:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272073600 00010000:00010000:0.0:1746065116.793824:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87cf8d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f9f expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.793862:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12672 00000100:00100000:0.0:1746065116.793869:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272073600:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.793879:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.793893:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87cf8d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f9f expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.793903:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87cf8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2f9f expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.793921:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.793923:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.793928:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f87cf94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fa6 expref: 170 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.793936:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f87cf94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fa6 expref: 170 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.793961:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f87cf94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fa6 expref: 170 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.793971:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a04000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267260800:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065116.794027:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.813592:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.816495:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+173:2005:x1830881272074112:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2697us (2902us total) trans 4294970628 rc 0/0 00000100:00100000:0.0:1746065116.816505:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1816 00002000:00100000:0.0:1746065116.816513:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072a07100 x1830881272074112/t4294970628(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.816521:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a07100 with x1830881272074112 ext(0->7) 00010000:00010000:0.0:1746065116.816529:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f87cf94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fa6 expref: 173 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.816541:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f87cf94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fa6 expref: 173 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.816547:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a07100 00000100:00100000:0.0:1746065116.819972:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.827258:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.832064:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.832803:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.838919:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.841755:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272075008 00000100:00100000:0.0:1746065116.841763:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272075008 00002000:00100000:0.0:1746065116.841794:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fafaa00 x1830881272075008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.841802:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafaa00 with x1830881272075008 ext(0->4095) 00010000:00010000:0.0:1746065116.841808:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cfa2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fb4 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.841820:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cfa2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fb4 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.841831:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fafaa00 00000100:00100000:0.0:1746065116.841859:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1817 00000100:00100000:0.0:1746065116.841865:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272075008:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065116.841965:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272075008:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 100us (1651us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065116.841970:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1817 00002000:00100000:0.0:1746065116.841975:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fafaa00 x1830881272075008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.841981:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafaa00 with x1830881272075008 ext(0->4095) 00010000:00010000:0.0:1746065116.841985:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cfa2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fb4 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.841994:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cfa2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fb4 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.841999:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fafaa00 00000100:00100000:0.0:1746065116.847232:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.847259:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272075264 00000100:00100000:0.0:1746065116.847266:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272075264 00010000:00010000:0.0:1746065116.847293:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cfa2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fb4 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.847335:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12675 00000100:00100000:0.0:1746065116.847342:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272075264:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.847353:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.847372:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cfa2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fb4 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.847381:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cfa2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fb4 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.847399:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b20c00/0x392ae0376f87cfa2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fb4 expref: 6 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.847422:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.847423:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.847429:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880072b21c00/0x392ae0376f87cfa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fbb expref: 171 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.847437:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072b21c00/0x392ae0376f87cfa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fbb expref: 171 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.847978:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880072b21c00/0x392ae0376f87cfa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fbb expref: 171 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.847989:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f84b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267261440:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065116.848739:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.851611:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.857627:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.860519:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.861403:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+174:2004:x1830881272075776:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 731us (884us total) trans 4294970629 rc 0/0 00000100:00100000:0.0:1746065116.861409:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1818 00002000:00100000:0.0:1746065116.861414:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f849c00 x1830881272075776/t4294970629(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.861421:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f849c00 with x1830881272075776 ext(0->7) 00010000:00010000:0.0:1746065116.861426:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b21c00/0x392ae0376f87cfa9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fbb expref: 174 pid: 21550 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.861434:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b21c00/0x392ae0376f87cfa9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fbb expref: 174 pid: 21550 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.861440:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f849c00 00000100:00100000:0.0:1746065116.863853:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.869790:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.874874:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.874958:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.880876:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.884796:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.884832:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272076800 00000100:00100000:0.0:1746065116.884838:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272076800 00002000:00100000:0.0:1746065116.884864:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f5eb480 x1830881272076800/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.884873:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eb480 with x1830881272076800 ext(0->4095) 00010000:00010000:0.0:1746065116.884879:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87cfb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fc9 expref: 175 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.884889:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87cfb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fc9 expref: 175 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065116.884896:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f5eb480 00000100:00100000:0.0:1746065116.884907:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1819 00000100:00100000:0.0:1746065116.884912:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+175:2003:x1830881272076800:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065116.885000:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+175:2003:x1830881272076800:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 88us (205us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065116.885005:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1819 00002000:00100000:0.0:1746065116.885008:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f5eb480 x1830881272076800/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.885014:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eb480 with x1830881272076800 ext(0->4095) 00010000:00010000:0.0:1746065116.885018:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87cfb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fc9 expref: 175 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.885025:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87cfb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fc9 expref: 175 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065116.885030:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f5eb480 00000100:00100000:0.0:1746065116.910604:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+177:2002:x1830881272077056:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 866us (1077us total) trans 4294970630 rc 0/0 00000100:00100000:0.0:1746065116.910611:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1820 00002000:00100000:0.0:1746065116.910616:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072f9b480 x1830881272077056/t4294970630(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.910623:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b480 with x1830881272077056 ext(0->7) 00010000:00010000:0.0:1746065116.910627:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87cfb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fc9 expref: 177 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.910637:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87cfb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fc9 expref: 177 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065116.910642:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f9b480 00000100:00100000:0.0:1746065116.912290:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.915536:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.918375:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.920704:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.922681:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.925409:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.936555:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.937785:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+178:2005:x1830881272078336:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 734us (1235us total) trans 4294970631 rc 0/0 00000100:00100000:0.0:1746065116.937791:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1823 00002000:00100000:0.0:1746065116.937797:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012fbfb480 x1830881272078336/t4294970631(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.937803:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfb480 with x1830881272078336 ext(0->7) 00010000:00010000:0.0:1746065116.937807:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b30800/0x392ae0376f87cfc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fd7 expref: 178 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.937817:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b30800/0x392ae0376f87cfc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fd7 expref: 178 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065116.937822:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fbfb480 00000100:00100000:0.0:1746065116.941528:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.942409:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12680 00000100:00100000:0.0:1746065116.942417:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+178:2003:x1830881272078464:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.942428:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.942445:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072b30800/0x392ae0376f87cfc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fd7 expref: 178 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.942456:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072b30800/0x392ae0376f87cfc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fd7 expref: 178 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.942475:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b30800/0x392ae0376f87cfc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fd7 expref: 178 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.942529:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.942531:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.942537:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880072b6ce00/0x392ae0376f87cfcc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fde expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.942544:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072b6ce00/0x392ae0376f87cfcc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fde expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.942571:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880072b6ce00/0x392ae0376f87cfcc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fde expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.942580:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267262720:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065116.942658:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.944156:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.944208:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.944226:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272078848 00000100:00100000:0.0:1746065116.944230:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272078848 00002000:00100000:0.0:1746065116.944254:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012fbf8e00 x1830881272078848/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.944262:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8e00 with x1830881272078848 ext(0->4095) 00002000:00010000:0.0:1746065116.944266:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fbf8e00 00000100:00100000:0.0:1746065116.944280:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12765 00000100:00100000:0.0:1746065116.944286:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272078848:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065116.944595:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272078848:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 309us (385us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065116.944600:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12765 00002000:00100000:0.0:1746065116.944605:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012fbf8e00 x1830881272078848/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.944612:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8e00 with x1830881272078848 ext(0->4095) 00010000:00010000:0.0:1746065116.944616:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072b6ce00/0x392ae0376f87cfcc lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fde expref: 6 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.944624:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072b6ce00/0x392ae0376f87cfcc lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fde expref: 6 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065116.944628:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fbf8e00 00000100:00100000:0.0:1746065116.946895:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.946947:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.952973:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.961773:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.962644:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+181:2004:x1830881272079616:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 696us (875us total) trans 4294970632 rc 0/0 00000100:00100000:0.0:1746065116.962651:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1825 00002000:00100000:0.0:1746065116.962657:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012fbf8700 x1830881272079616/t4294970632(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 496/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.962664:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8700 with x1830881272079616 ext(0->7) 00010000:00010000:0.0:1746065116.962668:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bd74000/0x392ae0376f87cfd3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fe5 expref: 181 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.962678:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bd74000/0x392ae0376f87cfd3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fe5 expref: 181 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065116.962683:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fbf8700 00000100:00100000:0.0:1746065116.964686:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.968378:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.970633:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.973817:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.984075:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.984232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.986935:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.990233:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272081152 00000100:00100000:0.0:1746065116.990237:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272081152 00010000:00010000:0.0:1746065116.990256:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd74400/0x392ae0376f87cfda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fec expref: 181 pid: 9642 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065116.990278:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12683 00000100:00100000:0.0:1746065116.990283:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+181:2005:x1830881272081152:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.990292:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.990307:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bd74400/0x392ae0376f87cfda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fec expref: 181 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.990316:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bd74400/0x392ae0376f87cfda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fec expref: 181 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.990332:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd74400/0x392ae0376f87cfda lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2fec expref: 181 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.990344:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.990359:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+180:2005:x1830881272081152:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 76us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.990364:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12683 00000100:00100000:0.0:1746065116.991598:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.991632:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065116.999369:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272081664 00000100:00100000:0.0:1746065116.999374:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272081664 00002000:00100000:0.0:1746065116.999404:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fb65c00 x1830881272081664/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.999411:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb65c00 with x1830881272081664 ext(0->4095) 00010000:00010000:0.0:1746065116.999418:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cfe8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ffa expref: 181 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.999429:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cfe8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ffa expref: 181 pid: 9558 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065116.999435:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb65c00 00000100:00100000:0.0:1746065116.999461:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1827 00000100:00100000:0.0:1746065116.999468:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+181:2004:x1830881272081664:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065116.999555:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+181:2004:x1830881272081664:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 87us (356us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065116.999560:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1827 00002000:00100000:0.0:1746065116.999565:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fb65c00 x1830881272081664/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.999571:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb65c00 with x1830881272081664 ext(0->4095) 00010000:00010000:0.0:1746065116.999575:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cfe8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ffa expref: 181 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065116.999583:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cfe8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ffa expref: 181 pid: 9558 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065116.999589:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb65c00 00000100:00100000:0.0:1746065117.002948:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065117.003229:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065117.005470:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+183:2005:x1830881272081920:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2245us (2522us total) trans 4294970633 rc 0/0 00000100:00100000:0.0:1746065117.005479:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1828 00002000:00100000:0.0:1746065117.005488:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009dc11500 x1830881272081920/t4294970633(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.005496:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc11500 with x1830881272081920 ext(0->7) 00010000:00010000:0.0:1746065117.005504:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cfe8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ffa expref: 183 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.005521:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87cfe8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e2ffa expref: 183 pid: 9558 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.005527:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009dc11500 00000100:00100000:0.0:1746065117.009996:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.016704:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.026467:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.028153:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.033023:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.033061:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.035501:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.038411:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.044636:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.053500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.056728:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.056804:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.065734:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.069971:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.077695:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12689 00000100:00100000:0.0:1746065117.077711:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272084224:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065117.077738:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065117.077760:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f02de00/0x392ae0376f87d004 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3016 expref: 6 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.077775:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f02de00/0x392ae0376f87d004 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3016 expref: 6 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.077796:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f02de00/0x392ae0376f87d004 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3016 expref: 6 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.077822:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.077824:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.077829:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d00b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e301d expref: 183 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.077837:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d00b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e301d expref: 183 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.077865:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d00b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e301d expref: 183 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065117.077875:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267264768:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065117.077960:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.083965:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.097976:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.111486:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.119111:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+186:2005:x1830881272084736:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2387us (7624us total) trans 4294970635 rc 0/0 00000100:00100000:0.0:1746065117.119122:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1832 00002000:00100000:0.0:1746065117.119145:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88013077b100 x1830881272084736/t4294970635(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.119154:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b100 with x1830881272084736 ext(0->7) 00010000:00010000:0.0:1746065117.119164:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d00b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e301d expref: 186 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.119178:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d00b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e301d expref: 186 pid: 9558 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.119184:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013077b100 00000100:00100000:0.0:1746065117.138848:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.138933:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.141850:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.149189:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.153689:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.168846:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.171549:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.176435:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+188:2002:x1830881272085888:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 680us (4885us total) trans 4294970636 rc 0/0 00000100:00100000:0.0:1746065117.176442:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1834 00002000:00100000:0.0:1746065117.176447:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d5a0000 x1830881272085888/t4294970636(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.176454:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0000 with x1830881272085888 ext(0->7) 00010000:00010000:0.0:1746065117.176459:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87d019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e302b expref: 188 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.176468:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87d019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e302b expref: 188 pid: 9558 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.176474:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a0000 00000100:00100000:0.0:1746065117.177746:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.182964:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.185834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.186836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.188558:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.188677:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.188702:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272086912 00000100:00100000:0.0:1746065117.188704:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272086912 00010000:00010000:0.0:1746065117.188718:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846000/0x392ae0376f87d020 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3032 expref: 6 pid: 9558 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.188733:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12693 00000100:00100000:0.0:1746065117.188738:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272086912:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065117.188888:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065117.188905:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f846000/0x392ae0376f87d020 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3032 expref: 6 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.188913:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f846000/0x392ae0376f87d020 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3032 expref: 6 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.188930:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f846000/0x392ae0376f87d020 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3032 expref: 6 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.188950:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065117.189152:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272086912:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 412us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.189158:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12693 00000100:00100000:0.0:1746065117.192584:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272087040 00000100:00100000:0.0:1746065117.192592:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272087040 00010000:00010000:0.0:1746065117.192618:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87d027 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3039 expref: 189 pid: 9558 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.192655:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12694 00000100:00100000:0.0:1746065117.192662:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+189:2004:x1830881272087040:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065117.192672:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065117.192686:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87d027 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3039 expref: 189 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.192696:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87d027 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3039 expref: 189 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.192715:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87d027 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3039 expref: 189 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.192728:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.192729:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.192735:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d02e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3040 expref: 188 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.192741:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d02e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3040 expref: 188 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.192766:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d02e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3040 expref: 188 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065117.192776:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d5a2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267265920:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065117.193204:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.202713:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.206868:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+190:2003:x1830881272087680:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3937us (4155us total) trans 4294970637 rc 0/0 00000100:00100000:0.0:1746065117.206879:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1837 00002000:00100000:0.0:1746065117.206887:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d5a3800 x1830881272087680/t4294970637(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.206895:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3800 with x1830881272087680 ext(0->7) 00010000:00010000:0.0:1746065117.206903:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d02e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3040 expref: 190 pid: 9558 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.206916:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d02e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3040 expref: 190 pid: 9558 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.206922:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a3800 00000100:00100000:0.0:1746065117.208411:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.211064:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.213860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.215992:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.234036:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.235746:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272088832 00000100:00100000:0.0:1746065117.235750:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272088832 00000100:00100000:0.0:1746065117.235785:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28723 00000100:00100000:0.0:1746065117.235791:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+190:1140:x1830881272088832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065117.235801:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065117.235814:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb69a00/0x392ae0376f87d043 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3055 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.235834:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f846000/0x392ae0376f87d035 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3047 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.235842:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87d03c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e304e expref: 191 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.235847:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.235849:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.235852:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb69a00/0x392ae0376f87d043 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3055 expref: 191 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.235874:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87d03c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e304e expref: 191 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.235883:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87d03c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e304e expref: 191 pid: 9558 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.235893:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d5a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267266304:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065117.235953:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f846000/0x392ae0376f87d035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3047 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.235961:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f846000/0x392ae0376f87d035 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3047 expref: 5 pid: 9558 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.235968:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d5a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267266432:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065117.235984:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0840 going to sleep for 11 seconds 00010000:00010000:0.0:1746065117.249352:0:9642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87d03c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e304e expref: 191 pid: 9558 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.249378:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d5a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267266304:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065117.249387:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d5a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267266432:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065117.249404:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb69a00/0x392ae0376f87d043 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3055 expref: 190 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.249413:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb69a00, rc 0) 00000100:00100000:0.0:1746065117.249433:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+190:1140:x1830881272088832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 13642us (13791us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.249439:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28723 00000100:00100000:0.0:1746065117.249884:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.249950:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.252018:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.256828:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.260973:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+193:2004:x1830881272089728:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 715us (4149us total) trans 4294970638 rc 0/0 00000100:00100000:0.0:1746065117.260980:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1839 00002000:00100000:0.0:1746065117.260987:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d5a3480 x1830881272089728/t4294970638(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.260995:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3480 with x1830881272089728 ext(0->7) 00010000:00010000:0.0:1746065117.261002:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb69a00/0x392ae0376f87d043 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3055 expref: 193 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.261014:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb69a00/0x392ae0376f87d043 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3055 expref: 193 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.261021:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a3480 00000100:00100000:0.0:1746065117.272855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.278633:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.280632:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.282284:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.284589:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.290328:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.290355:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.290380:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.294014:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.302737:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.307330:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+194:2002:x1830881272091520:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3205us (4592us total) trans 4294970639 rc 0/0 00000100:00100000:0.0:1746065117.307339:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1841 00002000:00100000:0.0:1746065117.307347:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88013017b100 x1830881272091520/t4294970639(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.307356:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b100 with x1830881272091520 ext(0->7) 00010000:00010000:0.0:1746065117.307364:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87d058 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e306a expref: 194 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.307379:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87d058 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e306a expref: 194 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.307385:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013017b100 00000100:00100000:0.0:1746065117.309336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.310401:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:0.0:1746065117.312575:0:9574:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8a00/0x392ae0376f87d05f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3071 expref: 5 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.312583:0:9574:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8a00/0x392ae0376f87d05f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3071 expref: 5 pid: 9642 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.312590:0:9574:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130178a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267267584:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065117.312635:0:9574:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.316317:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.320332:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.323544:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.336636:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.345612:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.350569:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+196:2004:x1830881272092672:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1967us (4952us total) trans 4294970640 rc 0/0 00000100:00100000:0.0:1746065117.350578:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1843 00002000:00100000:0.0:1746065117.350586:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d79ea00 x1830881272092672/t4294970640(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.350593:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ea00 with x1830881272092672 ext(0->7) 00010000:00010000:0.0:1746065117.350599:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f87d066 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3078 expref: 196 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.350610:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f87d066 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3078 expref: 196 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.350616:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d79ea00 00000100:00100000:0.0:1746065117.356371:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.356456:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.358562:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.364758:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.369761:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.375546:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.377436:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.378239:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+198:2004:x1830881272093824:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 646us (802us total) trans 4294970641 rc 0/0 00000100:00100000:0.0:1746065117.378245:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1845 00002000:00100000:0.0:1746065117.378249:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f7c2680 x1830881272093824/t4294970641(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.378256:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2680 with x1830881272093824 ext(0->7) 00010000:00010000:0.0:1746065117.378260:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87d074 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3086 expref: 198 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.378267:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f847c00/0x392ae0376f87d074 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3086 expref: 198 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.378272:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f7c2680 00000100:00100000:0.0:1746065117.381256:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.384601:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.387975:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.390036:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.394847:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.398880:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.399534:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.401928:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.401963:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.403296:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.409491:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.420400:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+201:2004:x1830881272096128:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1829us (2432us total) trans 4294970642 rc 0/0 00000100:00100000:0.0:1746065117.420408:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1847 00002000:00100000:0.0:1746065117.420416:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009faf9180 x1830881272096128/t4294970642(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.420424:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9180 with x1830881272096128 ext(0->7) 00010000:00010000:0.0:1746065117.420431:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d089 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e309b expref: 201 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.420444:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d089 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e309b expref: 201 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.420450:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009faf9180 00000100:00100000:0.0:1746065117.424430:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.430846:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.433908:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.433947:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.437656:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.441292:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.446469:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.451879:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+202:2003:x1830881272097408:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 4971us (5409us total) trans 4294970643 rc 0/0 00000100:00100000:0.0:1746065117.451890:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1849 00002000:00100000:0.0:1746065117.452007:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012dfff480 x1830881272097408/t4294970643(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.452018:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfff480 with x1830881272097408 ext(0->7) 00010000:00010000:0.0:1746065117.452027:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d097 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30b0 expref: 202 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.452041:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d097 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30b0 expref: 202 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.452048:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dfff480 00000100:00100000:0.0:1746065117.457776:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.467130:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.467155:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272097792 00000100:00100000:0.0:1746065117.467161:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272097792 00002000:00100000:0.0:1746065117.467195:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012dffc700 x1830881272097792/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.467204:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffc700 with x1830881272097792 ext(0->4095) 00002000:00010000:0.0:1746065117.467209:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dffc700 00000100:00100000:0.0:1746065117.467227:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12786 00000100:00100000:0.0:1746065117.467233:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272097792:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065117.467334:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272097792:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 101us (219us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065117.467340:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12786 00002000:00100000:0.0:1746065117.467346:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012dffc700 x1830881272097792/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.467358:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffc700 with x1830881272097792 ext(0->4095) 00002000:00010000:0.0:1746065117.467361:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dffc700 00000100:00100000:0.0:1746065117.468662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.475543:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.487226:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.490717:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.490806:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272098560 00000100:00100000:0.0:1746065117.490811:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272098560 00002000:00100000:0.0:1746065117.490842:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072a1f800 x1830881272098560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.490850:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f800 with x1830881272098560 ext(0->4095) 00010000:00010000:0.0:1746065117.490856:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d09e lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30a9 expref: 6 pid: 21550 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.490864:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d09e lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30a9 expref: 6 pid: 21550 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.490869:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a1f800 00000100:00100000:0.0:1746065117.497061:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.498485:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.498520:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.508071:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.512564:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.516039:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+205:2005:x1830881272099456:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3276us (3473us total) trans 4294970644 rc 0/0 00000100:00100000:0.0:1746065117.516048:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1852 00002000:00100000:0.0:1746065117.516056:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d1e2a00 x1830881272099456/t4294970644(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.516064:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2a00 with x1830881272099456 ext(0->7) 00010000:00010000:0.0:1746065117.516072:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87d0ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30be expref: 205 pid: 9560 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.516305:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f87d0ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30be expref: 205 pid: 9560 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.516312:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e2a00 00000100:00100000:0.0:1746065117.517711:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.528525:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.531913:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.534690:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.538019:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.558405:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.570006:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3766:1830881267270784:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.570033:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065117.570050:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d5a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3766:1830881267271296:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.570063:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065117.570072:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3766:1830881267271808:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.570095:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065117.570110:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746065117.570114:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c4d7531-7474-4559-997c-c1b3824c301a:3766:1830881267270656:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.570146:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065117.570171:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d5a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267271168:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.570189:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065117.570199:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267271680:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.570551:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.570575:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.570605:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f98000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267270400:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065117.570613:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267270528:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065117.570636:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d0c1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30d3 expref: 205 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.570649:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f02c000, rc 0) 00000100:00100000:0.0:1746065117.570677:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+205:1140:x1830881272100608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 12083us (12280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.570683:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28741 00000100:00100000:0.0:1746065117.571861:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272100736 00000100:00100000:0.0:1746065117.571864:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272100736 00010000:00010000:0.0:1746065117.571893:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846000/0x392ae0376f87d0b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30c5 expref: 205 pid: 9560 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.571913:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272100864 00000100:00100000:0.0:1746065117.571915:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272100864 00010000:00010000:0.0:1746065117.571924:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87d0ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30cc expref: 6 pid: 9642 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.571937:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12715 00000100:00100000:0.0:1746065117.571941:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272100864:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065117.571947:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065117.571958:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87d0ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30cc expref: 6 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.571965:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87d0ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30cc expref: 6 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.573370:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f847600/0x392ae0376f87d0ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30cc expref: 6 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.573386:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.573388:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.573393:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d0c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30d3 expref: 204 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.573400:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d0c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30d3 expref: 204 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065117.573413:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267272064 00000100:00100000:0.0:1746065117.573416:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267272064 00000100:00100000:0.0:1746065117.573494:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065117.573511:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267272192:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.573528:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065117.574078:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3766:1830881267270784:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.574253:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d5a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3766:1830881267271296:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.574263:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3766:1830881267271808:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.574280:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c4d7531-7474-4559-997c-c1b3824c301a:3766:1830881267270656:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.574288:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d5a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267271168:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.574476:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267271680:0@lo:400:kworker.0 00000100:00100000:0.0:1746065117.574484:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267272192:0@lo:400:kworker.0 00010000:00010000:0.0:1746065117.574515:0:9574:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d0c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30d3 expref: 203 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065117.574525:0:9574:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9574:1830881267272320:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065117.577445:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.596915:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.601157:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.603922:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.616642:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.617484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.617519:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272102400 00000100:00100000:0.0:1746065117.617523:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272102400 00002000:00100000:0.0:1746065117.617550:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f4e8e00 x1830881272102400/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.617558:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8e00 with x1830881272102400 ext(0->4095) 00002000:00010000:0.0:1746065117.617562:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4e8e00 00000100:00100000:0.0:1746065117.618014:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1855 00000100:00100000:0.0:1746065117.618020:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+208:2002:x1830881272102400:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065117.621017:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.621047:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.622603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.625789:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.631516:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+208:2003:x1830881272103296:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1265us (1923us total) trans 4294970646 rc 0/0 00000100:00100000:0.0:1746065117.631523:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1857 00002000:00100000:0.0:1746065117.631531:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880130179c00 x1830881272103296/t4294970646(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.631537:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130179c00 with x1830881272103296 ext(0->7) 00010000:00010000:0.0:1746065117.631543:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fecfe00/0x392ae0376f87d0d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30e8 expref: 208 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.631552:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fecfe00/0x392ae0376f87d0d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30e8 expref: 208 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.631557:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130179c00 00000100:00100000:0.0:1746065117.635741:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.639756:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.656301:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.660833:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.660865:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.664877:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.668532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.671673:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+211:2005:x1830881272104576:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1656us (3145us total) trans 4294970647 rc 0/0 00000100:00100000:0.0:1746065117.671682:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1859 00002000:00100000:0.0:1746065117.671690:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d549880 x1830881272104576/t4294970647(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.671698:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549880 with x1830881272104576 ext(0->7) 00010000:00010000:0.0:1746065117.671706:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727df200/0x392ae0376f87d0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30f6 expref: 211 pid: 9642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.671719:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727df200/0x392ae0376f87d0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e30f6 expref: 211 pid: 9642 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.671725:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d549880 00000100:00100000:0.0:1746065117.675621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.680167:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.682276:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.682349:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.685275:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.690301:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.693786:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.696102:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+212:2002:x1830881272105856:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2092us (2295us total) trans 4294970648 rc 0/0 00000100:00100000:0.0:1746065117.696113:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1861 00002000:00100000:0.0:1746065117.696129:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d4a2d80 x1830881272105856/t4294970648(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.696137:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2d80 with x1830881272105856 ext(0->7) 00010000:00010000:0.0:1746065117.696144:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0b15000/0x392ae0376f87d0f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e310b expref: 212 pid: 21550 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.696156:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0b15000/0x392ae0376f87d0f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e310b expref: 212 pid: 21550 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.696162:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d4a2d80 00000100:00100000:0.0:1746065117.710425:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.720019:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.722261:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272106368 00000100:00100000:0.0:1746065117.722265:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272106368 00002000:00100000:0.0:1746065117.722288:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fb67800 x1830881272106368/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.722296:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67800 with x1830881272106368 ext(0->4095) 00010000:00010000:0.0:1746065117.722302:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d0f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3104 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.722310:0:27164:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d0f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3104 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065117.722315:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb67800 00000100:00100000:0.0:1746065117.722536:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1862 00000100:00100000:0.0:1746065117.722542:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272106368:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065117.722626:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272106368:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 84us (829us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065117.722632:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1862 00002000:00100000:0.0:1746065117.722636:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fb67800 x1830881272106368/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.722642:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67800 with x1830881272106368 ext(0->4095) 00010000:00010000:0.0:1746065117.722647:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d0f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3104 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.722653:0:27164:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d0f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3104 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065117.722662:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb67800 00000100:00100000:0.0:1746065117.730385:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.730422:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272106496 00000100:00100000:0.0:1746065117.730428:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272106496 00000100:00100000:0.0:1746065117.730465:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28751 00000100:00100000:0.0:1746065117.730471:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+213:1141:x1830881272106496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065117.730485:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065117.730499:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d107 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3119 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.730524:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.730528:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d100 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3112 expref: 214 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.730535:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065117.730538:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d107 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3119 expref: 214 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.730565:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d100 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3112 expref: 214 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.730575:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f02c000/0x392ae0376f87d107 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3119 expref: 214 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.730583:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f02c000, rc 0) 00000100:00100000:0.0:1746065117.730614:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+214:1141:x1830881272106496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 143us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.730623:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28751 00000100:00100000:0.0:1746065117.732310:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.732341:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272106624 00000100:00100000:0.0:1746065117.732345:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272106624 00010000:00010000:0.0:1746065117.732362:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d0f2 lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3104 expref: 6 pid: 9560 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.732385:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12724 00000100:00100000:0.0:1746065117.732391:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272106624:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065117.732399:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065117.732414:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d0f2 lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3104 expref: 6 pid: 9560 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.732423:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d0f2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3104 expref: 6 pid: 9560 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.732439:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.732441:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.732446:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3112 expref: 213 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.732453:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3112 expref: 213 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.732472:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3112 expref: 213 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.732485:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d100 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3112 expref: 213 pid: 21550 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.732494:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267274752:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065117.735389:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.736775:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.738775:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+215:2005:x1830881272107136:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1853us (1994us total) trans 4294970649 rc 0/0 00000100:00100000:0.0:1746065117.738784:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1864 00002000:00100000:0.0:1746065117.738792:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d4a1180 x1830881272107136/t4294970649(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.738801:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1180 with x1830881272107136 ext(0->7) 00010000:00010000:0.0:1746065117.738808:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3112 expref: 215 pid: 21550 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.738821:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f87d100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3112 expref: 215 pid: 21550 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.738827:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d4a1180 00000100:00100000:0.0:1746065117.740300:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.745034:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.748761:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.748804:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.751160:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.752482:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.754029:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.756623:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+216:2002:x1830881272108416:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2297us (2590us total) trans 4294970650 rc 0/0 00000100:00100000:0.0:1746065117.756630:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1866 00002000:00100000:0.0:1746065117.756637:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d4a3480 x1830881272108416/t4294970650(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.756643:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a3480 with x1830881272108416 ext(0->7) 00010000:00010000:0.0:1746065117.756648:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3120 expref: 216 pid: 21550 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.756658:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3120 expref: 216 pid: 21550 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.756662:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d4a3480 00000100:00100000:0.0:1746065117.758296:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.762773:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.767004:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.767941:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.773494:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.776396:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.777259:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.779829:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.785268:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.787657:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+218:2003:x1830881272110208:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 713us (2393us total) trans 4294970651 rc 0/0 00000100:00100000:0.0:1746065117.787664:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1869 00002000:00100000:0.0:1746065117.787671:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800979a4700 x1830881272110208/t4294970651(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.787677:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4700 with x1830881272110208 ext(0->7) 00010000:00010000:0.0:1746065117.787681:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a1234800/0x392ae0376f87d123 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3135 expref: 218 pid: 9560 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.787690:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a1234800/0x392ae0376f87d123 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3135 expref: 218 pid: 9560 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.787700:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979a4700 00000100:00100000:0.0:1746065117.798814:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.799157:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.802190:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.803389:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.806693:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.807346:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065117.807359:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267276672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065117.807395:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065117.808157:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267276672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065117.817556:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+221:2004:x1830881272111488:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 962us (1147us total) trans 4294970652 rc 0/0 00000100:00100000:0.0:1746065117.817563:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1872 00002000:00100000:0.0:1746065117.817569:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880130178a80 x1830881272111488/t4294970652(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.817575:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130178a80 with x1830881272111488 ext(0->7) 00010000:00010000:0.0:1746065117.817580:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a1234800/0x392ae0376f87d131 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3143 expref: 221 pid: 9560 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.817589:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a1234800/0x392ae0376f87d131 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3143 expref: 221 pid: 9560 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.817594:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130178a80 00000100:00100000:0.0:1746065117.818934:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.828537:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.837314:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.838207:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.849415:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.854824:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.878060:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.881357:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.883270:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+222:2003:x1830881272113152:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 847us (1912us total) trans 4294970653 rc 0/0 00000100:00100000:0.0:1746065117.883277:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1874 00002000:00100000:0.0:1746065117.883282:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a091fb80 x1830881272113152/t4294970653(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.883289:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091fb80 with x1830881272113152 ext(0->7) 00010000:00010000:0.0:1746065117.883293:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072539400/0x392ae0376f87d146 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3158 expref: 222 pid: 9560 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065117.883301:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072539400/0x392ae0376f87d146 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3158 expref: 222 pid: 9560 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065117.883306:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091fb80 00000100:00100000:0.0:1746065117.884450:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.893420:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.894613:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.894634:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272113664 00000100:00100000:0.0:1746065117.894637:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272113664 00002000:00100000:0.0:1746065117.894665:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800a091df80 x1830881272113664/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.894674:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091df80 with x1830881272113664 ext(0->4095) 00002000:00010000:0.0:1746065117.894679:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a091df80 00000100:00100000:0.0:1746065117.895737:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12799 00000100:00100000:0.0:1746065117.895743:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272113664:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065117.895845:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272113664:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 102us (1232us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065117.895851:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12799 00002000:00100000:0.0:1746065117.895856:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800a091df80 x1830881272113664/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.895863:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091df80 with x1830881272113664 ext(0->4095) 00010000:00010000:0.0:1746065117.895868:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a1234800/0x392ae0376f87d14d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e315f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.895876:0:27164:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff8800a1234800/0x392ae0376f87d14d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e315f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065117.895881:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091df80 00000100:00100000:0.0:1746065117.902031:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.904852:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.910386:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.925035:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.926161:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+225:2005:x1830881272114432:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 788us (1132us total) trans 4294970654 rc 0/0 00000100:00100000:0.0:1746065117.926168:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1876 00002000:00100000:0.0:1746065117.926173:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a091dc00 x1830881272114432/t4294970654(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.926180:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091dc00 with x1830881272114432 ext(0->7) 00010000:00010000:0.0:1746065117.926185:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072539a00/0x392ae0376f87d154 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3166 expref: 225 pid: 9560 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065117.926194:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072539a00/0x392ae0376f87d154 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3166 expref: 225 pid: 9560 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065117.926200:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091dc00 00000100:00100000:0.0:1746065117.927609:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.929340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.931249:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.933893:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.953178:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.954665:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.954705:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.957318:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.957440:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.957604:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.958101:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12739 00000100:00100000:0.0:1746065117.958107:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272116096:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065117.958114:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065117.958130:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87d162 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3174 expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065117.958138:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87d162 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3174 expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065117.958149:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87d162 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3174 expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065117.958159:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.958161:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.958165:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e317b expref: 226 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.958170:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d169 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e317b expref: 226 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.958185:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d169 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e317b expref: 226 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.958192:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d169 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e317b expref: 226 pid: 9560 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065117.958201:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267278464:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065117.958758:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.962951:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.964677:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.965648:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+227:2005:x1830881272116736:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 858us (972us total) trans 4294970655 rc 0/0 00000100:00100000:0.0:1746065117.965655:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1879 00002000:00100000:0.0:1746065117.965661:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729d5180 x1830881272116736/t4294970655(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.965669:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d5180 with x1830881272116736 ext(0->7) 00010000:00010000:0.0:1746065117.965674:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d169 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e317b expref: 227 pid: 9560 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065117.965684:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800728f9600/0x392ae0376f87d169 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e317b expref: 227 pid: 9560 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065117.965690:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729d5180 00000100:00100000:0.0:1746065117.966733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.970735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.973168:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.974999:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.975043:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.977720:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.980162:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.982427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.984951:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.989588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.994713:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+228:2005:x1830881272118400:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 4395us (5122us total) trans 4294970656 rc 0/0 00000100:00100000:0.0:1746065117.994723:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1881 00002000:00100000:0.0:1746065117.994734:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f93aa00 x1830881272118400/t4294970656(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:33/0 lens 496/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.994743:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93aa00 with x1830881272118400 ext(0->7) 00010000:00010000:0.0:1746065117.994751:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87d17e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3190 expref: 228 pid: 9560 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065117.994765:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524800/0x392ae0376f87d17e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3190 expref: 228 pid: 9560 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065117.994771:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f93aa00 00000100:00100000:0.0:1746065117.996004:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065117.998208:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.001070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.003338:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.008834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.011846:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.012485:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+230:2005:x1830881272119552:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 507us (639us total) trans 4294970657 rc 0/0 00000100:00100000:0.0:1746065118.012490:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1883 00002000:00100000:0.0:1746065118.012494:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fbbdc00 x1830881272119552/t4294970657(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.012499:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdc00 with x1830881272119552 ext(0->7) 00010000:00010000:0.0:1746065118.012503:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d18c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e319e expref: 230 pid: 9560 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.012509:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d18c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e319e expref: 230 pid: 9560 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.012513:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbdc00 00000100:00100000:0.0:1746065118.014793:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.017345:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.017462:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.019406:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.020275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.025135:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.026218:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+233:2005:x1830881272120832:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 911us (1094us total) trans 4294970658 rc 0/0 00000100:00100000:0.0:1746065118.026225:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1885 00002000:00100000:0.0:1746065118.026232:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fbbc380 x1830881272120832/t4294970658(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.026239:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc380 with x1830881272120832 ext(0->7) 00010000:00010000:0.0:1746065118.026245:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff19400/0x392ae0376f87d19a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31ac expref: 233 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.026258:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff19400/0x392ae0376f87d19a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31ac expref: 233 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.026264:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbc380 00000100:00100000:0.0:1746065118.027506:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.029582:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.043406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.044709:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.047750:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.049898:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.053449:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.056027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.059715:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+234:2004:x1830881272122496:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3347us (3677us total) trans 4294970659 rc 0/0 00000100:00100000:0.0:1746065118.059726:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1887 00002000:00100000:0.0:1746065118.059736:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306f3b80 x1830881272122496/t4294970659(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.059745:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3b80 with x1830881272122496 ext(0->7) 00010000:00010000:0.0:1746065118.059753:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d1af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31c1 expref: 234 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.059768:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d1af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31c1 expref: 234 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.059775:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306f3b80 00000100:00100000:0.0:1746065118.063468:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.065872:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272122752 00000100:00100000:0.0:1746065118.065878:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272122752 00000100:00100000:0.0:1746065118.065916:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28777 00000100:00100000:0.0:1746065118.065921:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+234:1140:x1830881272122752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065118.065934:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.065948:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072edfc00/0x392ae0376f87d1bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e31cf expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.066181:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87d1b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31c8 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.066192:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.066194:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.066197:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072edfc00/0x392ae0376f87d1bd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31cf expref: 235 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.066218:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87d1b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31c8 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.066228:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87d1b6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31c8 expref: 5 pid: 21550 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.066237:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267281024:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065118.066286:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.068185:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.070162:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.075273:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272123392 00000100:00100000:0.0:1746065118.075279:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272123392 00002000:00100000:0.0:1746065118.075308:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800a091ea00 x1830881272123392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.075316:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ea00 with x1830881272123392 ext(0->4095) 00002000:00010000:0.0:1746065118.075320:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a091ea00 00000100:00100000:0.0:1746065118.075332:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12809 00000100:00100000:0.0:1746065118.075336:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+234:2002:x1830881272123392:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.075423:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+234:2002:x1830881272123392:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 86us (194us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.075431:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12809 00002000:00100000:0.0:1746065118.075435:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800a091ea00 x1830881272123392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.075441:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ea00 with x1830881272123392 ext(0->4095) 00002000:00010000:0.0:1746065118.075444:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a091ea00 00000100:00100000:0.0:1746065118.079662:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.084249:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.085491:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+236:2005:x1830881272123648:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1059us (1247us total) trans 4294970660 rc 0/0 00000100:00100000:0.0:1746065118.085497:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1889 00002000:00100000:0.0:1746065118.085502:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f18ce00 x1830881272123648/t4294970660(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.085508:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18ce00 with x1830881272123648 ext(0->7) 00010000:00010000:0.0:1746065118.085514:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072edfc00/0x392ae0376f87d1bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31cf expref: 236 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.085523:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072edfc00/0x392ae0376f87d1bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31cf expref: 236 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.085528:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f18ce00 00000100:00100000:0.0:1746065118.089751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.090592:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.090663:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272123904 00000100:00100000:0.0:1746065118.090666:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272123904 00000100:00100000:0.0:1746065118.090697:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28779 00000100:00100000:0.0:1746065118.090702:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+237:1140:x1830881272123904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065118.090713:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.090723:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c77ce00/0x392ae0376f87d1cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e31dd expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.090736:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.090740:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d1c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31d6 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.090745:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065118.090749:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c77ce00/0x392ae0376f87d1cb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31dd expref: 237 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.090838:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d1c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31d6 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.090847:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d1c4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31d6 expref: 5 pid: 21550 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.090857:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267281536:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065118.090921:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.092707:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.092749:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272124160 00000100:00100000:0.0:1746065118.092752:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272124160 00002000:00100000:0.0:1746065118.092777:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012f18df80 x1830881272124160/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.092785:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18df80 with x1830881272124160 ext(0->4095) 00010000:00010000:0.0:1746065118.092790:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d1c4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31d6 expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.092836:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d1c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31d6 expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.092842:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f18df80 00000100:00100000:0.0:1746065118.092864:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1890 00000100:00100000:0.0:1746065118.092886:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272124160:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.093563:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272124160:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 676us (854us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.093569:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1890 00002000:00100000:0.0:1746065118.093574:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012f18df80 x1830881272124160/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.093580:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18df80 with x1830881272124160 ext(0->4095) 00010000:00010000:0.0:1746065118.093659:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d1c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31d6 expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.093667:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f846e00/0x392ae0376f87d1c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31d6 expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.093673:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f18df80 00000100:00100000:0.0:1746065118.095321:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.097301:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.102355:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.104857:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.106143:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+238:2004:x1830881272124800:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 856us (1284us total) trans 4294970661 rc 0/0 00000100:00100000:0.0:1746065118.106150:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1891 00002000:00100000:0.0:1746065118.106155:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009c322680 x1830881272124800/t4294970661(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.106162:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322680 with x1830881272124800 ext(0->7) 00010000:00010000:0.0:1746065118.106167:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c77ce00/0x392ae0376f87d1cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31dd expref: 238 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.106177:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c77ce00/0x392ae0376f87d1cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31dd expref: 238 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.106182:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c322680 00000100:00100000:0.0:1746065118.107673:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.112623:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272125056 00000100:00100000:0.0:1746065118.112627:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272125056 00000100:00100000:0.0:1746065118.112653:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28781 00000100:00100000:0.0:1746065118.112658:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+237:1140:x1830881272125056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065118.112665:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.112678:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c77de00/0x392ae0376f87d1d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e31eb expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.112697:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091065a00/0x392ae0376f87d1d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31e4 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.112703:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.112705:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.112709:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c77de00/0x392ae0376f87d1d9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31eb expref: 238 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.112730:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091065a00/0x392ae0376f87d1d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31e4 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.112740:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091065a00/0x392ae0376f87d1d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31e4 expref: 5 pid: 21550 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.112750:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c321180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267282048:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065118.112798:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.115682:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.115759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.117947:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.121910:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272126080 00000100:00100000:0.0:1746065118.121918:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272126080 00002000:00100000:0.0:1746065118.121956:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012fbfaa00 x1830881272126080/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.121965:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfaa00 with x1830881272126080 ext(0->7) 00010000:00010000:0.0:1746065118.121973:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c77de00/0x392ae0376f87d1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31eb expref: 239 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.121989:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c77de00/0x392ae0376f87d1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31eb expref: 239 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.121995:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fbfaa00 00000100:00100000:0.0:1746065118.122023:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1893 00000100:00100000:0.0:1746065118.122029:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+239:2002:x1830881272126080:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.123658:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+241:2002:x1830881272126080:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1625us (1944us total) trans 4294970662 rc 0/0 00000100:00100000:0.0:1746065118.123666:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1893 00002000:00100000:0.0:1746065118.123673:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012fbfaa00 x1830881272126080/t4294970662(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.123681:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfaa00 with x1830881272126080 ext(0->7) 00010000:00010000:0.0:1746065118.123688:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c77de00/0x392ae0376f87d1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31eb expref: 241 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.123699:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c77de00/0x392ae0376f87d1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31eb expref: 241 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.123704:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fbfaa00 00000100:00100000:0.0:1746065118.131890:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.133242:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.139873:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.139906:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272126592 00000100:00100000:0.0:1746065118.139911:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272126592 00002000:00100000:0.0:1746065118.139942:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c322300 x1830881272126592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.139950:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322300 with x1830881272126592 ext(0->4095) 00010000:00010000:0.0:1746065118.139956:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d1e0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31f2 expref: 243 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.139967:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d1e0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31f2 expref: 243 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.139977:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c322300 00000100:00100000:0.0:1746065118.139994:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1894 00000100:00100000:0.0:1746065118.140000:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+243:2005:x1830881272126592:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.142194:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+243:2005:x1830881272126592:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 2192us (2319us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.142204:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1894 00002000:00100000:0.0:1746065118.142213:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009c322300 x1830881272126592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.142222:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322300 with x1830881272126592 ext(0->4095) 00010000:00010000:0.0:1746065118.142230:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d1e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31f2 expref: 243 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.142241:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d1e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31f2 expref: 243 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.142247:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c322300 00000100:00100000:0.0:1746065118.145060:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.148010:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.148039:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fafa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267282688:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065118.148048:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065118.148064:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+240:2002:x1830881272126720:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2111us (3011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.148070:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12757 00000100:00100000:0.0:1746065118.148107:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272127104 00000100:00100000:0.0:1746065118.148109:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272127104 00002000:00100000:0.0:1746065118.148137:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f981880 x1830881272127104/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.148146:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981880 with x1830881272127104 ext(0->4095) 00010000:00010000:0.0:1746065118.148151:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072edf200/0x392ae0376f87d1e7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31f9 expref: 240 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.148159:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072edf200/0x392ae0376f87d1e7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31f9 expref: 240 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.148164:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f981880 00000100:00100000:0.0:1746065118.148175:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1895 00000100:00100000:0.0:1746065118.148180:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+240:2002:x1830881272127104:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.148251:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+240:2002:x1830881272127104:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 71us (242us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.148255:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1895 00002000:00100000:0.0:1746065118.148259:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f981880 x1830881272127104/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.148265:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981880 with x1830881272127104 ext(0->4095) 00010000:00010000:0.0:1746065118.148269:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072edf200/0x392ae0376f87d1e7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31f9 expref: 240 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.148276:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072edf200/0x392ae0376f87d1e7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31f9 expref: 240 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.148285:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f981880 00000100:00100000:0.0:1746065118.151756:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.153580:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+242:2004:x1830881272127232:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 719us (1822us total) trans 4294970663 rc 0/0 00000100:00100000:0.0:1746065118.153586:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1896 00002000:00100000:0.0:1746065118.153592:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f981c00 x1830881272127232/t4294970663(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.153598:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981c00 with x1830881272127232 ext(0->7) 00010000:00010000:0.0:1746065118.153602:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072edf200/0x392ae0376f87d1e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31f9 expref: 242 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.153610:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072edf200/0x392ae0376f87d1e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e31f9 expref: 242 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.153615:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f981c00 00000100:00100000:0.0:1746065118.157215:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.160976:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272127616 00000100:00100000:0.0:1746065118.160981:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272127616 00002000:00100000:0.0:1746065118.161009:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d5a2a00 x1830881272127616/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.161017:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2a00 with x1830881272127616 ext(0->4095) 00002000:00010000:0.0:1746065118.161021:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d5a2a00 00000100:00100000:0.0:1746065118.161042:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12812 00000100:00100000:0.0:1746065118.161047:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272127616:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.161164:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272127616:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 116us (396us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.161169:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12812 00002000:00100000:0.0:1746065118.161173:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d5a2a00 x1830881272127616/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.161179:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2a00 with x1830881272127616 ext(0->4095) 00002000:00010000:0.0:1746065118.161182:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d5a2a00 00000100:00100000:0.0:1746065118.164829:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.167174:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.173023:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.173149:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.175436:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.176913:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.179371:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.181938:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.186984:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.189730:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+245:2003:x1830881272129280:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1728us (2740us total) trans 4294970664 rc 0/0 00000100:00100000:0.0:1746065118.189740:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1899 00002000:00100000:0.0:1746065118.189748:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f084380 x1830881272129280/t4294970664(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.189756:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084380 with x1830881272129280 ext(0->7) 00010000:00010000:0.0:1746065118.189765:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d1fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e320e expref: 245 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.189786:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d1fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e320e expref: 245 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.189792:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f084380 00000100:00100000:0.0:1746065118.197774:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.199921:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.211478:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.211513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.213210:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.215712:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.218345:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.225433:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.232949:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.234153:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+246:2005:x1830881272130944:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 706us (1201us total) trans 4294970665 rc 0/0 00000100:00100000:0.0:1746065118.234160:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1901 00002000:00100000:0.0:1746065118.234165:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fff7800 x1830881272130944/t4294970665(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.234172:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7800 with x1830881272130944 ext(0->7) 00010000:00010000:0.0:1746065118.234178:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064a00/0x392ae0376f87d211 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3223 expref: 246 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.234191:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064a00/0x392ae0376f87d211 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3223 expref: 246 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.234201:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff7800 00000100:00100000:0.0:1746065118.239762:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.248867:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.251964:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.256524:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.257300:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.257878:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272131712 00000100:00100000:0.0:1746065118.257882:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272131712 00010000:00010000:0.0:1746065118.257899:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87d218 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e322a expref: 6 pid: 9642 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.257916:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12765 00000100:00100000:0.0:1746065118.257920:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272131712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065118.257927:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065118.257942:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87d218 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e322a expref: 6 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.257951:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87d218 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e322a expref: 6 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.257965:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87d218 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e322a expref: 6 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.258492:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.258494:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.258500:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d21f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3231 expref: 246 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.258508:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d21f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3231 expref: 246 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.258528:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d21f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3231 expref: 246 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.258538:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d21f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3231 expref: 246 pid: 9642 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.258549:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267284608:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065118.258598:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.261401:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267284608:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065118.261418:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065118.261449:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272131712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3528us (4149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.261458:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12765 00000100:00100000:0.0:1746065118.262534:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.272595:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+249:2002:x1830881272132224:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1144us (1295us total) trans 4294970666 rc 0/0 00000100:00100000:0.0:1746065118.272601:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1904 00002000:00100000:0.0:1746065118.272607:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009faf8700 x1830881272132224/t4294970666(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.272613:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf8700 with x1830881272132224 ext(0->7) 00010000:00010000:0.0:1746065118.272619:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d21f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3231 expref: 249 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.272629:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524a00/0x392ae0376f87d21f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3231 expref: 249 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.272634:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009faf8700 00000100:00100000:0.0:1746065118.274108:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.276526:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.281505:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.283643:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.287384:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.287415:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272133120 00000100:00100000:0.0:1746065118.287421:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272133120 00002000:00100000:0.0:1746065118.287452:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fff5f80 x1830881272133120/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.287460:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5f80 with x1830881272133120 ext(0->4095) 00010000:00010000:0.0:1746065118.287466:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8a00/0x392ae0376f87d22d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e323f expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.287475:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8a00/0x392ae0376f87d22d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e323f expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.287481:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff5f80 00000100:00100000:0.0:1746065118.287751:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1905 00000100:00100000:0.0:1746065118.287759:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272133120:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.287877:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272133120:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 118us (493us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.287885:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1905 00002000:00100000:0.0:1746065118.287890:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fff5f80 x1830881272133120/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.287896:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5f80 with x1830881272133120 ext(0->4095) 00010000:00010000:0.0:1746065118.287900:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8a00/0x392ae0376f87d22d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e323f expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.287907:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8a00/0x392ae0376f87d22d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e323f expref: 6 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.287912:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff5f80 00000100:00100000:0.0:1746065118.287944:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.290960:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.293113:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.295188:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.301711:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.304373:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+250:2005:x1830881272133888:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2465us (2664us total) trans 4294970667 rc 0/0 00000100:00100000:0.0:1746065118.304382:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1906 00002000:00100000:0.0:1746065118.304389:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fff6d80 x1830881272133888/t4294970667(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.304396:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6d80 with x1830881272133888 ext(0->7) 00010000:00010000:0.0:1746065118.304423:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065a00/0x392ae0376f87d234 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3246 expref: 250 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.304441:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065a00/0x392ae0376f87d234 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3246 expref: 250 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.304447:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff6d80 00000100:00100000:0.0:1746065118.306493:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.309676:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.309747:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.312417:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.312448:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.315507:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272134912 00000100:00100000:0.0:1746065118.315512:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272134912 00002000:00100000:0.0:1746065118.315541:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d5a1880 x1830881272134912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.315549:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1880 with x1830881272134912 ext(0->4095) 00010000:00010000:0.0:1746065118.315556:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d242 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3254 expref: 252 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.315567:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d242 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3254 expref: 252 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.315572:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a1880 00000100:00100000:0.0:1746065118.315599:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1908 00000100:00100000:0.0:1746065118.315605:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+252:2005:x1830881272134912:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.315922:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+252:2005:x1830881272134912:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 316us (614us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.315930:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1908 00002000:00100000:0.0:1746065118.315934:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d5a1880 x1830881272134912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.315940:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1880 with x1830881272134912 ext(0->4095) 00010000:00010000:0.0:1746065118.315944:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d242 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3254 expref: 252 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.315952:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d242 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3254 expref: 252 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.315957:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a1880 00000100:00100000:0.0:1746065118.317240:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.317277:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272135168 00000100:00100000:0.0:1746065118.317281:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272135168 00002000:00100000:0.0:1746065118.317300:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d6cad80 x1830881272135168/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.317307:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cad80 with x1830881272135168 ext(0->7) 00010000:00010000:0.0:1746065118.317311:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d242 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3254 expref: 252 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.317319:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d242 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3254 expref: 252 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.317325:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d6cad80 00000100:00100000:0.0:1746065118.317348:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1909 00000100:00100000:0.0:1746065118.317353:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+252:2005:x1830881272135168:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.318835:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+253:2005:x1830881272135168:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1476us (1590us total) trans 4294970668 rc 0/0 00000100:00100000:0.0:1746065118.318843:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1909 00002000:00100000:0.0:1746065118.318849:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d6cad80 x1830881272135168/t4294970668(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.318856:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cad80 with x1830881272135168 ext(0->7) 00010000:00010000:0.0:1746065118.318862:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d242 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3254 expref: 253 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.318872:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d242 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3254 expref: 253 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.318877:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d6cad80 00000100:00100000:0.0:1746065118.323224:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.332549:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.337848:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.341496:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.343963:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.344947:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.347819:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.351827:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.356826:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.364151:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+254:2004:x1830881272136832:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 580us (1872us total) trans 4294970669 rc 0/0 00000100:00100000:0.0:1746065118.364157:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1911 00002000:00100000:0.0:1746065118.364163:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d5a0700 x1830881272136832/t4294970669(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.364171:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0700 with x1830881272136832 ext(0->7) 00010000:00010000:0.0:1746065118.364177:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d257 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3269 expref: 254 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.364187:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d257 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3269 expref: 254 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.364193:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a0700 00000100:00100000:0.0:1746065118.365760:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.377469:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.380361:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.385532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.385729:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.389680:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272137856 00000100:00100000:0.0:1746065118.389685:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272137856 00002000:00100000:0.0:1746065118.389714:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009ea75180 x1830881272137856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.389723:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75180 with x1830881272137856 ext(0->4095) 00010000:00010000:0.0:1746065118.389728:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87d265 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3277 expref: 255 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.389739:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87d265 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3277 expref: 255 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.389744:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea75180 00000100:00100000:0.0:1746065118.389768:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1912 00000100:00100000:0.0:1746065118.389774:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+255:2004:x1830881272137856:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.389872:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+255:2004:x1830881272137856:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 97us (241us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.389877:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1912 00002000:00100000:0.0:1746065118.389882:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009ea75180 x1830881272137856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.389889:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75180 with x1830881272137856 ext(0->4095) 00010000:00010000:0.0:1746065118.389893:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87d265 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3277 expref: 255 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.389901:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87d265 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3277 expref: 255 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.389906:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea75180 00000100:00100000:0.0:1746065118.392999:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.400985:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+257:2005:x1830881272138112:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 7798us (7984us total) trans 4294970670 rc 0/0 00000100:00100000:0.0:1746065118.400995:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1913 00002000:00100000:0.0:1746065118.401004:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d6c9880 x1830881272138112/t4294970670(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.401012:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9880 with x1830881272138112 ext(0->7) 00010000:00010000:0.0:1746065118.401020:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87d265 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3277 expref: 257 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.401033:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524000/0x392ae0376f87d265 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3277 expref: 257 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.401039:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d6c9880 00000100:00100000:0.0:1746065118.404640:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.410275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.414854:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.416606:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.419439:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.419473:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.424024:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.426580:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.433540:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.441486:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.445555:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+258:2004:x1830881272139776:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1225us (4066us total) trans 4294970671 rc 0/0 00000100:00100000:0.0:1746065118.445562:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1915 00002000:00100000:0.0:1746065118.445567:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a0938a80 x1830881272139776/t4294970671(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.445574:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0938a80 with x1830881272139776 ext(0->7) 00010000:00010000:0.0:1746065118.445580:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064400/0x392ae0376f87d27a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e328c expref: 258 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.445591:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064400/0x392ae0376f87d27a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e328c expref: 258 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.445597:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0938a80 00000100:00100000:0.0:1746065118.449887:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.453048:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.455169:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.455210:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.457836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.459867:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.462965:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+261:2002:x1830881272141056:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 701us (1122us total) trans 4294970672 rc 0/0 00000100:00100000:0.0:1746065118.462971:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1917 00002000:00100000:0.0:1746065118.462976:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d5a1f80 x1830881272141056/t4294970672(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.462982:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1f80 with x1830881272141056 ext(0->7) 00010000:00010000:0.0:1746065118.462987:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064a00/0x392ae0376f87d288 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e329a expref: 261 pid: 9560 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.462995:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064a00/0x392ae0376f87d288 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e329a expref: 261 pid: 9560 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.463000:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d5a1f80 00000100:00100000:0.0:1746065118.466809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.474284:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.478697:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.478909:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.482649:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.486823:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.489019:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.494495:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.497517:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.498673:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+262:2004:x1830881272142720:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 962us (1155us total) trans 4294970673 rc 0/0 00000100:00100000:0.0:1746065118.498680:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1919 00002000:00100000:0.0:1746065118.498686:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072978a80 x1830881272142720/t4294970673(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.498693:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978a80 with x1830881272142720 ext(0->7) 00010000:00010000:0.0:1746065118.498698:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065400/0x392ae0376f87d29d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32af expref: 262 pid: 9560 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.498707:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065400/0x392ae0376f87d29d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32af expref: 262 pid: 9560 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.498712:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072978a80 00000100:00100000:0.0:1746065118.499940:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.506748:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.510652:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.513324:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.514892:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.516423:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.517185:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+264:2005:x1830881272143872:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 588us (761us total) trans 4294970674 rc 0/0 00000100:00100000:0.0:1746065118.517191:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1921 00002000:00100000:0.0:1746065118.517196:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009549f480 x1830881272143872/t4294970674(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.517202:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549f480 with x1830881272143872 ext(0->7) 00010000:00010000:0.0:1746065118.517206:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d2ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32bd expref: 264 pid: 9560 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.517215:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d2ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32bd expref: 264 pid: 9560 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.517220:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009549f480 00000100:00100000:0.0:1746065118.519708:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.523212:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.530213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.531488:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272144512 00000100:00100000:0.0:1746065118.531492:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272144512 00000100:00100000:0.0:1746065118.531539:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28814 00000100:00100000:0.0:1746065118.531560:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+265:1141:x1830881272144512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065118.531581:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.531589:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7e7c00/0x392ae0376f87d2c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e32d2 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.531622:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.531626:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d2b9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32cb expref: 266 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.531631:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065118.531634:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7e7c00/0x392ae0376f87d2c0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32d2 expref: 266 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.531667:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d2b9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32cb expref: 266 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.531689:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7e7c00/0x392ae0376f87d2c0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32d2 expref: 266 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.531712:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7e7c00, rc 0) 00000100:00100000:0.0:1746065118.531783:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+266:1141:x1830881272144512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 223us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.531788:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28814 00000100:00100000:0.0:1746065118.533779:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.538010:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.544794:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.545698:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+267:2002:x1830881272145152:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 663us (911us total) trans 4294970675 rc 0/0 00000100:00100000:0.0:1746065118.545705:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1923 00002000:00100000:0.0:1746065118.545710:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306a0000 x1830881272145152/t4294970675(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.545716:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0000 with x1830881272145152 ext(0->7) 00010000:00010000:0.0:1746065118.545721:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d2b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32cb expref: 267 pid: 9560 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.545729:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d2b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32cb expref: 267 pid: 9560 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.545734:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306a0000 00000100:00100000:0.0:1746065118.549248:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.557189:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.563554:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.564094:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.565381:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.568676:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.569631:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.569660:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.572420:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.576180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.577317:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+269:2003:x1830881272146944:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 915us (1142us total) trans 4294970676 rc 0/0 00000100:00100000:0.0:1746065118.577324:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1926 00002000:00100000:0.0:1746065118.577329:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d651f80 x1830881272146944/t4294970676(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.577336:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651f80 with x1830881272146944 ext(0->7) 00010000:00010000:0.0:1746065118.577340:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9600/0x392ae0376f87d2ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32d9 expref: 269 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.577349:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9600/0x392ae0376f87d2ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32d9 expref: 269 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.577355:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d651f80 00000100:00100000:0.0:1746065118.582041:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.586990:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.589330:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.589399:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.589530:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28818 00000100:00100000:0.0:1746065118.589536:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881272147456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065118.589547:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.589559:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7e6600/0x392ae0376f87d2dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e32ee expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.589577:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.589578:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.589584:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7e6600/0x392ae0376f87d2dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32ee expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.589791:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7e6600/0x392ae0376f87d2dc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32ee expref: 6 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.589799:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7e6600/0x392ae0376f87d2dc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32ee expref: 6 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.589807:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7e6600, rc 0) 00000100:00100000:0.0:1746065118.589840:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1141:x1830881272147456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 305us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.589845:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28818 00000100:00100000:0.0:1746065118.592018:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.594725:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.598253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.599769:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.600193:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f80d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.601297:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.603664:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+270:2005:x1830881272148608:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1321us (2365us total) trans 4294970677 rc 0/0 00000100:00100000:0.0:1746065118.603672:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1928 00002000:00100000:0.0:1746065118.603679:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009dc39880 x1830881272148608/t4294970677(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.603693:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39880 with x1830881272148608 ext(0->7) 00010000:00010000:0.0:1746065118.603699:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8a00/0x392ae0376f87d2e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32f5 expref: 270 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.603709:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8a00/0x392ae0376f87d2e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e32f5 expref: 270 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.603714:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009dc39880 00000100:00100000:0.0:1746065118.605701:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.609713:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.611393:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.620551:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.624020:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.624124:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.627776:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.628943:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.628971:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.637629:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+273:2003:x1830881272150656:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1737us (1922us total) trans 4294970678 rc 0/0 00000100:00100000:0.0:1746065118.637638:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1931 00002000:00100000:0.0:1746065118.637645:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009ea76680 x1830881272150656/t4294970678(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.637652:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76680 with x1830881272150656 ext(0->7) 00010000:00010000:0.0:1746065118.637658:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065c00/0x392ae0376f87d2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e330a expref: 273 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.637673:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065c00/0x392ae0376f87d2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e330a expref: 273 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.637678:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea76680 00000100:00100000:0.0:1746065118.639794:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.642488:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.644677:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.646947:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.650173:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.650922:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272151808 00000100:00100000:0.0:1746065118.650925:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272151808 00010000:00010000:0.0:1746065118.650936:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d306 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3318 expref: 6 pid: 9635 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.650958:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12799 00000100:00100000:0.0:1746065118.650963:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272151808:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065118.650969:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065118.650975:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d306 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3318 expref: 6 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.650982:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d306 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3318 expref: 6 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.651173:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d306 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3318 expref: 6 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.651197:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.651198:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.651204:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880072568a00/0x392ae0376f87d30d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e331f expref: 272 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.651211:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072568a00/0x392ae0376f87d30d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e331f expref: 272 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.651230:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880072568a00/0x392ae0376f87d30d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e331f expref: 272 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.651239:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880072568a00/0x392ae0376f87d30d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e331f expref: 272 pid: 9635 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.651248:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267292288:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065118.651304:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.653013:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.655664:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.656923:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+275:2002:x1830881272152448:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 989us (1262us total) trans 4294970679 rc 0/0 00000100:00100000:0.0:1746065118.656931:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1934 00002000:00100000:0.0:1746065118.656936:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8801306f0a80 x1830881272152448/t4294970679(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.656943:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0a80 with x1830881272152448 ext(0->7) 00010000:00010000:0.0:1746065118.656949:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568a00/0x392ae0376f87d30d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e331f expref: 275 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.656959:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568a00/0x392ae0376f87d30d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e331f expref: 275 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.656964:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801306f0a80 00000100:00100000:0.0:1746065118.660536:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.662175:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.667490:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.667534:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.669256:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.669758:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.670691:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.672629:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.676992:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272154240 00000100:00100000:0.0:1746065118.677002:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272154240 00002000:00100000:0.0:1746065118.677037:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800979a4380 x1830881272154240/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.677047:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4380 with x1830881272154240 ext(0->7) 00010000:00010000:0.0:1746065118.677055:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065c00/0x392ae0376f87d322 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3334 expref: 275 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.677067:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065c00/0x392ae0376f87d322 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3334 expref: 275 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.677074:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979a4380 00000100:00100000:0.0:1746065118.677131:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1936 00000100:00100000:0.0:1746065118.677137:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+275:2005:x1830881272154240:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.677665:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+277:2005:x1830881272154240:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 527us (1802us total) trans 4294970680 rc 0/0 00000100:00100000:0.0:1746065118.677671:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1936 00002000:00100000:0.0:1746065118.677677:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800979a4380 x1830881272154240/t4294970680(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.677684:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4380 with x1830881272154240 ext(0->7) 00010000:00010000:0.0:1746065118.677689:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065c00/0x392ae0376f87d322 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3334 expref: 277 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.677702:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065c00/0x392ae0376f87d322 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3334 expref: 277 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.677707:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979a4380 00000100:00100000:0.0:1746065118.679212:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.683848:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.689254:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.695553:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272154880 00000100:00100000:0.0:1746065118.695561:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272154880 00000100:00100000:0.0:1746065118.695695:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28831 00000100:00100000:0.0:1746065118.695702:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+276:1140:x1830881272154880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065118.695713:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.695725:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c32e400/0x392ae0376f87d337 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3349 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.695748:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d329 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e333b expref: 277 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.695761:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d330 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3342 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.695766:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.695768:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.695771:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c32e400/0x392ae0376f87d337 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3349 expref: 277 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.695956:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d330 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3342 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.695966:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d330 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3342 expref: 6 pid: 9635 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.696068:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267293184:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065118.696598:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d329 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e333b expref: 277 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.696607:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d329 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e333b expref: 277 pid: 21550 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.696615:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267293312:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065118.696635:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.698875:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.700471:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.700862:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272155392 00000100:00100000:0.0:1746065118.700866:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272155392 00010000:00010000:0.0:1746065118.700878:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d329 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e333b expref: 277 pid: 21550 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.700902:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12805 00000100:00100000:0.0:1746065118.700907:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+277:2004:x1830881272155392:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065118.700913:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065118.700920:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d329 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e333b expref: 277 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.700927:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d329 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e333b expref: 277 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.700937:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d329 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e333b expref: 277 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.700947:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.700949:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.700954:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c32e400/0x392ae0376f87d337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3349 expref: 276 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.700960:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c32e400/0x392ae0376f87d337 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3349 expref: 276 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.700981:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c32e400/0x392ae0376f87d337 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3349 expref: 276 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065118.700995:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267293440:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065118.701048:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.701207:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272155520 00000100:00100000:0.0:1746065118.701211:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272155520 00000100:00100000:0.0:1746065118.701228:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28832 00000100:00100000:0.0:1746065118.701233:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+277:1141:x1830881272155520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065118.701243:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.701251:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c32fa00/0x392ae0376f87d33e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3350 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.701265:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c32e400/0x392ae0376f87d337 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3349 expref: 278 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.701270:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065118.701271:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065118.701274:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c32fa00/0x392ae0376f87d33e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3350 expref: 278 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.701290:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c32e400/0x392ae0376f87d337 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3349 expref: 278 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.701298:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c32e400/0x392ae0376f87d337 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3349 expref: 278 pid: 9642 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.701305:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267293568:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065118.701345:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.703928:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.708928:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.709814:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+279:2005:x1830881272156032:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 580us (889us total) trans 4294970681 rc 0/0 00000100:00100000:0.0:1746065118.709821:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1939 00002000:00100000:0.0:1746065118.709826:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f849f80 x1830881272156032/t4294970681(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.709833:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f849f80 with x1830881272156032 ext(0->7) 00010000:00010000:0.0:1746065118.709838:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c32e400/0x392ae0376f87d337 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3349 expref: 279 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.709847:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c32e400/0x392ae0376f87d337 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3349 expref: 279 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.709852:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f849f80 00000100:00100000:0.0:1746065118.712439:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.715274:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.717170:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.722688:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.726500:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272157184 00000100:00100000:0.0:1746065118.726504:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272157184 00002000:00100000:0.0:1746065118.726524:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800979a7100 x1830881272157184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.726531:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7100 with x1830881272157184 ext(0->4095) 00010000:00010000:0.0:1746065118.726536:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c32fa00/0x392ae0376f87d33e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3350 expref: 280 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.726544:0:27161:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff88009c32fa00/0x392ae0376f87d33e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3350 expref: 280 pid: 9642 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065118.726549:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979a7100 00000100:00100000:0.0:1746065118.726561:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1940 00000100:00100000:0.0:1746065118.726565:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+280:2002:x1830881272157184:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.726642:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+280:2002:x1830881272157184:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 75us (206us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.726646:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1940 00002000:00100000:0.0:1746065118.726651:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800979a7100 x1830881272157184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.726657:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7100 with x1830881272157184 ext(0->4095) 00010000:00010000:0.0:1746065118.726661:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c32fa00/0x392ae0376f87d33e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3350 expref: 280 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.726666:0:27161:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff88009c32fa00/0x392ae0376f87d33e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3350 expref: 280 pid: 9642 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065118.726670:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979a7100 00000100:00100000:0.0:1746065118.728812:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.729643:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.736249:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.741040:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.743189:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+280:2003:x1830881272158080:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1945us (2151us total) trans 4294970682 rc 0/0 00000100:00100000:0.0:1746065118.743199:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1942 00002000:00100000:0.0:1746065118.743206:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d79d880 x1830881272158080/t4294970682(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.743214:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d880 with x1830881272158080 ext(0->7) 00010000:00010000:0.0:1746065118.743221:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d34c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e335e expref: 280 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.743233:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d34c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e335e expref: 280 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.743238:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d79d880 00000100:00100000:0.0:1746065118.753954:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.757936:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.759417:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.762365:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.767490:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.770590:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.774786:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.776170:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+282:2005:x1830881272159232:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1113us (1381us total) trans 4294970683 rc 0/0 00000100:00100000:0.0:1746065118.776177:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1944 00002000:00100000:0.0:1746065118.776182:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880130779f80 x1830881272159232/t4294970683(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.776189:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779f80 with x1830881272159232 ext(0->7) 00010000:00010000:0.0:1746065118.776194:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d35a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e336c expref: 282 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.776206:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d35a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e336c expref: 282 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.776212:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130779f80 00000100:00100000:0.0:1746065118.778935:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.788590:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.789966:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.790043:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.792588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.796883:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.798649:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+285:2002:x1830881272160512:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1227us (1768us total) trans 4294970684 rc 0/0 00000100:00100000:0.0:1746065118.798657:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1946 00002000:00100000:0.0:1746065118.798663:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009549d880 x1830881272160512/t4294970684(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.798669:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d880 with x1830881272160512 ext(0->7) 00010000:00010000:0.0:1746065118.798675:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d368 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e337a expref: 285 pid: 9635 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.798686:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d368 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e337a expref: 285 pid: 9635 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.798691:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009549d880 00000100:00100000:0.0:1746065118.803850:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.805755:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.806646:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272161024 00000100:00100000:0.0:1746065118.806650:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272161024 00002000:00100000:0.0:1746065118.806673:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800979a4000 x1830881272161024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.806681:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4000 with x1830881272161024 ext(0->4095) 00010000:00010000:0.0:1746065118.806686:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064400/0x392ae0376f87d36f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3381 expref: 286 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.806696:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064400/0x392ae0376f87d36f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3381 expref: 286 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.806701:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979a4000 00000100:00100000:0.0:1746065118.806725:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1947 00000100:00100000:0.0:1746065118.806731:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+286:2005:x1830881272161024:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.806836:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+286:2005:x1830881272161024:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 104us (462us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.806842:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1947 00002000:00100000:0.0:1746065118.806847:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800979a4000 x1830881272161024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.806853:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4000 with x1830881272161024 ext(0->4095) 00010000:00010000:0.0:1746065118.806858:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064400/0x392ae0376f87d36f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3381 expref: 286 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.806866:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064400/0x392ae0376f87d36f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3381 expref: 286 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.806876:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979a4000 00000100:00100000:0.0:1746065118.808030:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.808102:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.810684:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.812884:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.814393:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+286:2005:x1830881272161792:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1315us (1507us total) trans 4294970685 rc 0/0 00000100:00100000:0.0:1746065118.814400:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1949 00002000:00100000:0.0:1746065118.814406:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88007297a300 x1830881272161792/t4294970685(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.814413:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297a300 with x1830881272161792 ext(0->7) 00010000:00010000:0.0:1746065118.814418:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064200/0x392ae0376f87d376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3388 expref: 286 pid: 9642 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.814427:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064200/0x392ae0376f87d376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3388 expref: 286 pid: 9642 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.814432:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007297a300 00000100:00100000:0.0:1746065118.815371:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.819761:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.824844:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.829803:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.830773:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.835573:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.835779:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.838650:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.842823:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.847807:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.849990:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+288:2004:x1830881272163584:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 945us (2186us total) trans 4294970686 rc 0/0 00000100:00100000:0.0:1746065118.849996:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1952 00002000:00100000:0.0:1746065118.850003:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f087100 x1830881272163584/t4294970686(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.850010:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f087100 with x1830881272163584 ext(0->7) 00010000:00010000:0.0:1746065118.850016:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f87d38b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e339d expref: 288 pid: 21550 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.850028:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f87d38b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e339d expref: 288 pid: 21550 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746065118.850034:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f087100 00000100:00100000:0.0:1746065118.855010:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.858319:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.859637:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.866175:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.871067:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272164480 00000100:00100000:0.0:1746065118.871073:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272164480 00002000:00100000:0.0:1746065118.871128:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880130179500 x1830881272164480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.871136:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130179500 with x1830881272164480 ext(0->4095) 00002000:00010000:0.0:1746065118.871140:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130179500 00000100:00100000:0.0:1746065118.871155:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12843 00000100:00100000:0.0:1746065118.871162:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+288:2004:x1830881272164480:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.871250:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+288:2004:x1830881272164480:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 88us (507us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.871256:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12843 00002000:00100000:0.0:1746065118.871261:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880130179500 x1830881272164480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.871268:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130179500 with x1830881272164480 ext(0->4095) 00002000:00010000:0.0:1746065118.871270:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130179500 00000100:00100000:0.0:1746065118.877707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.881057:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.882281:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+290:2005:x1830881272164736:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 598us (1225us total) trans 4294970687 rc 0/0 00000100:00100000:0.0:1746065118.882287:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1954 00002000:00100000:0.0:1746065118.882293:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f9f9880 x1830881272164736/t4294970687(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.882299:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9880 with x1830881272164736 ext(0->7) 00010000:00010000:0.0:1746065118.882303:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d399 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33ab expref: 290 pid: 21550 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065118.882312:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d399 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33ab expref: 290 pid: 21550 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065118.882317:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9f9880 00000100:00100000:0.0:1746065118.884479:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.890332:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272165120 00000100:00100000:0.0:1746065118.890340:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272165120 00002000:00100000:0.0:1746065118.890374:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fafbb80 x1830881272165120/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.890383:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafbb80 with x1830881272165120 ext(0->4095) 00002000:00010000:0.0:1746065118.890387:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fafbb80 00000100:00100000:0.0:1746065118.890402:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12844 00000100:00100000:0.0:1746065118.890407:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272165120:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065118.890515:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272165120:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 107us (241us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065118.890521:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12844 00002000:00100000:0.0:1746065118.890527:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fafbb80 x1830881272165120/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.890534:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafbb80 with x1830881272165120 ext(0->4095) 00002000:00010000:0.0:1746065118.890536:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fafbb80 00000100:00100000:0.0:1746065118.894144:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.895027:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.895628:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065118.895639:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267297408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065118.895666:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065118.896246:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267297408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065118.897344:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.899630:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.901549:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.902645:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+293:2002:x1830881272166016:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 967us (1098us total) trans 4294970688 rc 0/0 00000100:00100000:0.0:1746065118.902655:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1956 00002000:00100000:0.0:1746065118.902661:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fbbce00 x1830881272166016/t4294970688(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.902668:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbce00 with x1830881272166016 ext(0->7) 00010000:00010000:0.0:1746065118.902674:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d3a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33b9 expref: 293 pid: 21550 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065118.902682:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d3a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33b9 expref: 293 pid: 21550 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065118.902687:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbbce00 00000100:00100000:0.0:1746065118.904744:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.907982:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.912397:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.914348:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.919406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.921609:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.925772:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.925814:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.927799:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.930892:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.934526:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.936876:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+294:2005:x1830881272168064:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1615us (2353us total) trans 4294970689 rc 0/0 00000100:00100000:0.0:1746065118.936883:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1958 00002000:00100000:0.0:1746065118.936890:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009c320e00 x1830881272168064/t4294970689(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.936899:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320e00 with x1830881272168064 ext(0->7) 00010000:00010000:0.0:1746065118.936904:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f87d3bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33ce expref: 294 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065118.936915:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f87d3bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33ce expref: 294 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065118.936921:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c320e00 00000100:00100000:0.0:1746065118.946703:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.960016:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.963007:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.966143:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.967529:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+297:2002:x1830881272169344:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1194us (1389us total) trans 4294970690 rc 0/0 00000100:00100000:0.0:1746065118.967537:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1960 00002000:00100000:0.0:1746065118.967544:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072f9aa00 x1830881272169344/t4294970690(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:34/0 lens 496/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.967551:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9aa00 with x1830881272169344 ext(0->7) 00010000:00010000:0.0:1746065118.967556:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f87d3ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33e3 expref: 297 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065118.967567:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f87d3ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33e3 expref: 297 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065118.967572:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f9aa00 00000100:00100000:0.0:1746065118.969602:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.972538:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.977079:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.979633:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.979932:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.983909:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.986699:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.986739:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065118.991342:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.006234:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.006274:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.006299:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272171136 00000100:00100000:0.0:1746065119.006307:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272171136 00002000:00100000:0.0:1746065119.007200:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880093858700 x1830881272171136/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.007208:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858700 with x1830881272171136 ext(0->7) 00010000:00010000:0.0:1746065119.007214:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33f1 expref: 298 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.007224:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33f1 expref: 298 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.007229:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093858700 00000100:00100000:0.0:1746065119.007252:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1963 00000100:00100000:0.0:1746065119.007258:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+298:2004:x1830881272171136:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.011449:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+300:2004:x1830881272171136:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 4183us (5165us total) trans 4294970691 rc 0/0 00000100:00100000:0.0:1746065119.011464:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1963 00002000:00100000:0.0:1746065119.011474:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880093858700 x1830881272171136/t4294970691(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.011482:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858700 with x1830881272171136 ext(0->7) 00010000:00010000:0.0:1746065119.011491:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33f1 expref: 300 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.011505:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065000/0x392ae0376f87d3df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33f1 expref: 300 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.011511:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093858700 00000100:00100000:0.0:1746065119.015983:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.019240:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.023739:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.024492:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.029225:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.033173:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.034689:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+300:2005:x1830881272172416:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1305us (1519us total) trans 4294970692 rc 0/0 00000100:00100000:0.0:1746065119.034698:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1966 00002000:00100000:0.0:1746065119.034705:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880093859880 x1830881272172416/t4294970692(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.034712:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859880 with x1830881272172416 ext(0->7) 00010000:00010000:0.0:1746065119.034720:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064a00/0x392ae0376f87d3ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33ff expref: 300 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.034735:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064a00/0x392ae0376f87d3ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e33ff expref: 300 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.034741:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093859880 00000100:00100000:0.0:1746065119.046426:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.056717:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.057073:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.065462:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.076382:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.076409:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272173696 00000100:00100000:0.0:1746065119.076417:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272173696 00002000:00100000:0.0:1746065119.076452:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009385aa00 x1830881272173696/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.076460:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385aa00 with x1830881272173696 ext(0->7) 00010000:00010000:0.0:1746065119.076467:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d3fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e340d expref: 301 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.076479:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d3fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e340d expref: 301 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.076485:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009385aa00 00000100:00100000:0.0:1746065119.076512:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1969 00000100:00100000:0.0:1746065119.076519:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+301:2003:x1830881272173696:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.078127:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+303:2003:x1830881272173696:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1603us (1747us total) trans 4294970693 rc 0/0 00000100:00100000:0.0:1746065119.078137:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1969 00002000:00100000:0.0:1746065119.078144:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009385aa00 x1830881272173696/t4294970693(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.078152:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385aa00 with x1830881272173696 ext(0->7) 00010000:00010000:0.0:1746065119.078159:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d3fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e340d expref: 303 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.078170:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d3fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e340d expref: 303 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.078175:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009385aa00 00000100:00100000:0.0:1746065119.082076:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.085756:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.091138:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.093503:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.098270:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.100058:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.105049:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.105121:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.105301:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12836 00000100:00100000:0.0:1746065119.105305:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+303:2004:x1830881272175104:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.105311:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.105319:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d402 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3414 expref: 303 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.105338:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d402 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3414 expref: 303 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.105359:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d402 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3414 expref: 303 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.105368:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.105370:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.105375:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3422 expref: 302 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.105385:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d410 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3422 expref: 302 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.105406:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d410 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3422 expref: 302 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.105416:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f983800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267301120:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065119.105455:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.106606:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.109908:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.122475:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.130143:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+304:2005:x1830881272175616:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 7105us (7672us total) trans 4294970694 rc 0/0 00000100:00100000:0.0:1746065119.130153:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1971 00002000:00100000:0.0:1746065119.130161:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880072f98000 x1830881272175616/t4294970694(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.130171:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98000 with x1830881272175616 ext(0->7) 00010000:00010000:0.0:1746065119.130179:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d410 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3422 expref: 304 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.130192:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569800/0x392ae0376f87d410 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3422 expref: 304 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.130199:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072f98000 00000100:00100000:0.0:1746065119.134533:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.137937:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.138746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.138796:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267301376:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065119.138808:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.138836:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+305:2002:x1830881272175744:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4080us (4324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.138842:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12837 00000100:00100000:0.0:1746065119.140856:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.140894:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.141178:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12838 00000100:00100000:0.0:1746065119.141184:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272176256:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.141192:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.141261:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f87d417 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3429 expref: 6 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.141268:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f87d417 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3429 expref: 6 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.141283:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f87d417 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3429 expref: 6 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.141314:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.141332:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272176256:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 149us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.141337:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12838 00000100:00100000:0.0:1746065119.142688:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.146542:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.148369:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a093a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+307:2002:x1830881272176896:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1472us (1825us total) trans 4294970695 rc 0/0 00000100:00100000:0.0:1746065119.148377:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1974 00002000:00100000:0.0:1746065119.148383:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a093a300 x1830881272176896/t4294970695(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.148390:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a093a300 with x1830881272176896 ext(0->7) 00010000:00010000:0.0:1746065119.148395:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d41e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3430 expref: 307 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.148406:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d41e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3430 expref: 307 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.148412:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a093a300 00000001:00080000:0.0:1746065119.149375:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970695 is committed 00000100:00100000:0.0:1746065119.151859:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.155627:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.159415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.159463:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.161956:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.162395:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.164296:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.166262:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.169239:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.172070:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.173543:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881272178560:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1034us (1473us total) trans 4294970696 rc 0/0 00000100:00100000:0.0:1746065119.173551:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1976 00002000:00100000:0.0:1746065119.173557:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800729d7100 x1830881272178560/t4294970696(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.173564:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d7100 with x1830881272178560 ext(0->7) 00010000:00010000:0.0:1746065119.173569:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d42c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e343e expref: 8 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.173580:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d42c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e343e expref: 8 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.173585:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800729d7100 00000100:00100000:0.0:1746065119.177664:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.180734:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267302528:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065119.180750:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.180916:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881272178688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3083us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.180939:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12842 00000100:00100000:0.0:1746065119.181366:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272178944 00000100:00100000:0.0:1746065119.181372:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272178944 00002000:00100000:0.0:1746065119.181403:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072a1d180 x1830881272178944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.181412:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1d180 with x1830881272178944 ext(0->4095) 00002000:00010000:0.0:1746065119.181416:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072a1d180 00000100:00100000:0.0:1746065119.181431:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12856 00000100:00100000:0.0:1746065119.181436:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272178944:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.182013:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272178944:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 575us (729us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.182019:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12856 00002000:00100000:0.0:1746065119.182024:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072a1d180 x1830881272178944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.182031:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1d180 with x1830881272178944 ext(0->4095) 00002000:00010000:0.0:1746065119.182034:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072a1d180 00000100:00100000:0.0:1746065119.187765:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.187830:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.191809:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.193005:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.196281:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.196681:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.203007:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.204537:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2002:x1830881272180352:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1320us (1530us total) trans 4294970697 rc 0/0 00000100:00100000:0.0:1746065119.204545:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1979 00002000:00100000:0.0:1746065119.204551:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880094825500 x1830881272180352/t4294970697(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.204559:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094825500 with x1830881272180352 ext(0->7) 00010000:00010000:0.0:1746065119.204565:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d448 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e345a expref: 10 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.204575:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f87d448 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e345a expref: 10 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.204581:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094825500 00000100:00100000:0.0:1746065119.209062:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.214233:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.216438:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.220140:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.226871:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.229615:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.229764:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.235654:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.236892:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2004:x1830881272182400:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 811us (1245us total) trans 4294970698 rc 0/0 00000100:00100000:0.0:1746065119.236899:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1981 00002000:00100000:0.0:1746065119.236905:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880094827100 x1830881272182400/t4294970698(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.236911:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094827100 with x1830881272182400 ext(0->7) 00010000:00010000:0.0:1746065119.236915:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064e00/0x392ae0376f87d45d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e346f expref: 13 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.236927:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064e00/0x392ae0376f87d45d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e346f expref: 13 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.236931:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094827100 00000100:00100000:0.0:1746065119.239489:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.242874:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.244536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.246597:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.251562:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.255425:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.256522:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.258822:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.258865:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.259268:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.264245:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.266853:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.268294:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881272184704:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 864us (1443us total) trans 4294970699 rc 0/0 00000100:00100000:0.0:1746065119.268301:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1984 00002000:00100000:0.0:1746065119.268307:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009e889500 x1830881272184704/t4294970699(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.268314:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889500 with x1830881272184704 ext(0->7) 00010000:00010000:0.0:1746065119.268319:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065a00/0x392ae0376f87d472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3484 expref: 15 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.268333:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065a00/0x392ae0376f87d472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3484 expref: 15 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.268338:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e889500 00000100:00100000:0.0:1746065119.270717:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.274357:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.274429:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272185088 00000100:00100000:0.0:1746065119.274434:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272185088 00002000:00100000:0.0:1746065119.274483:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009e889880 x1830881272185088/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.274491:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889880 with x1830881272185088 ext(0->4095) 00002000:00010000:0.0:1746065119.274495:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e889880 00000100:00100000:0.0:1746065119.274523:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12863 00000100:00100000:0.0:1746065119.274530:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2003:x1830881272185088:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.274667:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2003:x1830881272185088:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 137us (319us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.274683:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12863 00002000:00100000:0.0:1746065119.274689:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009e889880 x1830881272185088/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.274696:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889880 with x1830881272185088 ext(0->4095) 00002000:00010000:0.0:1746065119.274698:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e889880 00000100:00100000:0.0:1746065119.279618:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.279795:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.282592:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.287016:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.290190:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.293276:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881272185984:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2904us (3083us total) trans 4294970700 rc 0/0 00000100:00100000:0.0:1746065119.293286:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1986 00002000:00100000:0.0:1746065119.293294:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009e88a680 x1830881272185984/t4294970700(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.293301:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88a680 with x1830881272185984 ext(0->7) 00010000:00010000:0.0:1746065119.293308:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f98e800/0x392ae0376f87d480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3492 expref: 16 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.293322:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f98e800/0x392ae0376f87d480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3492 expref: 16 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.293327:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e88a680 00000100:00100000:0.0:1746065119.299838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.304658:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.305856:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.305881:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272186496 00000100:00100000:0.0:1746065119.305884:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272186496 00000100:00100000:0.0:1746065119.305917:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28880 00000100:00100000:0.0:1746065119.305923:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:1140:x1830881272186496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065119.305931:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.305943:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cd6a00/0x392ae0376f87d48e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e34a0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.305963:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091064200/0x392ae0376f87d487 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3499 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.305970:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.305972:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.305975:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd6a00/0x392ae0376f87d48e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34a0 expref: 16 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.305997:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091064200/0x392ae0376f87d487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3499 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.306006:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091064200/0x392ae0376f87d487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3499 expref: 5 pid: 9642 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.306016:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9635:1830881267305088:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065119.306064:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.310860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.310905:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.313337:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9635:1830881267305344:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065119.313350:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091064a00/0x392ae0376f87d495 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34a7 expref: 17 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.313363:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:0.0:1746065119.313389:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:1141:x1830881272186752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2121us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.313394:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28881 00000100:00100000:0.0:1746065119.314737:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.319581:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.320882:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2005:x1830881272187264:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1082us (1307us total) trans 4294970701 rc 0/0 00000100:00100000:0.0:1746065119.320889:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1988 00002000:00100000:0.0:1746065119.320895:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009e888000 x1830881272187264/t4294970701(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.320903:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e888000 with x1830881272187264 ext(0->7) 00010000:00010000:0.0:1746065119.320908:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097cd6a00/0x392ae0376f87d48e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34a0 expref: 19 pid: 9635 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.320918:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097cd6a00/0x392ae0376f87d48e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34a0 expref: 19 pid: 9635 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.320924:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e888000 00000100:00100000:0.0:1746065119.322153:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.325169:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.327801:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.330280:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.332867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.333697:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.340010:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1145 00000100:00100000:0.0:1746065119.340016:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2003:x1830881272188672:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065119.340258:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2003:x1830881272188672:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 242us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.340262:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1145 00000100:00100000:0.0:1746065119.340651:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272188544 00000100:00100000:0.0:1746065119.340654:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272188544 00000100:00100000:0.0:1746065119.340681:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1147 00000100:00100000:0.0:1746065119.340685:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881272188544:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065119.340705:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881272188544:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 20us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.340709:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1147 00000100:00100000:0.0:1746065119.341430:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272189056 00000100:00100000:0.0:1746065119.341433:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272189056 00000100:00100000:0.0:1746065119.341464:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1148 00000100:00100000:0.0:1746065119.341468:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272189056:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065119.341489:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272189056:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 21us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.341493:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1148 00000100:00100000:0.0:1746065119.344300:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.344332:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.344379:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.348830:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.352771:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.355838:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2003:x1830881272190208:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1968us (3067us total) trans 4294970702 rc 0/0 00000100:00100000:0.0:1746065119.355848:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1990 00002000:00100000:0.0:1746065119.355856:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d7fd500 x1830881272190208/t4294970702(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.355864:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d7fd500 with x1830881272190208 ext(0->7) 00010000:00010000:0.0:1746065119.355871:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d4a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34b5 expref: 20 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.355889:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d4a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34b5 expref: 20 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.355894:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d7fd500 00000100:00100000:0.0:1746065119.361868:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.363845:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272190464 00000100:00100000:0.0:1746065119.363850:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272190464 00000100:00100000:0.0:1746065119.363875:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28886 00000100:00100000:0.0:1746065119.363881:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:1140:x1830881272190464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065119.363892:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.363902:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d185a00/0x392ae0376f87d4b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e34c3 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.363919:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87d4aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34bc expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.363925:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.363927:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.363929:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d185a00/0x392ae0376f87d4b1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34c3 expref: 21 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.363944:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87d4aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34bc expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.363952:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87d4aa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34bc expref: 5 pid: 9560 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.363964:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267306240:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065119.364646:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.367022:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.368485:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.370686:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.379944:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.385201:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.387187:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881272191360:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1831us (1981us total) trans 4294970703 rc 0/0 00000100:00100000:0.0:1746065119.387196:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1992 00002000:00100000:0.0:1746065119.387203:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d7fea00 x1830881272191360/t4294970703(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.387211:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d7fea00 with x1830881272191360 ext(0->7) 00010000:00010000:0.0:1746065119.387217:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d185a00/0x392ae0376f87d4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34c3 expref: 22 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.387228:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d185a00/0x392ae0376f87d4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34c3 expref: 22 pid: 9560 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.387234:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d7fea00 00000100:00100000:0.0:1746065119.389907:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.392540:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.398175:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.401664:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.427756:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.434263:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.436822:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2002:x1830881272192512:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2332us (2551us total) trans 4294970704 rc 0/0 00000100:00100000:0.0:1746065119.436832:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1994 00002000:00100000:0.0:1746065119.436840:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d7fd880 x1830881272192512/t4294970704(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.436848:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d7fd880 with x1830881272192512 ext(0->7) 00010000:00010000:0.0:1746065119.436857:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87d4bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34d1 expref: 24 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.436871:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87d4bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34d1 expref: 24 pid: 9560 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.436877:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d7fd880 00000100:00100000:0.0:1746065119.438448:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.444886:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272192896 00000100:00100000:0.0:1746065119.444892:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272192896 00002000:00100000:0.0:1746065119.444924:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880093859c00 x1830881272192896/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.444932:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859c00 with x1830881272192896 ext(0->4095) 00002000:00010000:0.0:1746065119.444935:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093859c00 00000100:00100000:0.0:1746065119.444963:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12870 00000100:00100000:0.0:1746065119.444969:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272192896:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.446887:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272192896:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 1911us (4124us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.446899:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12870 00002000:00100000:0.0:1746065119.446908:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880093859c00 x1830881272192896/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.446915:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859c00 with x1830881272192896 ext(0->4095) 00002000:00010000:0.0:1746065119.446919:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093859c00 00000100:00100000:0.0:1746065119.448686:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.463576:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272193280 00000100:00100000:0.0:1746065119.463584:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272193280 00002000:00100000:0.0:1746065119.463619:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88013077b800 x1830881272193280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.463628:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b800 with x1830881272193280 ext(0->4095) 00002000:00010000:0.0:1746065119.463632:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013077b800 00000100:00100000:0.0:1746065119.463788:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12871 00000100:00100000:0.0:1746065119.463794:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2002:x1830881272193280:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.467198:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2002:x1830881272193280:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 3395us (3703us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.467210:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12871 00002000:00100000:0.0:1746065119.467220:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88013077b800 x1830881272193280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.467229:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b800 with x1830881272193280 ext(0->4095) 00002000:00010000:0.0:1746065119.467235:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013077b800 00000100:00100000:0.0:1746065119.478564:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.478657:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.482018:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.486376:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fafb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267307392:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065119.486401:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87d4d4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34e6 expref: 24 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.486414:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f524c00, rc 0) 00000100:00100000:0.0:1746065119.488483:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1140:x1830881272193536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 9667us (9922us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.488491:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28891 00000100:00100000:0.0:1746065119.489549:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272193920 00000100:00100000:0.0:1746065119.489555:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272193920 00010000:00010000:0.0:1746065119.489579:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524e00/0x392ae0376f87d4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34d8 expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.489598:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12864 00000100:00100000:0.0:1746065119.489603:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272193920:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.489613:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.489625:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f524e00/0x392ae0376f87d4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34d8 expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.489634:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f524e00/0x392ae0376f87d4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34d8 expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.489650:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f524e00/0x392ae0376f87d4c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34d8 expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.490380:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.490383:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.490389:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87d4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34e6 expref: 24 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.490413:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87d4d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34e6 expref: 24 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.494506:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.497347:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.499438:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2002:x1830881272194560:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1546us (2093us total) trans 4294970705 rc 0/0 00000100:00100000:0.0:1746065119.499447:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1997 00002000:00100000:0.0:1746065119.499454:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880092df0e00 x1830881272194560/t4294970705(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.499461:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092df0e00 with x1830881272194560 ext(0->7) 00010000:00010000:0.0:1746065119.499469:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87d4d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34e6 expref: 27 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.499481:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524c00/0x392ae0376f87d4d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34e6 expref: 27 pid: 9560 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.499487:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092df0e00 00000100:00100000:0.0:1746065119.509296:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272194944 00000100:00100000:0.0:1746065119.509301:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272194944 00002000:00100000:0.0:1746065119.509331:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072a1f100 x1830881272194944/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.509340:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f100 with x1830881272194944 ext(0->4095) 00002000:00010000:0.0:1746065119.509344:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072a1f100 00000100:00100000:0.0:1746065119.510310:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12872 00000100:00100000:0.0:1746065119.510318:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2002:x1830881272194944:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.510600:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2002:x1830881272194944:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 282us (1722us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.510606:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12872 00002000:00100000:0.0:1746065119.510611:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072a1f100 x1830881272194944/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.510618:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f100 with x1830881272194944 ext(0->4095) 00002000:00010000:0.0:1746065119.510621:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072a1f100 00000100:00100000:0.0:1746065119.513926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.514067:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.518265:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272195456 00000100:00100000:0.0:1746065119.518276:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272195456 00002000:00100000:0.0:1746065119.518308:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072a1e300 x1830881272195456/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.518316:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1e300 with x1830881272195456 ext(0->4095) 00010000:00010000:0.0:1746065119.518323:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d4e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34f4 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.518333:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d4e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34f4 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.518338:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a1e300 00000100:00100000:0.0:1746065119.518355:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1998 00000100:00100000:0.0:1746065119.518362:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272195456:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.518471:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272195456:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 109us (440us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.518477:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1998 00002000:00100000:0.0:1746065119.518482:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880072a1e300 x1830881272195456/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.518489:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1e300 with x1830881272195456 ext(0->4095) 00010000:00010000:0.0:1746065119.518493:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d4e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34f4 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.518499:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d4e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34f4 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.518504:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880072a1e300 00000100:00100000:0.0:1746065119.522070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.524799:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.528662:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.530492:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.532161:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2005:x1830881272196224:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1218us (1668us total) trans 4294970706 rc 0/0 00000100:00100000:0.0:1746065119.532169:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1999 00002000:00100000:0.0:1746065119.532174:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880092df2300 x1830881272196224/t4294970706(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.532256:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092df2300 with x1830881272196224 ext(0->7) 00010000:00010000:0.0:1746065119.532263:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065c00/0x392ae0376f87d4e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34fb expref: 28 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.532279:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065c00/0x392ae0376f87d4e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e34fb expref: 28 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.532285:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092df2300 00000100:00100000:0.0:1746065119.536024:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.539191:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.542031:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7200:1830881267308416:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065119.542044:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.542069:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:2005:x1830881272196352:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5855us (6052us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.542350:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12868 00000100:00100000:0.0:1746065119.542374:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272196736 00000100:00100000:0.0:1746065119.542378:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272196736 00002000:00100000:0.0:1746065119.542399:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009385ad80 x1830881272196736/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.542408:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385ad80 with x1830881272196736 ext(0->4095) 00010000:00010000:0.0:1746065119.542413:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d4f0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3502 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.542422:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d4f0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3502 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.542427:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009385ad80 00000100:00100000:0.0:1746065119.542439:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2000 00000100:00100000:0.0:1746065119.542444:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272196736:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.542530:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272196736:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 84us (496us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.542535:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2000 00002000:00100000:0.0:1746065119.542540:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009385ad80 x1830881272196736/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.542547:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385ad80 with x1830881272196736 ext(0->4095) 00010000:00010000:0.0:1746065119.542551:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d4f0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3502 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.542558:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f87d4f0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3502 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.542564:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009385ad80 00000100:00100000:0.0:1746065119.545336:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.545396:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.545411:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272196992 00000100:00100000:0.0:1746065119.545414:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272196992 00000100:00100000:0.0:1746065119.545434:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28897 00000100:00100000:0.0:1746065119.545444:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:1141:x1830881272196992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065119.545455:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.545467:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d185200/0x392ae0376f87d4fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3510 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.545485:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.545490:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d4f7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3509 expref: 30 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.545499:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065119.545502:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d185200/0x392ae0376f87d4fe lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3510 expref: 30 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.545807:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d4f7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3509 expref: 30 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.545816:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d185200/0x392ae0376f87d4fe lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3510 expref: 30 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.545823:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d185200, rc 0) 00000100:00100000:0.0:1746065119.545839:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:1141:x1830881272196992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 401us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.545845:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28897 00000100:00100000:0.0:1746065119.548119:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.551744:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.552632:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881272197504:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 703us (893us total) trans 4294970707 rc 0/0 00000100:00100000:0.0:1746065119.552639:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2002 00002000:00100000:0.0:1746065119.552645:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880092df3800 x1830881272197504/t4294970707(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.552652:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092df3800 with x1830881272197504 ext(0->7) 00010000:00010000:0.0:1746065119.552657:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d4f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3509 expref: 31 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.552671:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568e00/0x392ae0376f87d4f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3509 expref: 31 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.552677:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092df3800 00000100:00100000:0.0:1746065119.554152:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.564983:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272197888 00000100:00100000:0.0:1746065119.564995:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272197888 00002000:00100000:0.0:1746065119.565042:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880093859180 x1830881272197888/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.565051:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859180 with x1830881272197888 ext(0->4095) 00002000:00010000:0.0:1746065119.565055:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093859180 00000100:00100000:0.0:1746065119.565143:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12874 00000100:00100000:0.0:1746065119.565150:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2005:x1830881272197888:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.565277:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2005:x1830881272197888:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 127us (5455us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.565283:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12874 00002000:00100000:0.0:1746065119.565289:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880093859180 x1830881272197888/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.565295:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859180 with x1830881272197888 ext(0->4095) 00002000:00010000:0.0:1746065119.565298:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093859180 00000100:00100000:0.0:1746065119.568129:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.568209:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.572648:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.575518:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.576776:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.583773:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.590459:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.597844:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.610218:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.610294:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.616974:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.617053:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.617074:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272200192 00000100:00100000:0.0:1746065119.617094:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272200192 00002000:00100000:0.0:1746065119.617136:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880124b89880 x1830881272200192/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.617144:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b89880 with x1830881272200192 ext(0->4095) 00010000:00010000:0.0:1746065119.617151:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f87d51a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e352c expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.617161:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f87d51a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e352c expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.617166:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880124b89880 00000100:00100000:0.0:1746065119.617193:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2006 00000100:00100000:0.0:1746065119.617198:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272200192:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.617291:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272200192:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 92us (238us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.617296:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2006 00002000:00100000:0.0:1746065119.617300:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff880124b89880 x1830881272200192/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.617311:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b89880 with x1830881272200192 ext(0->4095) 00010000:00010000:0.0:1746065119.617315:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f87d51a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e352c expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.617322:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f87d51a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e352c expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.617327:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880124b89880 00000100:00100000:0.0:1746065119.624828:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.628469:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.630286:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.633117:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.634686:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881272200960:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1261us (1578us total) trans 4294970709 rc 0/0 00000100:00100000:0.0:1746065119.634693:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2007 00002000:00100000:0.0:1746065119.634698:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880124b8a680 x1830881272200960/t4294970709(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.634704:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8a680 with x1830881272200960 ext(0->7) 00010000:00010000:0.0:1746065119.634709:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f88f400/0x392ae0376f87d521 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3533 expref: 34 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.634719:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f88f400/0x392ae0376f87d521 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3533 expref: 34 pid: 9560 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.634724:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880124b8a680 00000100:00100000:0.0:1746065119.636037:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.638857:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.640844:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.644321:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.645043:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.646571:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.647417:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.647455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.649556:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.652521:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.653487:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2005:x1830881272202752:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 778us (971us total) trans 4294970710 rc 0/0 00000100:00100000:0.0:1746065119.653493:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2010 00002000:00100000:0.0:1746065119.653499:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880124a08700 x1830881272202752/t4294970710(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.653506:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124a08700 with x1830881272202752 ext(0->7) 00010000:00010000:0.0:1746065119.653511:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d536 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3548 expref: 36 pid: 21550 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.653519:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d536 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3548 expref: 36 pid: 21550 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.653524:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880124a08700 00000100:00100000:0.0:1746065119.655232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.657751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.659821:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.661156:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.663237:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.671426:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.674394:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.675505:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.675558:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.677931:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.686482:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.690611:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2003:x1830881272204800:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3913us (4125us total) trans 4294970711 rc 0/0 00000100:00100000:0.0:1746065119.690625:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2012 00002000:00100000:0.0:1746065119.690637:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880124a0aa00 x1830881272204800/t4294970711(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.690645:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124a0aa00 with x1830881272204800 ext(0->7) 00010000:00010000:0.0:1746065119.690655:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065400/0x392ae0376f87d54b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e355d expref: 39 pid: 21550 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.690670:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065400/0x392ae0376f87d54b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e355d expref: 39 pid: 21550 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.690676:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880124a0aa00 00000100:00100000:0.0:1746065119.694816:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.696010:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.702323:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272205312 00000100:00100000:0.0:1746065119.702329:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272205312 00002000:00100000:0.0:1746065119.702360:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009385b480 x1830881272205312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.702369:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b480 with x1830881272205312 ext(0->4095) 00010000:00010000:0.0:1746065119.702377:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065600/0x392ae0376f87d552 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3564 expref: 39 pid: 21550 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.702389:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065600/0x392ae0376f87d552 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3564 expref: 39 pid: 21550 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.702394:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009385b480 00000100:00100000:0.0:1746065119.702421:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2013 00000100:00100000:0.0:1746065119.702427:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881272205312:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.705118:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881272205312:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 2651us (3209us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.705130:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2013 00002000:00100000:0.0:1746065119.705141:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009385b480 x1830881272205312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.705150:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b480 with x1830881272205312 ext(0->4095) 00010000:00010000:0.0:1746065119.705160:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065600/0x392ae0376f87d552 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3564 expref: 39 pid: 21550 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.705176:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065600/0x392ae0376f87d552 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3564 expref: 39 pid: 21550 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.705182:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009385b480 00000100:00100000:0.0:1746065119.712253:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272205440 00000100:00100000:0.0:1746065119.712261:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272205440 00000100:00100000:0.0:1746065119.712602:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28911 00000100:00100000:0.0:1746065119.712610:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1141:x1830881272205440:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065119.712624:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.712638:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d560 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3572 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.712659:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.712664:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091064c00/0x392ae0376f87d559 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e356b expref: 38 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.712669:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065119.712672:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d560 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3572 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.712699:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091064c00/0x392ae0376f87d559 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e356b expref: 38 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.712710:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d560 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3572 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.712719:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072568600, rc 0) 00000100:00100000:0.0:1746065119.712756:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1141:x1830881272205440:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 147us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.712761:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28911 00000100:00100000:0.0:1746065119.716915:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.732194:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2004:x1830881272206080:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 5778us (5971us total) trans 4294970712 rc 0/0 00000100:00100000:0.0:1746065119.732205:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2015 00002000:00100000:0.0:1746065119.732215:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009f5e9c00 x1830881272206080/t4294970712(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.732225:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9c00 with x1830881272206080 ext(0->7) 00010000:00010000:0.0:1746065119.732234:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064c00/0x392ae0376f87d559 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e356b expref: 40 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.732250:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064c00/0x392ae0376f87d559 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e356b expref: 40 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.732257:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f5e9c00 00000100:00100000:0.0:1746065119.735768:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.741179:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.749846:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272206592 00000100:00100000:0.0:1746065119.749852:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272206592 00002000:00100000:0.0:1746065119.749884:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f5e9f80 x1830881272206592/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.749893:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9f80 with x1830881272206592 ext(0->4095) 00010000:00010000:0.0:1746065119.749901:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3572 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.749913:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3572 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.749919:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f5e9f80 00000100:00100000:0.0:1746065119.749944:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2016 00000100:00100000:0.0:1746065119.749949:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272206592:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.750049:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272206592:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 99us (296us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.750054:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2016 00002000:00100000:0.0:1746065119.750059:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009f5e9f80 x1830881272206592/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.750065:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9f80 with x1830881272206592 ext(0->4095) 00010000:00010000:0.0:1746065119.750069:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3572 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.750077:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072568600/0x392ae0376f87d560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3572 expref: 6 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.750119:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f5e9f80 00000100:00100000:0.0:1746065119.753398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.756158:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.761204:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.763316:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.764873:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881272207232:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 714us (1560us total) trans 4294970713 rc 0/0 00000100:00100000:0.0:1746065119.764880:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2017 00002000:00100000:0.0:1746065119.764885:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f728700 x1830881272207232/t4294970713(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.764891:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728700 with x1830881272207232 ext(0->7) 00010000:00010000:0.0:1746065119.764896:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f88e400/0x392ae0376f87d567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3579 expref: 42 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.765065:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f88e400/0x392ae0376f87d567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3579 expref: 42 pid: 9560 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.765071:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f728700 00000100:00100000:0.0:1746065119.766865:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.768715:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.771189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.775001:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.785326:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.786940:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.792011:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.805835:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.808557:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.810209:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2003:x1830881272209280:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1195us (1652us total) trans 4294970714 rc 0/0 00000100:00100000:0.0:1746065119.810217:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2019 00002000:00100000:0.0:1746065119.810223:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f72a300 x1830881272209280/t4294970714(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.810230:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a300 with x1830881272209280 ext(0->7) 00010000:00010000:0.0:1746065119.810235:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f88ea00/0x392ae0376f87d57c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e358e expref: 45 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.810245:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f88ea00/0x392ae0376f87d57c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e358e expref: 45 pid: 9560 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.810250:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f72a300 00000100:00100000:0.0:1746065119.812407:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.817384:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.820899:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.822408:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272209920 00000100:00100000:0.0:1746065119.822411:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272209920 00000100:00100000:0.0:1746065119.822427:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28918 00000100:00100000:0.0:1746065119.822431:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1140:x1830881272209920:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065119.822438:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.822443:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87d591 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e35a3 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.822455:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1234600/0x392ae0376f87d583 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3595 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.822462:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d58a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e359c expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.822466:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.822467:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.822469:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87d591 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35a3 expref: 45 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.822489:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d58a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e359c expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.822497:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d58a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e359c expref: 5 pid: 9560 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.822506:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f72b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267313280:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065119.822566:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1234600/0x392ae0376f87d583 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3595 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.822573:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a1234600/0x392ae0376f87d583 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3595 expref: 45 pid: 9560 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.822579:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f72b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267313408:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065119.822594:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.825181:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.825224:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.825326:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272210304 00000100:00100000:0.0:1746065119.825332:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272210304 00002000:00100000:0.0:1746065119.825359:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012f72bb80 x1830881272210304/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.825368:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72bb80 with x1830881272210304 ext(0->4095) 00010000:00010000:0.0:1746065119.825374:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d58a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e359c expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.825383:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d58a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e359c expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.825389:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f72bb80 00000100:00100000:0.0:1746065119.825402:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2020 00000100:00100000:0.0:1746065119.825407:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272210304:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.825495:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272210304:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 87us (269us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.825500:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2020 00002000:00100000:0.0:1746065119.825505:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012f72bb80 x1830881272210304/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.825512:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72bb80 with x1830881272210304 ext(0->4095) 00010000:00010000:0.0:1746065119.825516:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d58a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e359c expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.825524:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065e00/0x392ae0376f87d58a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e359c expref: 6 pid: 9560 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.825530:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f72bb80 00000100:00100000:0.0:1746065119.828444:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.838969:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.845954:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.851841:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.853668:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f73c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2003:x1830881272210944:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1626us (1830us total) trans 4294970715 rc 0/0 00000100:00100000:0.0:1746065119.853677:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2021 00002000:00100000:0.0:1746065119.853683:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f73c380 x1830881272210944/t4294970715(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.853691:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f73c380 with x1830881272210944 ext(0->7) 00010000:00010000:0.0:1746065119.853697:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87d591 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35a3 expref: 46 pid: 9642 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.853709:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f524200/0x392ae0376f87d591 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35a3 expref: 46 pid: 9642 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746065119.853720:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f73c380 00000100:00100000:0.0:1746065119.856748:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.870237:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.872938:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.878738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.878818:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.883213:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267314176:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065119.883229:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.883259:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272211712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3076us (4441us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.883267:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12893 00000100:00100000:0.0:1746065119.896426:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.897580:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2005:x1830881272212224:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1355us (1546us total) trans 4294970716 rc 0/0 00000100:00100000:0.0:1746065119.897588:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2024 00002000:00100000:0.0:1746065119.897594:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880124a0a300 x1830881272212224/t4294970716(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.897600:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124a0a300 with x1830881272212224 ext(0->7) 00010000:00010000:0.0:1746065119.897606:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f88e400/0x392ae0376f87d59f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35b1 expref: 50 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.897616:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f88e400/0x392ae0376f87d59f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35b1 expref: 50 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065119.897621:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880124a0a300 00000100:00100000:0.0:1746065119.902239:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.906888:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.913235:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.913824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.931243:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.932596:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f73e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2003:x1830881272213504:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1176us (1357us total) trans 4294970717 rc 0/0 00000100:00100000:0.0:1746065119.932602:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2027 00002000:00100000:0.0:1746065119.932608:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f73e300 x1830881272213504/t4294970717(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.932616:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f73e300 with x1830881272213504 ext(0->7) 00010000:00010000:0.0:1746065119.932622:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10000/0x392ae0376f87d5ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35bf expref: 50 pid: 21550 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.932632:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd10000/0x392ae0376f87d5ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35bf expref: 50 pid: 21550 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065119.932638:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f73e300 00000100:00100000:0.0:1746065119.936304:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.939556:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.944656:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.949202:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.955402:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.955549:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.955579:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272214656 00000100:00100000:0.0:1746065119.955581:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272214656 00002000:00100000:0.0:1746065119.955603:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012f73f800 x1830881272214656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.955612:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f73f800 with x1830881272214656 ext(0->4095) 00002000:00010000:0.0:1746065119.955616:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f73f800 00000100:00100000:0.0:1746065119.955640:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12889 00000100:00100000:0.0:1746065119.955645:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f73f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272214656:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.955748:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f73f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272214656:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 102us (201us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065119.955753:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12889 00002000:00100000:0.0:1746065119.955757:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88012f73f800 x1830881272214656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.955763:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f73f800 with x1830881272214656 ext(0->4095) 00002000:00010000:0.0:1746065119.955766:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f73f800 00000100:00100000:0.0:1746065119.957929:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.958686:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272214912 00000100:00100000:0.0:1746065119.958689:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272214912 00010000:00010000:0.0:1746065119.958701:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98fc00/0x392ae0376f87d5b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35c6 expref: 6 pid: 9560 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065119.958726:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12898 00000100:00100000:0.0:1746065119.958731:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272214912:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.958737:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.958745:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f98fc00/0x392ae0376f87d5b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35c6 expref: 6 pid: 9560 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.958754:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f98fc00/0x392ae0376f87d5b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35c6 expref: 6 pid: 9560 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.958765:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98fc00/0x392ae0376f87d5b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35c6 expref: 6 pid: 9560 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.958776:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.958778:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.958783:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f98e800/0x392ae0376f87d5c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35d4 expref: 49 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.958790:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98e800/0x392ae0376f87d5c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35d4 expref: 49 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.958809:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f98e800/0x392ae0376f87d5c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35d4 expref: 49 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.958818:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f729c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267315200:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065119.958865:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fbc0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.960581:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.963566:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.967376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.968182:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272215424 00000100:00100000:0.0:1746065119.968187:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272215424 00002000:00100000:0.0:1746065119.968218:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88008251f050 x1830881272215424/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:35/0 lens 496/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.968225:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008251f050 with x1830881272215424 ext(0->7) 00010000:00010000:0.0:1746065119.968232:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f98e800/0x392ae0376f87d5c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35d4 expref: 50 pid: 9560 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.968252:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f98e800/0x392ae0376f87d5c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35d4 expref: 50 pid: 9560 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065119.968258:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008251f050 00000100:00100000:0.0:1746065119.968498:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2028 00000100:00100000:0.0:1746065119.968504:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008251f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2002:x1830881272215424:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065119.972686:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.975472:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.979208:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065119.983733:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.003233:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.003265:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.003300:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.003328:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272216704 00000100:00100000:0.0:1746065120.003332:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272216704 00010000:00010000:0.0:1746065120.003351:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f87d5d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35e2 expref: 53 pid: 9560 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.003363:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272216960 00000100:00100000:0.0:1746065120.003365:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272216960 00010000:00010000:0.0:1746065120.003373:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98f600/0x392ae0376f87d5c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35db expref: 6 pid: 9560 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.003383:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12900 00000100:00100000:0.0:1746065120.003386:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2003:x1830881272216704:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.003396:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.003727:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f87d5d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35e2 expref: 55 pid: 9560 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.003735:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f87d5d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35e2 expref: 55 pid: 9560 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.003748:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f87d5d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35e2 expref: 55 pid: 9560 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.003759:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065120.003770:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2003:x1830881272216704:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 383us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.003775:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12900 00000100:00100000:0.0:1746065120.005536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.007253:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.008338:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2004:x1830881272217472:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 791us (1086us total) trans 4294970719 rc 0/0 00000100:00100000:0.0:1746065120.008344:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2030 00002000:00100000:0.0:1746065120.008349:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f729500 x1830881272217472/t4294970719(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.008355:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729500 with x1830881272217472 ext(0->7) 00010000:00010000:0.0:1746065120.008360:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd11c00/0x392ae0376f87d5d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35e9 expref: 55 pid: 21550 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.008368:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd11c00/0x392ae0376f87d5d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35e9 expref: 55 pid: 21550 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.008374:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f729500 00000100:00100000:0.0:1746065120.009679:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.011970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.014267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.015817:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.017890:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.023830:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.029052:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.029579:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.031599:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.034046:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.037352:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.038334:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2002:x1830881272219520:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 725us (986us total) trans 4294970720 rc 0/0 00000100:00100000:0.0:1746065120.038340:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2032 00002000:00100000:0.0:1746065120.038345:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f729c00 x1830881272219520/t4294970720(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.038351:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729c00 with x1830881272219520 ext(0->7) 00010000:00010000:0.0:1746065120.038355:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065400/0x392ae0376f87d5ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35fe expref: 56 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.038363:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065400/0x392ae0376f87d5ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e35fe expref: 56 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.038367:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f729c00 00000100:00100000:0.0:1746065120.039267:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.042015:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.045863:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.048955:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.049774:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.052273:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.053768:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.053827:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.055287:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.061638:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.063393:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2002:x1830881272221312:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1552us (1756us total) trans 4294970721 rc 0/0 00000100:00100000:0.0:1746065120.063401:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2035 00002000:00100000:0.0:1746065120.063407:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009d1e3480 x1830881272221312/t4294970721(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.063415:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3480 with x1830881272221312 ext(0->7) 00010000:00010000:0.0:1746065120.063421:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x392ae0376f87d601 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3613 expref: 58 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.063433:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x392ae0376f87d601 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3613 expref: 58 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.063438:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1e3480 00000100:00100000:0.0:1746065120.065221:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.069512:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.069530:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272221696 00000100:00100000:0.0:1746065120.069535:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272221696 00002000:00100000:0.0:1746065120.069563:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d1e1180 x1830881272221696/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.069572:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1180 with x1830881272221696 ext(0->4095) 00002000:00010000:0.0:1746065120.069575:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e1180 00000100:00100000:0.0:1746065120.069600:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12898 00000100:00100000:0.0:1746065120.069605:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272221696:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065120.069696:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272221696:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 90us (185us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065120.069701:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12898 00002000:00100000:0.0:1746065120.069705:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009d1e1180 x1830881272221696/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.069711:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1180 with x1830881272221696 ext(0->4095) 00002000:00010000:0.0:1746065120.069713:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e1180 00000100:00100000:0.0:1746065120.072120:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.072248:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.076211:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.076292:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.079251:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.079296:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.085075:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.089614:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.090722:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881272223104:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 926us (1113us total) trans 4294970722 rc 0/0 00000100:00100000:0.0:1746065120.090729:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2038 00002000:00100000:0.0:1746065120.090734:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f084a80 x1830881272223104/t4294970722(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.090741:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084a80 with x1830881272223104 ext(0->7) 00010000:00010000:0.0:1746065120.090746:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd11200/0x392ae0376f87d616 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3628 expref: 60 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.090756:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd11200/0x392ae0376f87d616 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3628 expref: 60 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.090761:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f084a80 00000100:00100000:0.0:1746065120.094537:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.101039:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.103711:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.103780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.106890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.107746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.112447:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.112491:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.115315:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.121203:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.122029:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2005:x1830881272224896:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 582us (832us total) trans 4294970723 rc 0/0 00000100:00100000:0.0:1746065120.122035:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2041 00002000:00100000:0.0:1746065120.122040:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012f18c700 x1830881272224896/t4294970723(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.122046:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18c700 with x1830881272224896 ext(0->7) 00010000:00010000:0.0:1746065120.122050:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f87d62b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e363d expref: 62 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.122060:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f87d62b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e363d expref: 62 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.122065:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f18c700 00000100:00100000:0.0:1746065120.123624:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.127814:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.132376:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.134821:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.136131:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.139427:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.139456:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.139645:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.142792:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.155062:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881272226688:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3824us (6535us total) trans 4294970724 rc 0/0 00000100:00100000:0.0:1746065120.155073:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2044 00002000:00100000:0.0:1746065120.155663:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880124a08a80 x1830881272226688/t4294970724(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.155672:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124a08a80 with x1830881272226688 ext(0->7) 00010000:00010000:0.0:1746065120.155682:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd11c00/0x392ae0376f87d640 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3652 expref: 64 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.155696:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd11c00/0x392ae0376f87d640 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3652 expref: 64 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.155707:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880124a08a80 00000100:00100000:0.0:1746065120.159491:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.164187:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.186916:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.190570:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.211204:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.213170:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2005:x1830881272227840:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1802us (1966us total) trans 4294970725 rc 0/0 00000100:00100000:0.0:1746065120.213179:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2046 00002000:00100000:0.0:1746065120.213186:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a091dc00 x1830881272227840/t4294970725(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.213194:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091dc00 with x1830881272227840 ext(0->7) 00010000:00010000:0.0:1746065120.213201:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d64e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3660 expref: 66 pid: 21550 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.213213:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d64e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3660 expref: 66 pid: 21550 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.213219:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091dc00 00000100:00100000:0.0:1746065120.220700:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.220785:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.223206:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.229640:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.243429:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.245655:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.246748:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2005:x1830881272228992:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 951us (1093us total) trans 4294970726 rc 0/0 00000100:00100000:0.0:1746065120.246755:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2048 00002000:00100000:0.0:1746065120.246761:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff8800a091d500 x1830881272228992/t4294970726(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.246768:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091d500 with x1830881272228992 ext(0->7) 00010000:00010000:0.0:1746065120.246773:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065600/0x392ae0376f87d65c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e366e expref: 68 pid: 21550 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.246782:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065600/0x392ae0376f87d65c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e366e expref: 68 pid: 21550 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.246788:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091d500 00000100:00100000:0.0:1746065120.247922:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.249196:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.253689:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.253715:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272229504 00000100:00100000:0.0:1746065120.253720:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272229504 00002000:00100000:0.0:1746065120.253750:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800a091f480 x1830881272229504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.253759:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f480 with x1830881272229504 ext(0->4095) 00010000:00010000:0.0:1746065120.253765:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3675 expref: 6 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.253777:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3675 expref: 6 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.253786:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091f480 00000100:00100000:0.0:1746065120.253800:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2049 00000100:00100000:0.0:1746065120.253806:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272229504:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065120.253898:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272229504:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 92us (212us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065120.253904:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2049 00002000:00100000:0.0:1746065120.253909:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff8800a091f480 x1830881272229504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.253916:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f480 with x1830881272229504 ext(0->4095) 00010000:00010000:0.0:1746065120.253920:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3675 expref: 6 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.253928:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3675 expref: 6 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.253934:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a091f480 00000100:00100000:0.0:1746065120.255567:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.255582:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272229632 00000100:00100000:0.0:1746065120.255586:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272229632 00010000:00010000:0.0:1746065120.255602:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3675 expref: 6 pid: 9642 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.255623:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12922 00000100:00100000:0.0:1746065120.255627:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272229632:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.255637:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.255649:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3675 expref: 6 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.255663:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d663 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3675 expref: 6 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.255680:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091065800/0x392ae0376f87d663 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3675 expref: 6 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.255694:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.255696:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.255702:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091064e00/0x392ae0376f87d66a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e367c expref: 67 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.255709:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091064e00/0x392ae0376f87d66a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e367c expref: 67 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.259123:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091064e00/0x392ae0376f87d66a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e367c expref: 67 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.259140:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267320576:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065120.268942:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.278248:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.285420:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.286042:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2050 00000100:00100000:0.0:1746065120.286050:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2004:x1830881272230144:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065120.286926:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:2004:x1830881272230144:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 875us (1506us total) trans 4294970727 rc 0/0 00000100:00100000:0.0:1746065120.286932:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2050 00002000:00100000:0.0:1746065120.286938:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fff5f80 x1830881272230144/t4294970727(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.286946:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5f80 with x1830881272230144 ext(0->7) 00010000:00010000:0.0:1746065120.286951:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064e00/0x392ae0376f87d66a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e367c expref: 70 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.286961:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064e00/0x392ae0376f87d66a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e367c expref: 70 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.287036:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff5f80 00000100:00100000:0.0:1746065120.290292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.294990:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.298301:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.306615:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.313146:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.320308:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.331672:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.335223:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.341365:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.347279:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.348247:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2003:x1830881272232576:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 633us (974us total) trans 4294970729 rc 0/0 00000100:00100000:0.0:1746065120.348254:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2055 00002000:00100000:0.0:1746065120.348260:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009fff7480 x1830881272232576/t4294970729(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.348267:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7480 with x1830881272232576 ext(0->7) 00010000:00010000:0.0:1746065120.348272:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10a00/0x392ae0376f87d686 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3698 expref: 75 pid: 21550 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.348281:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd10a00/0x392ae0376f87d686 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3698 expref: 75 pid: 21550 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.348287:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff7480 00000100:00100000:0.0:1746065120.353286:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.362115:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.364933:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.368611:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.372143:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.372197:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.372224:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272233600 00000100:00100000:0.0:1746065120.372230:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272233600 00010000:00010000:0.0:1746065120.372254:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd11400/0x392ae0376f87d68d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e369f expref: 76 pid: 21550 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.372289:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12928 00000100:00100000:0.0:1746065120.372296:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b403c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272233600:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.372305:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.372321:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd11400/0x392ae0376f87d68d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e369f expref: 76 pid: 21550 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.372335:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd11400/0x392ae0376f87d68d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e369f expref: 76 pid: 21550 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.372354:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065120.372380:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b403c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272233600:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.372386:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12928 00000100:00100000:0.0:1746065120.376771:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.390521:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.401522:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.411973:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.413925:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272234240:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1736us (1948us total) trans 4294970730 rc 0/0 00000100:00100000:0.0:1746065120.413933:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2057 00002000:00100000:0.0:1746065120.413940:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009dc10000 x1830881272234240/t4294970730(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.413948:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10000 with x1830881272234240 ext(0->7) 00010000:00010000:0.0:1746065120.413955:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072539a00/0x392ae0376f87d69b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36ad expref: 76 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.413967:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072539a00/0x392ae0376f87d69b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36ad expref: 76 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.413973:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009dc10000 00000100:00100000:0.0:1746065120.423879:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.423941:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.423962:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272234752 00000100:00100000:0.0:1746065120.423969:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272234752 00002000:00100000:0.0:1746065120.423999:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fff7800 x1830881272234752/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.424007:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7800 with x1830881272234752 ext(0->4095) 00002000:00010000:0.0:1746065120.424011:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fff7800 00000100:00100000:0.0:1746065120.424035:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12907 00000100:00100000:0.0:1746065120.424039:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272234752:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065120.424168:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272234752:12345-192.168.202.8@tcp:3:rw_seq_cst_vs_d.0 Request processed in 128us (226us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065120.424173:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12907 00002000:00100000:0.0:1746065120.424177:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->4095) req@ffff88009fff7800 x1830881272234752/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.424183:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7800 with x1830881272234752 ext(0->4095) 00002000:00010000:0.0:1746065120.424186:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fff7800 00000100:00100000:0.0:1746065120.426538:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.429796:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.438910:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.445988:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272235520 00000100:00100000:0.0:1746065120.445997:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272235520 00002000:00100000:0.0:1746065120.446035:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880124a08e00 x1830881272235520/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.446045:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124a08e00 with x1830881272235520 ext(0->7) 00010000:00010000:0.0:1746065120.446052:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072539400/0x392ae0376f87d6a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36bb expref: 77 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.446065:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072539400/0x392ae0376f87d6a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36bb expref: 77 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.446070:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880124a08e00 00000100:00100000:0.0:1746065120.446129:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2059 00000100:00100000:0.0:1746065120.446136:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2003:x1830881272235520:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065120.449882:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2003:x1830881272235520:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 3737us (4269us total) trans 4294970731 rc 0/0 00000100:00100000:0.0:1746065120.449892:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2059 00002000:00100000:0.0:1746065120.449900:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff880124a08e00 x1830881272235520/t4294970731(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.449908:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124a08e00 with x1830881272235520 ext(0->7) 00010000:00010000:0.0:1746065120.449916:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880072539400/0x392ae0376f87d6a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36bb expref: 79 pid: 9642 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.449930:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880072539400/0x392ae0376f87d6a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36bb expref: 79 pid: 9642 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.449936:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880124a08e00 00000100:00100000:0.0:1746065120.451980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.458798:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.460865:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.461545:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.466133:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.467521:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.477568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.501457:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.503756:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272237184:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1800us (2294us total) trans 4294970732 rc 0/0 00000100:00100000:0.0:1746065120.503764:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2061 00002000:00100000:0.0:1746065120.503772:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012fbf8380 x1830881272237184/t4294970732(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.503779:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8380 with x1830881272237184 ext(0->7) 00010000:00010000:0.0:1746065120.503787:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064e00/0x392ae0376f87d6be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36d0 expref: 80 pid: 9560 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.503800:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064e00/0x392ae0376f87d6be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36d0 expref: 80 pid: 9560 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.503806:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fbf8380 00000100:00100000:0.0:1746065120.508589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.513156:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ba3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.513186:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267323648:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065120.513201:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065120.519389:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.522999:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.524860:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.526941:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.528917:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2002:x1830881272238464:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1689us (1974us total) trans 4294970733 rc 0/0 00000100:00100000:0.0:1746065120.528925:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2063 00002000:00100000:0.0:1746065120.528932:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88012fbfbb80 x1830881272238464/t4294970733(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.528940:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfbb80 with x1830881272238464 ext(0->7) 00010000:00010000:0.0:1746065120.528947:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd11e00/0x392ae0376f87d6cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36de expref: 83 pid: 9560 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.528959:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd11e00/0x392ae0376f87d6cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36de expref: 83 pid: 9560 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.528965:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fbfbb80 00000100:00100000:0.0:1746065120.531364:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.535008:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.539884:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.539938:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.542602:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.544068:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.546013:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.549578:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2003:x1830881272239744:12345-192.168.202.8@tcp:4:rw_seq_cst_vs_d.0 Request processed in 2272us (3560us total) trans 4294970734 rc 0/0 00000100:00100000:0.0:1746065120.549587:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2065 00002000:00100000:0.0:1746065120.549595:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x17:0x0] (0->7) req@ffff88009c322a00 x1830881272239744/t4294970734(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:36/0 lens 496/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.549603:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322a00 with x1830881272239744 ext(0->7) 00010000:00010000:0.0:1746065120.549611:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10c00/0x392ae0376f87d6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36f3 expref: 84 pid: 9560 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.549630:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd10c00/0x392ae0376f87d6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e36f3 expref: 84 pid: 9560 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.549636:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c322a00 00000100:00100000:0.0:1746065120.556679:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.578796:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.584567:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.640549:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.645228:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.647512:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.651356:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065120.655714:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065122.575244:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c4d7531-7474-4559-997c-c1b3824c301a:3768:1830881267324928:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.575307:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.575364:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267325440:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.575387:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.575405:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267325952:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.575423:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.575434:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267326464:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.575446:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.575458:0:3768:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746065122.575462:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3768:1830881267325312:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.575477:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.575489:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124a08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267325824:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.575503:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.575513:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267326336:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.575528:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.575548:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267325440:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.575567:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267325184:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.575583:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.575594:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3766:1830881267325696:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.575832:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.576112:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3766:1830881267325696:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.576117:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3766:1830881267326208:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.576136:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.576156:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267325184:0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.576169:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267326208 00000100:00100000:0.0:1746065122.576171:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267326208 00000100:00100000:0.0:1746065122.576188:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1746065122.576193:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3766:x1830881267326208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065122.576526:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3766:x1830881267326208:12345-0@lo:400:kworker.0 Request processed in 333us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.576532:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1746065122.639635:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267326592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065122.639685:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.640132:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267326592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065122.815684:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267326848 00000100:00100000:0.0:1746065122.815691:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267326848 00000100:00100000:0.0:1746065122.815722:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1746065122.815727:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3768:x1830881267326848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746065122.815751:0:7217:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1445990400 avail 1316528128 00000100:00100000:0.0:1746065122.815788:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3768:x1830881267326848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.815793:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1746065124.015291:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267327104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065124.015355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746065124.016010:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065124.016285:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267327104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065124.080006:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267327232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065124.080059:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746065124.080819:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065124.080844:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267327232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065124.304784:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065124.305231:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065124.308663:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.319862:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272241664 00000100:00100000:0.0:1746065124.319871:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272241664 00000100:00100000:0.0:1746065124.322232:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28968 00000100:00100000:0.0:1746065124.322243:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2003:x1830881272241664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065124.322257:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.322273:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f87d766 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e371d expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065124.322295:0:9558:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065124.322310:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.322312:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.322318:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f87d766 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e371d expref: 6 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.322331:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f87d766 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e371d expref: 6 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.322339:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd000, rc 0) 00000100:00100000:0.0:1746065124.322383:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881272241664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 144us (2795us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.322389:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28968 00000100:00080000:0.0:1746065124.327299:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065124.331243:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.334140:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.351007:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272242432 00000100:00100000:0.0:1746065124.351013:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272242432 00010000:00010000:0.0:1746065124.351042:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8c0800/0x392ae0376f87d758 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3716 expref: 12 pid: 11924 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.351076:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12941 00000100:00100000:0.0:1746065124.351099:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881272242432:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065124.351109:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065124.351114:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8c0800/0x392ae0376f87d758 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3716 expref: 12 pid: 11924 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.351128:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8c0800/0x392ae0376f87d758 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3716 expref: 12 pid: 11924 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.351144:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8c0800/0x392ae0376f87d758 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3716 expref: 12 pid: 11924 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.351230:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x43:0x0].0x0 (ffff88009fe2fc00) 00010000:00010000:0.0:1746065124.351234:0:8359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f87d79e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:0.0:1746065124.351242:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f87d79e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21520 initiator: MDT0 00010000:00010000:0.0:1746065124.351247:0:8359:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f87d79e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21520 initiator: MDT0 00010000:00010000:0.0:1746065124.351262:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065124.351280:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2005:x1830881272242432:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 182us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.351286:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12941 00000100:00100000:0.0:1746065124.351652:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272242816 00000100:00100000:0.0:1746065124.351656:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272242816 00000100:00100000:0.0:1746065124.351676:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272243072 00000100:00100000:0.0:1746065124.351678:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272243072 00000100:00100000:0.0:1746065124.351768:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 801 00000100:00100000:0.0:1746065124.351774:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2004:x1830881272242816:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065124.351800:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2004:x1830881272242816:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 27us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.351807:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 801 00000100:00100000:0.0:1746065124.351816:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 802 00000100:00100000:0.0:1746065124.351820:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272243072:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065124.351838:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272243072:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 18us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.351843:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 802 00000100:00080000:0.0:1746065124.351854:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065124.351856:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746065124.362702:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1746065124.362825:0:299:0:(genops.c:863:class_export_destroy()) destroying export ffff880072a48800/eb9e1243-8634-4680-83fd-4b7a1b6b07ce for lustre-OST0001 00000020:00000080:0.0:1746065124.362856:0:299:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880072a4b000 for lustre-OST0001 00000100:00100000:0.0:1746065124.365348:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.367525:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.371419:0:11924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272243840 00000100:00100000:0.0:1746065124.371424:0:11924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272243840 00000100:00100000:0.0:1746065124.371457:0:11924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36512 00000100:00100000:0.0:1746065124.371462:0:11924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:1791:x1830881272243840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065124.371472:0:11924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.371483:0:11924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd600/0x392ae0376f87d7ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3740 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.371539:0:11924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfce00/0x392ae0376f87d7c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x43:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11924 initiator: MDT0 00010000:00010000:0.0:1746065124.371546:0:11924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfce00/0x392ae0376f87d7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11924 initiator: MDT0 00010000:00010000:0.0:1746065124.371553:0:11924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfce00/0x392ae0376f87d7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11924 initiator: MDT0 00000004:00200000:0.0:1746065124.371567:0:11924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x43:0x0]: returning size 0 00000004:00200000:0.0:1746065124.371570:0:11924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065124.371580:0:11924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfce00/0x392ae0376f87d7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11924 initiator: MDT0 00010000:00010000:0.0:1746065124.371593:0:11924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd600/0x392ae0376f87d7ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x43:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3740 expref: 14 pid: 11924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.371611:0:11924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfce00/0x392ae0376f87d7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3740 expref: 13 pid: 11924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.371618:0:11924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x43:0x0].0x0 (ffff88009fe2fc00) 00010000:00010000:0.0:1746065124.371620:0:11924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065124.371623:0:11924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:0.0:1746065124.371704:0:11924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:1791:x1830881272243840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 240us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.371712:0:11924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36512 00000100:00100000:0.0:1746065124.373017:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.375180:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.377002:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.378111:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.380579:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.383026:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.386219:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.390389:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.395417:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.397761:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.400020:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881272245376:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1570us (2254us total) trans 4294971987 rc 0/0 00000100:00100000:0.0:1746065124.400028:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2066 00002000:00100000:0.0:1746065124.400036:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880124a0aa00 x1830881272245376/t4294971987(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:40/0 lens 496/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.400044:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124a0aa00 with x1830881272245376 ext(0->7) 00010000:00010000:0.0:1746065124.400051:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87d7d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e374e expref: 9 pid: 9560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.400072:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87d7d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e374e expref: 9 pid: 9560 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.400078:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124a0aa00 00000100:00100000:0.0:1746065124.403564:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.406745:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.408302:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.415234:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.417371:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.420178:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.422723:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.422801:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.426753:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.428750:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.433425:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.436169:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.438075:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.440033:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.443900:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.447628:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.449775:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.450662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.452786:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.456257:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.460581:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.465768:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.470585:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.472689:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.475903:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.478609:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.494373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.497123:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.504746:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.505831:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2005:x1830881272250624:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 775us (1090us total) trans 4294971988 rc 0/0 00000100:00100000:0.0:1746065124.505838:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2072 00002000:00100000:0.0:1746065124.505844:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f983b80 x1830881272250624/t4294971988(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:40/0 lens 496/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.505851:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983b80 with x1830881272250624 ext(0->7) 00010000:00010000:0.0:1746065124.505856:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87d823 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e379b expref: 11 pid: 9559 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.505865:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87d823 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e379b expref: 11 pid: 9559 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.505871:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f983b80 00000100:00100000:0.0:1746065124.511158:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.514394:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.517845:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.521031:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272251264 00000100:00100000:0.0:1746065124.521036:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272251264 00000100:00100000:0.0:1746065124.521074:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28985 00000100:00100000:0.0:1746065124.521096:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:1791:x1830881272251264:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065124.521104:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.521111:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f87d838 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e37b0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.521123:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.521127:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f87d831 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37a9 expref: 13 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.521131:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.521133:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f87d838 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37b0 expref: 13 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.521154:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f87d831 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37a9 expref: 13 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.521165:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f87d838 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37b0 expref: 13 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.521174:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfde00, rc 0) 00000100:00100000:0.0:1746065124.521193:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:1791:x1830881272251264:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 115us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.521202:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28985 00000100:00100000:0.0:1746065124.525180:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.528836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.533383:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.534534:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.536930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.538435:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.538501:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.541237:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.545519:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.551035:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.555820:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.572961:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.573867:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2005:x1830881272253312:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 710us (912us total) trans 4294971989 rc 0/0 00000100:00100000:0.0:1746065124.573875:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2076 00002000:00100000:0.0:1746065124.573881:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072a1c380 x1830881272253312/t4294971989(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:40/0 lens 496/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.573889:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1c380 with x1830881272253312 ext(0->7) 00010000:00010000:0.0:1746065124.573893:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b000/0x392ae0376f87d846 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37be expref: 13 pid: 9559 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.573903:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b000/0x392ae0376f87d846 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37be expref: 13 pid: 9559 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.573909:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1c380 00000100:00100000:0.0:1746065124.581006:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.584898:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272253824 00000100:00100000:0.0:1746065124.584903:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272253824 00002000:00100000:0.0:1746065124.584932:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8b800 x1830881272253824/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.584939:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8b800 with x1830881272253824 ext(0->4095) 00010000:00010000:0.0:1746065124.584945:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a200/0x392ae0376f87d84d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37c5 expref: 7 pid: 9560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.584954:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a200/0x392ae0376f87d84d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37c5 expref: 7 pid: 9560 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.584959:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8b800 00000100:00100000:0.0:1746065124.584971:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2077 00000100:00100000:0.0:1746065124.584976:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272253824:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065124.585058:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272253824:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 82us (514us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065124.585077:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2077 00002000:00100000:0.0:1746065124.585103:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8b800 x1830881272253824/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.585110:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8b800 with x1830881272253824 ext(0->4095) 00010000:00010000:0.0:1746065124.585113:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a200/0x392ae0376f87d84d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37c5 expref: 7 pid: 9560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.585120:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a200/0x392ae0376f87d84d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37c5 expref: 7 pid: 9560 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.585125:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8b800 00000100:00100000:0.0:1746065124.586654:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.589607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.592051:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272254336 00000100:00100000:0.0:1746065124.592057:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272254336 00000100:00100000:0.0:1746065124.592127:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28990 00000100:00100000:0.0:1746065124.592135:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272254336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065124.592146:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.592159:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f87d85b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e37d3 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.592181:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f87d854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37cc expref: 12 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.592188:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.592189:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.592193:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f87d85b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37d3 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.592216:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f87d854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37cc expref: 12 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.592226:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f87d854 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37cc expref: 12 pid: 9560 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.592236:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267332608:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065124.592325:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000001:00080000:0.0:1746065124.592382:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970734 is committed 00000100:00100000:0.0:1746065124.594579:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.596435:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.598596:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.599892:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.601967:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.603410:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12963 00000100:00100000:0.0:1746065124.603419:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5947050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272255104:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065124.603431:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065124.603449:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f87d85b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37d3 expref: 7 pid: 9560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.603462:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f87d85b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37d3 expref: 7 pid: 9560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.603480:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f87d85b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37d3 expref: 7 pid: 9560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.603509:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.603510:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.603516:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f87d862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37da expref: 13 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.603523:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f87d862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37da expref: 13 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.603547:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f87d862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37da expref: 13 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.603556:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f87d862 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37da expref: 13 pid: 9560 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.603567:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5ea680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267333120:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065124.604043:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.606488:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.608955:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.609615:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.610468:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272255616 00000100:00100000:0.0:1746065124.610472:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272255616 00010000:00010000:0.0:1746065124.610487:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f87d862 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37da expref: 14 pid: 9560 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.610511:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12964 00000100:00100000:0.0:1746065124.610516:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2002:x1830881272255616:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065124.610523:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065124.610537:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f87d862 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37da expref: 14 pid: 9560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.610546:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f87d862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37da expref: 14 pid: 9560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.610561:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f87d862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37da expref: 14 pid: 9560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.610587:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.610588:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.610603:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8aa00/0x392ae0376f87d869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37e1 expref: 13 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.610610:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8aa00/0x392ae0376f87d869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37e1 expref: 13 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.610892:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8aa00/0x392ae0376f87d869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37e1 expref: 13 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.610902:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8aa00/0x392ae0376f87d869 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37e1 expref: 13 pid: 9559 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.610911:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267333376:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065124.610975:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.621653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.625776:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.625958:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.629864:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.633981:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.634942:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272256640 00000100:00100000:0.0:1746065124.634946:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272256640 00000100:00100000:0.0:1746065124.634977:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 28995 00000100:00100000:0.0:1746065124.634982:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1795:x1830881272256640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065124.634993:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.635002:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87d87e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e37f6 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.635016:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a800/0x392ae0376f87d877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37ef expref: 12 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.635022:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.635023:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.635026:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87d87e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37f6 expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.635041:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a800/0x392ae0376f87d877 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37ef expref: 12 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.635050:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a800/0x392ae0376f87d877 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37ef expref: 12 pid: 9635 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.635058:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267333888:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065124.635125:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.639972:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267333888:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065124.639997:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87d87e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e37f6 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.640011:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d184800, rc 0) 00000100:00100000:0.0:1746065124.640051:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1795:x1830881272256640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5068us (5171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.640058:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 28995 00000100:00100000:0.0:1746065124.642938:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.647736:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.649885:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.652829:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.655328:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.658265:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.660119:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.662836:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.666562:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.666610:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.670434:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.675513:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.680183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.682340:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.684987:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.686635:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.688365:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.688826:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272259840 00000100:00100000:0.0:1746065124.688829:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272259840 00000100:00100000:0.0:1746065124.688848:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29002 00000100:00100000:0.0:1746065124.688853:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:1791:x1830881272259840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065124.688859:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.688865:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87d8af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3827 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.688875:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.688878:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87d8a8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3820 expref: 15 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.688883:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.688886:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87d8af lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3827 expref: 15 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.688903:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87d8a8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3820 expref: 15 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.688918:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87d8af lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3827 expref: 15 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.688927:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d185a00, rc 0) 00000100:00100000:0.0:1746065124.688946:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:1791:x1830881272259840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 93us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.688952:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29002 00000100:00100000:0.0:1746065124.690573:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.693783:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.696640:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.697492:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.701220:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.703344:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.703402:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.707737:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.711210:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.714408:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.717518:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.720018:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.723368:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.725594:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.727573:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.730871:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.732598:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.735516:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.737361:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.739434:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.741434:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.743527:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.745441:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.747370:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.752026:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.756694:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.757146:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.759791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.762051:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.762158:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.764564:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.767340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.769893:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.771731:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.778885:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.783375:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.792996:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.799655:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.803879:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.808440:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.812694:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881272267008:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 3303us (4257us total) trans 4294971990 rc 0/0 00000100:00100000:0.0:1746065124.812703:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2092 00002000:00100000:0.0:1746065124.812711:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a09fd180 x1830881272267008/t4294971990(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:40/0 lens 496/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.812720:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fd180 with x1830881272267008 ext(0->7) 00010000:00010000:0.0:1746065124.812728:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a800/0x392ae0376f87d903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e387b expref: 15 pid: 9558 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.812742:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a800/0x392ae0376f87d903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e387b expref: 15 pid: 9558 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.812748:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09fd180 00000100:00100000:0.0:1746065124.815078:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.822483:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267339136:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065124.822500:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065124.822623:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881272267136:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 7367us (7550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.822633:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12987 00000100:00100000:0.0:1746065124.824359:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272267776 00000100:00100000:0.0:1746065124.824364:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272267776 00010000:00010000:0.0:1746065124.824387:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87d90a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3882 expref: 7 pid: 9558 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.824407:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12988 00000100:00100000:0.0:1746065124.824413:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272267776:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065124.824423:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065124.824437:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87d90a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3882 expref: 7 pid: 9558 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.824450:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87d90a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3882 expref: 7 pid: 9558 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.824468:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87d90a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3882 expref: 7 pid: 9558 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.824481:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.824483:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.824488:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87d911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3889 expref: 14 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.824493:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87d911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3889 expref: 14 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.824516:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87d911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3889 expref: 14 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.824526:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267339392:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065124.824573:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.827714:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272268032 00000100:00100000:0.0:1746065124.827719:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272268032 00002000:00100000:0.0:1746065124.827742:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72a680 x1830881272268032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.827750:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a680 with x1830881272268032 ext(0->4095) 00010000:00010000:0.0:1746065124.827755:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87d911 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3889 expref: 17 pid: 9558 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.827770:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87d911 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3889 expref: 17 pid: 9558 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.827776:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72a680 00000100:00100000:0.0:1746065124.827798:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2093 00000100:00100000:0.0:1746065124.827803:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881272268032:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065124.827886:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881272268032:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 82us (243us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065124.827891:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2093 00002000:00100000:0.0:1746065124.827895:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72a680 x1830881272268032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.827902:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a680 with x1830881272268032 ext(0->4095) 00010000:00010000:0.0:1746065124.827906:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87d911 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3889 expref: 17 pid: 9558 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.827914:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87d911 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3889 expref: 17 pid: 9558 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.827918:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72a680 00000100:00100000:0.0:1746065124.829603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.832238:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.834564:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.837960:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.842541:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.847025:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.850763:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.856898:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.859774:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.864044:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.865910:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.870341:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.873857:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.877132:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.877454:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.880253:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.885446:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.889578:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272271488 00000100:00100000:0.0:1746065124.889584:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272271488 00002000:00100000:0.0:1746065124.889614:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8aa00 x1830881272271488/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.889623:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8aa00 with x1830881272271488 ext(0->4095) 00002000:00010000:0.0:1746065124.889627:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8aa00 00000100:00100000:0.0:1746065124.889652:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12938 00000100:00100000:0.0:1746065124.889659:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881272271488:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065124.889778:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881272271488:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 119us (260us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065124.889783:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12938 00002000:00100000:0.0:1746065124.889788:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8aa00 x1830881272271488/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.889794:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8aa00 with x1830881272271488 ext(0->4095) 00002000:00010000:0.0:1746065124.889797:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8aa00 00000100:00100000:0.0:1746065124.891205:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.892997:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.895988:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.897583:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.899560:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.899619:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.901861:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.903728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.903787:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.907943:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272273152 00000100:00100000:0.0:1746065124.907950:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272273152 00002000:00100000:0.0:1746065124.907980:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72aa00 x1830881272273152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.907989:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72aa00 with x1830881272273152 ext(0->4095) 00010000:00010000:0.0:1746065124.907996:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87d957 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e38cf expref: 15 pid: 9558 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065124.908007:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87d957 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e38cf expref: 15 pid: 9558 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065124.908012:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72aa00 00000100:00100000:0.0:1746065124.908027:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2097 00000100:00100000:0.0:1746065124.908032:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2004:x1830881272273152:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065124.908155:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2004:x1830881272273152:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 123us (692us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065124.908161:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2097 00002000:00100000:0.0:1746065124.908167:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72aa00 x1830881272273152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065124.908174:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72aa00 with x1830881272273152 ext(0->4095) 00010000:00010000:0.0:1746065124.908178:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87d957 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e38cf expref: 15 pid: 9558 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065124.908188:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87d957 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e38cf expref: 15 pid: 9558 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065124.908193:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72aa00 00000100:00100000:0.0:1746065124.910879:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.910919:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.915074:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.917639:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.919506:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.922162:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.924261:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.926761:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.929650:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.929694:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.932312:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.937179:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.939970:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.940434:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.944134:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.946676:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.946715:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.950211:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.953236:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.953265:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.956076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.956126:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272276608 00000100:00100000:0.0:1746065124.956131:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272276608 00010000:00010000:0.0:1746065124.956151:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f02ce00/0x392ae0376f87d988 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3900 expref: 15 pid: 9558 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746065124.956178:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13006 00000100:00100000:0.0:1746065124.956183:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2004:x1830881272276608:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065124.956193:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065124.956207:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f02ce00/0x392ae0376f87d988 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3900 expref: 15 pid: 9558 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065124.956216:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f02ce00/0x392ae0376f87d988 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3900 expref: 15 pid: 9558 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065124.956231:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.956232:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.956238:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f02d600/0x392ae0376f87d98f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3907 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.956243:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f02d600/0x392ae0376f87d98f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3907 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.956264:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f02d600/0x392ae0376f87d98f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3907 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.956276:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267344000:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065124.956337:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.959417:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.963792:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.967730:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.968474:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.971413:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.974510:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.975243:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.979049:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.981846:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.981924:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.986044:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.990130:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.993832:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.996469:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065124.999148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.003170:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.003225:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.007377:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.007411:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.012870:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.015228:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.017231:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.019818:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.022625:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.025373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.025958:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272281216 00000100:00100000:0.0:1746065125.025962:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272281216 00000100:00100000:0.0:1746065125.025990:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29044 00000100:00100000:0.0:1746065125.025995:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:1791:x1830881272281216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065125.026002:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065125.026013:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87d9d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e394d expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.026027:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.026031:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b000/0x392ae0376f87d9ce lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3946 expref: 17 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.026035:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065125.026038:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87d9d5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e394d expref: 17 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.026066:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b000/0x392ae0376f87d9ce lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3946 expref: 17 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.026078:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87d9d5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e394d expref: 17 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.026114:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d185a00, rc 0) 00000100:00100000:0.0:1746065125.026131:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:1791:x1830881272281216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 137us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.026135:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29044 00000100:00100000:0.0:1746065125.028017:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.030409:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.033279:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.033324:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.039508:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.047766:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.047873:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.048051:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272282368 00000100:00100000:0.0:1746065125.048054:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272282368 00010000:00010000:0.0:1746065125.048078:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87d9d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e394d expref: 17 pid: 9635 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746065125.050311:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.053562:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.057967:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.061311:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.064783:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.070030:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.071748:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267347328:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065125.071764:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065125.071800:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5945050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881272283264:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6612us (7018us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.071809:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13019 00000100:00100000:0.0:1746065125.072149:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272283648 00000100:00100000:0.0:1746065125.072155:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272283648 00002000:00100000:0.0:1746065125.072182:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8b480 x1830881272283648/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.072190:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8b480 with x1830881272283648 ext(0->4095) 00010000:00010000:0.0:1746065125.072196:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b400/0x392ae0376f87d9ea lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3962 expref: 7 pid: 9635 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.072207:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b400/0x392ae0376f87d9ea lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3962 expref: 7 pid: 9635 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065125.072212:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8b480 00000100:00100000:0.0:1746065125.072233:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2110 00000100:00100000:0.0:1746065125.072239:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272283648:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065125.072943:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272283648:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 704us (1067us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065125.072949:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2110 00002000:00100000:0.0:1746065125.072954:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8b480 x1830881272283648/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.072961:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8b480 with x1830881272283648 ext(0->4095) 00010000:00010000:0.0:1746065125.072965:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b400/0x392ae0376f87d9ea lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3962 expref: 7 pid: 9635 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.072973:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b400/0x392ae0376f87d9ea lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3962 expref: 7 pid: 9635 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065125.072978:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8b480 00000100:00100000:0.0:1746065125.075478:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.078271:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.083932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.088124:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.089249:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881272284288:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 648us (1124us total) trans 4294971991 rc 0/0 00000100:00100000:0.0:1746065125.089255:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2111 00002000:00100000:0.0:1746065125.089261:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a091ca80 x1830881272284288/t4294971991(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:41/0 lens 496/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.089270:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ca80 with x1830881272284288 ext(0->7) 00010000:00010000:0.0:1746065125.089275:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a800/0x392ae0376f87d9f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3969 expref: 17 pid: 9635 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.089284:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a800/0x392ae0376f87d9f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3969 expref: 17 pid: 9635 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065125.089289:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091ca80 00000100:00100000:0.0:1746065125.100409:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.100460:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.108523:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.115575:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.120945:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.123919:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.128755:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.130413:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2004:x1830881272285440:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 908us (1656us total) trans 4294971992 rc 0/0 00000100:00100000:0.0:1746065125.130419:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2113 00002000:00100000:0.0:1746065125.130425:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fff6a00 x1830881272285440/t4294971992(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:41/0 lens 496/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.130431:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6a00 with x1830881272285440 ext(0->7) 00010000:00010000:0.0:1746065125.130436:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87d9ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3977 expref: 19 pid: 9635 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.130445:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87d9ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3977 expref: 19 pid: 9635 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065125.130450:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff6a00 00000100:00100000:0.0:1746065125.131881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.136557:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.136624:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.139501:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.139542:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.142717:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.147599:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.150619:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.156075:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.158257:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.160253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.162280:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.165303:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.168578:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.171506:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.171580:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.179070:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.183384:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.187036:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.192161:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.197186:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.200330:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.202689:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.206162:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.206213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.208715:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.210832:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.213382:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.214864:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.219959:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.221701:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.223318:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.223347:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.225282:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.227560:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.234530:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.238707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.240960:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.241220:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.244725:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.248480:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.253165:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.256406:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.261253:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.265327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.268772:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.272040:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.274988:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.278580:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.283780:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.284638:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:2005:x1830881272295296:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 624us (863us total) trans 4294971993 rc 0/0 00000100:00100000:0.0:1746065125.284644:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2126 00002000:00100000:0.0:1746065125.284649:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d5a1f80 x1830881272295296/t4294971993(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:41/0 lens 496/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.284654:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1f80 with x1830881272295296 ext(0->7) 00010000:00010000:0.0:1746065125.284657:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87da84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e39fc expref: 21 pid: 9558 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.284664:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87da84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e39fc expref: 21 pid: 9558 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065125.284668:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a1f80 00000100:00100000:0.0:1746065125.287667:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.292315:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.297841:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.300050:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.301533:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.305400:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.310463:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.313421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.316488:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.320599:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.325218:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272297344 00000100:00100000:0.0:1746065125.325222:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272297344 00000100:00100000:0.0:1746065125.325245:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29074 00000100:00100000:0.0:1746065125.325250:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1791:x1830881272297344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065125.325258:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065125.325268:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87daa7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3a1f expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.325285:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f02d400/0x392ae0376f87daa0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3a18 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.325292:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.325293:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.325296:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87daa7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3a1f expref: 22 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.325318:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f02d400/0x392ae0376f87daa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3a18 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.325328:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f02d400/0x392ae0376f87daa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3a18 expref: 7 pid: 9558 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746065125.325338:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267354112:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065125.325991:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.328937:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.332068:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.336689:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.338947:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.342970:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.345625:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.349547:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.352383:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.352457:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.354954:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.355244:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.361758:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.368625:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.371443:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.374785:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.375410:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.377619:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.379842:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.388544:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.391995:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.395327:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.399663:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.402512:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.407448:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.408647:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.411329:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.414412:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.418274:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.420642:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.425771:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.429611:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.430484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.433960:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.434024:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.436803:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.440450:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.443507:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.446545:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.449890:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.452945:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.455444:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.456199:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.457565:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.461134:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.467246:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.471829:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.473801:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.476859:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.480709:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.482114:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.483009:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.485376:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.488839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.491165:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.492808:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.494563:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.497496:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.501590:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.503299:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.503332:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.507431:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.509303:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.512205:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.512660:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.515661:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.518522:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.519282:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.524113:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.526022:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.530688:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.534855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.538344:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.540568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.543925:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.550416:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.553669:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.558793:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.561221:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.562891:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2005:x1830881272311296:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 894us (1670us total) trans 4294971994 rc 0/0 00000100:00100000:0.0:1746065125.562899:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2140 00002000:00100000:0.0:1746065125.562905:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f7c0000 x1830881272311296/t4294971994(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:41/0 lens 496/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.562912:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0000 with x1830881272311296 ext(0->7) 00010000:00010000:0.0:1746065125.562918:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8ae00/0x392ae0376f87db5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3ad5 expref: 23 pid: 9560 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.562929:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8ae00/0x392ae0376f87db5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3ad5 expref: 23 pid: 9560 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065125.562936:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0000 00000100:00100000:0.0:1746065125.564690:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.567027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.568628:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.570989:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.571517:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.576885:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.579875:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.583779:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.588529:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.591121:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.591508:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.595854:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.598138:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.601942:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.607745:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.608307:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13078 00000100:00100000:0.0:1746065125.608316:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881272313984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065125.608341:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065125.608609:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b000/0x392ae0376f87db80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3af8 expref: 24 pid: 9560 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.608624:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b000/0x392ae0376f87db80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3af8 expref: 24 pid: 9560 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.608652:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b000/0x392ae0376f87db80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3af8 expref: 24 pid: 9560 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.609513:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.609516:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.609524:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a200/0x392ae0376f87db87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3aff expref: 23 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.609532:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a200/0x392ae0376f87db87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3aff expref: 23 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.609562:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a200/0x392ae0376f87db87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3aff expref: 23 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.609574:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267362432:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065125.609650:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.612798:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.614933:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.619273:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.623041:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.623113:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.626630:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.626688:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.628961:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.634304:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.640524:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.642726:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.645848:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.648555:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.649960:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.650978:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.652389:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.654810:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.656745:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.660674:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.662791:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.664386:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.665985:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.667998:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.671955:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.672708:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.676274:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.678148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.678176:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.680628:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.682932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.683000:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.685654:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.689469:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.692578:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.694302:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.697351:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.699642:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.701483:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.704826:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.707241:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.708794:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.708821:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.713133:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.715012:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.715442:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.717756:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.720161:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.722521:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.724170:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.725973:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.731022:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.732962:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.733910:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d5a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267366912:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065125.733926:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dc05 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3b7d expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.733933:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f02c600, rc 0) 00000100:00100000:0.0:1746065125.733953:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1795:x1830881272323072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2622us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.733959:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29124 00000100:00100000:0.0:1746065125.737924:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.737947:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272323584 00000100:00100000:0.0:1746065125.737953:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272323584 00002000:00100000:0.0:1746065125.737984:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017a300 x1830881272323584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.737993:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017a300 with x1830881272323584 ext(0->4095) 00010000:00010000:0.0:1746065125.738000:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dc05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3b7d expref: 24 pid: 9558 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.738012:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dc05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3b7d expref: 24 pid: 9558 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065125.738023:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017a300 00000100:00100000:0.0:1746065125.738103:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2153 00000100:00100000:0.0:1746065125.738109:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881272323584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065125.738203:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881272323584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 93us (283us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065125.738208:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2153 00002000:00100000:0.0:1746065125.738213:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017a300 x1830881272323584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.738220:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017a300 with x1830881272323584 ext(0->4095) 00010000:00010000:0.0:1746065125.738224:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dc05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3b7d expref: 24 pid: 9558 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.738232:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dc05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3b7d expref: 24 pid: 9558 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065125.738237:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017a300 00000100:00100000:0.0:1746065125.740122:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.741219:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.746803:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.747136:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.750206:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.755163:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.759563:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.761690:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.764263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.768314:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.769999:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.770848:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.773490:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.776009:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.779473:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.784888:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.787291:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.789740:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.791733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.794009:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.794874:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.795942:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.799168:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.801643:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.801715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.804473:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.807635:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.808066:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.810708:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.813673:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.818425:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.820772:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.824460:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.827808:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.829387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.831966:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.834393:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.836670:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.838658:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.844474:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.850187:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.858313:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.860594:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881272330880:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2101us (2277us total) trans 4294971995 rc 0/0 00000100:00100000:0.0:1746065125.860603:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2161 00002000:00100000:0.0:1746065125.860610:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f7c1880 x1830881272330880/t4294971995(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:41/0 lens 496/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.860619:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1880 with x1830881272330880 ext(0->7) 00010000:00010000:0.0:1746065125.860626:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87dc67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3bdf expref: 25 pid: 9558 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.860638:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87dc67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3bdf expref: 25 pid: 9558 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746065125.860854:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c1880 00000100:00100000:0.0:1746065125.863741:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.868186:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.868354:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272331264 00000100:00100000:0.0:1746065125.868360:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272331264 00002000:00100000:0.0:1746065125.868391:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbf800 x1830881272331264/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.868400:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881272331264 ext(0->4095) 00002000:00010000:0.0:1746065125.868403:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbf800 00000100:00100000:0.0:1746065125.868419:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 12992 00000100:00100000:0.0:1746065125.868425:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272331264:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065125.868535:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272331264:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 109us (350us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065125.868540:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 12992 00002000:00100000:0.0:1746065125.868545:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbf800 x1830881272331264/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065125.868868:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881272331264 ext(0->4095) 00002000:00010000:0.0:1746065125.868871:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbf800 00000100:00100000:0.0:1746065125.870010:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.875189:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.876145:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.879681:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f980a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267371136:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065125.879698:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065125.879746:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272331648:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3505us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.879756:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13112 00000100:00100000:0.0:1746065125.879891:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d5a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267371264:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065125.879914:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f02d800/0x392ae0376f87dc7c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3bf4 expref: 26 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.879927:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f02d800, rc 0) 00000100:00100000:0.0:1746065125.879948:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1791:x1830881272331520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3134us (4761us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.879957:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29141 00000100:00100000:0.0:1746065125.881307:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.884364:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.884440:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.887147:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.892219:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.893000:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.897236:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.899506:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.903489:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.905392:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.908184:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.911417:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.913693:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.913740:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.915312:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.917314:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.919288:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.922764:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.925958:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.930194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.932930:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.933599:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.938181:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.942809:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.947613:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.949861:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.952805:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.955865:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.958168:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.958249:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.961340:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.963721:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.968925:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.974850:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.977115:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.982273:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.984748:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.985846:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.990567:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.991077:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.991562:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272338688 00000100:00100000:0.0:1746065125.991565:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272338688 00000100:00100000:0.0:1746065125.991583:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29155 00000100:00100000:0.0:1746065125.991587:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1795:x1830881272338688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065125.991597:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065125.991605:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87dcde lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3c56 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.991619:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dcd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3c4f expref: 26 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.991623:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065125.991624:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065125.991627:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87dcde lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3c56 expref: 26 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.991642:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dcd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3c4f expref: 26 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.991652:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dcd7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3c4f expref: 26 pid: 9559 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746065125.991659:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267374848:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065125.991691:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.995697:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065125.998475:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.001105:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065126.001253:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065126.002653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065126.002799:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065126.004345:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.010201:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.013520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.016001:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.018690:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.021496:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.024330:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.026693:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.031346:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.034974:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.037338:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.041797:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.053128:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.070167:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.085019:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.087717:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2002:x1830881272342272:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1371us (2699us total) trans 4294971996 rc 0/0 00000100:00100000:0.0:1746065126.087725:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2173 00002000:00100000:0.0:1746065126.087732:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012dffc000 x1830881272342272/t4294971996(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 496/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.087739:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffc000 with x1830881272342272 ext(0->7) 00010000:00010000:0.0:1746065126.087745:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f02d600/0x392ae0376f87dd01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3c79 expref: 27 pid: 9559 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.087756:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f02d600/0x392ae0376f87dd01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3c79 expref: 27 pid: 9559 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.087761:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffc000 00000100:00100000:0.0:1746065126.091180:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.095727:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.097729:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.098824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.100440:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.102665:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.105265:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.109359:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272343680 00000100:00100000:0.0:1746065126.109366:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272343680 00002000:00100000:0.0:1746065126.109408:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a3800 x1830881272343680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.109423:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3800 with x1830881272343680 ext(0->4095) 00002000:00010000:0.0:1746065126.109427:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a3800 00000100:00100000:0.0:1746065126.109447:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13005 00000100:00100000:0.0:1746065126.109455:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2005:x1830881272343680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065126.109575:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2005:x1830881272343680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 120us (276us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065126.109580:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13005 00002000:00100000:0.0:1746065126.109586:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a3800 x1830881272343680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.109592:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3800 with x1830881272343680 ext(0->4095) 00002000:00010000:0.0:1746065126.109594:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a3800 00000100:00100000:0.0:1746065126.111202:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.114532:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.117159:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.119284:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.119594:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.124554:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.127674:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.130167:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.130250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.134127:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.138611:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272345600 00000100:00100000:0.0:1746065126.138619:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272345600 00000100:00100000:0.0:1746065126.138661:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29168 00000100:00100000:0.0:1746065126.138668:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:1791:x1830881272345600:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065126.138680:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065126.138689:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d185c00/0x392ae0376f87dd39 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3cb1 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.138937:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065126.138942:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f02dc00/0x392ae0376f87dd32 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3caa expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.138948:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065126.138950:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185c00/0x392ae0376f87dd39 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3cb1 expref: 29 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.138980:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f02dc00/0x392ae0376f87dd32 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3caa expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.139005:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d185c00/0x392ae0376f87dd39 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3cb1 expref: 28 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.139012:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d185c00, rc 0) 00000100:00100000:0.0:1746065126.139045:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:1791:x1830881272345600:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 377us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.139059:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29168 00000100:00100000:0.0:1746065126.142307:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.146270:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.149114:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.152145:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.155030:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.159868:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.160001:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.163445:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.163706:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.169193:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.172465:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.180472:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.196962:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.202044:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:2004:x1830881272348032:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 4850us (5082us total) trans 4294971997 rc 0/0 00000100:00100000:0.0:1746065126.202063:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2179 00002000:00100000:0.0:1746065126.202073:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f9fb800 x1830881272348032/t4294971997(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 496/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.202097:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9fb800 with x1830881272348032 ext(0->7) 00010000:00010000:0.0:1746065126.202105:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f02de00/0x392ae0376f87dd4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3cc6 expref: 29 pid: 9559 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.202119:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f02de00/0x392ae0376f87dd4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3cc6 expref: 29 pid: 9559 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.202125:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9fb800 00000100:00100000:0.0:1746065126.214077:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.233116:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.245209:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.248464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.255946:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.265796:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.268120:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881272349184:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2144us (2327us total) trans 4294971998 rc 0/0 00000100:00100000:0.0:1746065126.268129:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2181 00002000:00100000:0.0:1746065126.268136:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f9f9500 x1830881272349184/t4294971998(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 496/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.268146:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9500 with x1830881272349184 ext(0->7) 00010000:00010000:0.0:1746065126.268153:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87dd5c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3cd4 expref: 31 pid: 9559 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.268165:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87dd5c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3cd4 expref: 31 pid: 9559 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.268171:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9f9500 00000100:00100000:0.0:1746065126.282021:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272349568 00000100:00100000:0.0:1746065126.282028:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272349568 00002000:00100000:0.0:1746065126.282069:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a2a00 x1830881272349568/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.282077:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2a00 with x1830881272349568 ext(0->4095) 00002000:00010000:0.0:1746065126.282099:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a2a00 00000100:00100000:0.0:1746065126.282123:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13011 00000100:00100000:0.0:1746065126.282129:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272349568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065126.282233:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272349568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 104us (1080us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065126.282238:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13011 00002000:00100000:0.0:1746065126.282242:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a2a00 x1830881272349568/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.282249:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2a00 with x1830881272349568 ext(0->4095) 00002000:00010000:0.0:1746065126.282252:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a2a00 00000100:00100000:0.0:1746065126.283188:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.286472:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.286580:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.286614:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272349952 00000100:00100000:0.0:1746065126.286620:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272349952 00010000:00010000:0.0:1746065126.286648:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87dd63 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3cdb expref: 7 pid: 9559 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746065126.286683:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13147 00000100:00100000:0.0:1746065126.286690:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272349952:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065126.286700:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065126.286716:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87dd63 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3cdb expref: 7 pid: 9559 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.286725:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87dd63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3cdb expref: 7 pid: 9559 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.286744:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.286746:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.286751:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87dd6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3ce2 expref: 31 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.286758:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87dd6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3ce2 expref: 31 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.286785:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87dd6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3ce2 expref: 31 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065126.286795:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267380096:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065126.286857:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.290531:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.296455:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.303937:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.308025:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.310410:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.311561:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.315507:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.315554:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.319658:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.322731:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.326005:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.328512:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.331825:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.335284:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.337613:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.343712:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.350574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.353511:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.357061:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.362534:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.365571:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.368567:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.374103:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.374618:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.378871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.380699:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.382386:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.384043:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.386219:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.388447:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.391604:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.394604:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.396334:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.400373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.402825:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.410467:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.412202:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.412263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.414692:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.416507:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.419663:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.423860:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.427806:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.430242:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.433259:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.436327:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.439194:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.442263:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.445296:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.446818:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881272359040:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 735us (1527us total) trans 4294971999 rc 0/0 00000100:00100000:0.0:1746065126.446824:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2191 00002000:00100000:0.0:1746065126.446829:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f84b100 x1830881272359040/t4294971999(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 496/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.446835:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84b100 with x1830881272359040 ext(0->7) 00010000:00010000:0.0:1746065126.446840:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87dde1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3d59 expref: 33 pid: 9560 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.446848:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87dde1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3d59 expref: 33 pid: 9560 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.446853:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f84b100 00000100:00100000:0.0:1746065126.448753:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.454003:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.454715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.456954:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.457390:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.460525:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.462407:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.465600:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.467875:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.470635:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.473853:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.475671:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.476242:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272361216 00000100:00100000:0.0:1746065126.476245:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272361216 00000100:00100000:0.0:1746065126.476262:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29198 00000100:00100000:0.0:1746065126.476266:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1795:x1830881272361216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065126.476272:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065126.476279:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87de0b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3d83 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.476288:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.476291:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87de04 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3d7c expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.476296:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065126.476298:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87de0b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3d83 expref: 35 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.476317:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87de04 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3d7c expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.476327:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87de0b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3d83 expref: 35 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.476336:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d184c00, rc 0) 00000100:00100000:0.0:1746065126.476353:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1795:x1830881272361216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.476358:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29198 00000100:00100000:0.0:1746065126.478217:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.480616:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.483340:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.486517:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.488708:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.490634:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.496811:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.497039:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.499031:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.500995:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.505775:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.509316:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.512895:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.515631:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.518510:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.520430:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.522483:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.525289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.527434:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.530485:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.533740:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.537540:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.540730:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.544921:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.545170:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.547833:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.550882:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.557491:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.567342:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.573318:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.577002:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.578295:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272366976 00000100:00100000:0.0:1746065126.578300:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272366976 00000100:00100000:0.0:1746065126.578336:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29209 00000100:00100000:0.0:1746065126.578341:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1791:x1830881272366976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065126.578354:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065126.578365:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d185000/0x392ae0376f87de58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3dd0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.578385:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f02d400/0x392ae0376f87de51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dc9 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.578391:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.578392:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.578395:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185000/0x392ae0376f87de58 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dd0 expref: 34 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.578413:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f02d400/0x392ae0376f87de51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dc9 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.578422:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f02d400/0x392ae0376f87de51 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dc9 expref: 6 pid: 9560 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746065126.578431:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267388672:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065126.578472:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.585181:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000001:00080000:0.0:1746065126.595454:0:7194:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983588 is committed 00000001:00080000:0.0:1746065126.595480:0:7194:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983586 is committed 00000004:00080000:0.0:1746065126.595488:0:7194:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000004:00080000:0.0:1746065126.595503:0:7194:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000100:00080000:0.0:1746065126.597484:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065126.604190:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.613935:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.613960:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.634483:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.634535:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272368000 00000100:00100000:0.0:1746065126.634542:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272368000 00002000:00100000:0.0:1746065126.636300:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800979a4380 x1830881272368000/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 496/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.636308:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4380 with x1830881272368000 ext(0->7) 00010000:00010000:0.0:1746065126.636313:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185000/0x392ae0376f87de58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dd0 expref: 34 pid: 9560 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.636322:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185000/0x392ae0376f87de58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dd0 expref: 34 pid: 9560 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.636327:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a4380 00000100:00100000:0.0:1746065126.636348:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2198 00000100:00100000:0.0:1746065126.636353:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881272368000:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00080000:0.0:1746065126.636445:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065126.637713:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2004:x1830881272368000:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1356us (23776us total) trans 4294972000 rc 0/0 00000100:00100000:0.0:1746065126.637720:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2198 00002000:00100000:0.0:1746065126.637726:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800979a4380 x1830881272368000/t4294972000(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 496/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.637734:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4380 with x1830881272368000 ext(0->7) 00010000:00010000:0.0:1746065126.637739:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185000/0x392ae0376f87de58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dd0 expref: 36 pid: 9560 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.637749:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185000/0x392ae0376f87de58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dd0 expref: 36 pid: 9560 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.637754:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a4380 00000100:00100000:0.0:1746065126.639453:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.645479:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.654735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.661373:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.669494:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.701898:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.701954:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.707437:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.713447:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.720180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.722777:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e3ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.727744:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.749966:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.750804:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881272370304:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 645us (845us total) trans 4294972002 rc 0/0 00000100:00100000:0.0:1746065126.750810:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2202 00002000:00100000:0.0:1746065126.750816:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4e9f80 x1830881272370304/t4294972002(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 496/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.750823:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9f80 with x1830881272370304 ext(0->7) 00010000:00010000:0.0:1746065126.750827:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f87de7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dec expref: 39 pid: 9559 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.750835:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f87de7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dec expref: 39 pid: 9559 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.750840:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9f80 00000100:00100000:0.0:1746065126.767415:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.769683:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.775328:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.782752:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.785901:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.791642:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.798263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.800600:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:2004:x1830881272371456:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1866us (2337us total) trans 4294972003 rc 0/0 00000100:00100000:0.0:1746065126.800608:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2204 00002000:00100000:0.0:1746065126.800615:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4e8700 x1830881272371456/t4294972003(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 496/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.800622:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8700 with x1830881272371456 ext(0->7) 00010000:00010000:0.0:1746065126.800629:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f02de00/0x392ae0376f87de89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dfa expref: 41 pid: 9560 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.800641:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f02de00/0x392ae0376f87de89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3dfa expref: 41 pid: 9560 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.800647:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e8700 00000100:00100000:0.0:1746065126.802078:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.805411:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.817467:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.823799:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.827543:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.827600:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272372480 00000100:00100000:0.0:1746065126.827605:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272372480 00002000:00100000:0.0:1746065126.827633:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9180 x1830881272372480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.827642:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9180 with x1830881272372480 ext(0->4095) 00010000:00010000:0.0:1746065126.827649:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c800/0x392ae0376f87de97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e08 expref: 42 pid: 9560 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.827659:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f02c800/0x392ae0376f87de97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e08 expref: 42 pid: 9560 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.827665:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9180 00000100:00100000:0.0:1746065126.827690:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2205 00000100:00100000:0.0:1746065126.827695:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881272372480:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065126.827787:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881272372480:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 92us (245us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065126.827793:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2205 00002000:00100000:0.0:1746065126.827797:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9180 x1830881272372480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.827803:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9180 with x1830881272372480 ext(0->4095) 00010000:00010000:0.0:1746065126.827807:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c800/0x392ae0376f87de97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e08 expref: 42 pid: 9560 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.827815:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f02c800/0x392ae0376f87de97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e08 expref: 42 pid: 9560 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.827820:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9180 00000100:00100000:0.0:1746065126.829875:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.834791:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.838834:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.843524:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.844951:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.845012:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272373248 00000100:00100000:0.0:1746065126.845015:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272373248 00000100:00100000:0.0:1746065126.845039:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29221 00000100:00100000:0.0:1746065126.845073:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:1791:x1830881272373248:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065126.845100:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065126.845113:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87deac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3e1d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.845129:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dea5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e16 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.845134:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.845135:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.845138:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87deac lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e1d expref: 42 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.845153:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dea5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e16 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.845166:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87dea5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e16 expref: 6 pid: 9560 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746065126.845173:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0918e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267391744:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065126.845206:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.852875:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.855552:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.861520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.871872:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.872872:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2004:x1830881272374144:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 733us (1005us total) trans 4294972004 rc 0/0 00000100:00100000:0.0:1746065126.872879:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2207 00002000:00100000:0.0:1746065126.872885:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a0918700 x1830881272374144/t4294972004(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:42/0 lens 496/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.872892:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918700 with x1830881272374144 ext(0->7) 00010000:00010000:0.0:1746065126.872896:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87deac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e1d expref: 43 pid: 9560 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.872905:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87deac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e1d expref: 43 pid: 9560 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746065126.872911:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918700 00000100:00100000:0.0:1746065126.895927:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.897470:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13194 00000100:00100000:0.0:1746065126.897481:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2002:x1830881272374272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065126.897495:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065126.897511:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87deac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e1d expref: 43 pid: 9560 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.897522:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87deac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e1d expref: 43 pid: 9560 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.897540:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87deac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e1d expref: 43 pid: 9560 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065126.897571:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.897572:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.897579:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9600/0x392ae0376f87deb3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e24 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.897586:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9600/0x392ae0376f87deb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e24 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.897613:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9600/0x392ae0376f87deb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e24 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065126.897623:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0918380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267392128:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065126.897699:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.901255:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.905725:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.905749:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272374656 00000100:00100000:0.0:1746065126.905755:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272374656 00002000:00100000:0.0:1746065126.905792:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091a300 x1830881272374656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.905800:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091a300 with x1830881272374656 ext(0->4095) 00010000:00010000:0.0:1746065126.905807:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9600/0x392ae0376f87deb3 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e24 expref: 7 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065126.905819:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9600/0x392ae0376f87deb3 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e24 expref: 7 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065126.905825:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091a300 00000100:00100000:0.0:1746065126.905840:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2208 00000100:00100000:0.0:1746065126.905845:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272374656:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065126.905949:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272374656:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (230us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065126.905954:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2208 00002000:00100000:0.0:1746065126.905959:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091a300 x1830881272374656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065126.905965:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091a300 with x1830881272374656 ext(0->4095) 00010000:00010000:0.0:1746065126.905969:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9600/0x392ae0376f87deb3 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e24 expref: 7 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065126.905976:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9600/0x392ae0376f87deb3 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3e24 expref: 7 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065126.905980:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091a300 00000100:00100000:0.0:1746065126.908576:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.910758:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.914190:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.916845:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.919841:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.926000:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.928532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.931384:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.931427:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.940200:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.942553:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.945277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.947702:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.952671:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.956164:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.958621:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.963478:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.963522:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.967788:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.971970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.975521:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.977579:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.980064:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.981202:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.983749:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.986695:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.987517:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.991236:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.994753:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065126.998515:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.001755:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.003650:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.005474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.009916:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.011819:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.011884:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.017688:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.020971:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.024515:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.031176:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.033373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.035259:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.039687:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.042612:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.049804:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.058840:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.064878:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.064926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.071217:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.074146:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.074183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.078355:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.082050:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.085980:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.089254:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.125479:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.125568:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.126742:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124a09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272384512:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1013us (1268us total) trans 4294972005 rc 0/0 00000100:00100000:0.0:1746065127.126748:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2218 00002000:00100000:0.0:1746065127.126753:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880124a09c00 x1830881272384512/t4294972005(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 496/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.126760:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124a09c00 with x1830881272384512 ext(0->7) 00010000:00010000:0.0:1746065127.126765:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87df38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3ea9 expref: 46 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.126774:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87df38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3ea9 expref: 46 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.126779:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124a09c00 00000100:00100000:0.0:1746065127.135861:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.138807:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.144177:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.149537:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.152831:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.155478:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.159122:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.159161:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.161070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.162491:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.165322:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.168483:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.172021:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.174961:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.176825:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.182563:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.182644:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.189506:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.189587:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.192698:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.196260:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.199977:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.201871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.205116:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.208750:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.210995:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.213711:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.218005:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.219960:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.222312:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.224879:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.230904:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.234345:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.236169:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.238992:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.241752:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.276214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.282701:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272391552 00000100:00100000:0.0:1746065127.282708:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272391552 00000100:00100000:0.0:1746065127.282759:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29256 00000100:00100000:0.0:1746065127.282766:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:1791:x1830881272391552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065127.282784:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.282797:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87dfa1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e3f12 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.282824:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87df9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f0b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.282830:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.282832:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.282835:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87dfa1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f12 expref: 48 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.282860:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87df9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f0b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.282871:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87df9a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f0b expref: 6 pid: 9560 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065127.282882:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267400704:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065127.283046:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.284171:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.284694:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267400704:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065127.284711:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87dfa1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f12 expref: 47 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.284722:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072568600, rc 0) 00000100:00100000:0.0:1746065127.284743:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:1791:x1830881272391552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1978us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.284750:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29256 00000100:00100000:0.0:1746065127.286692:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.289016:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.292444:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.296214:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.297696:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2005:x1830881272392448:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 989us (1486us total) trans 4294972007 rc 0/0 00000100:00100000:0.0:1746065127.297703:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2227 00002000:00100000:0.0:1746065127.297709:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88007253ea00 x1830881272392448/t4294972007(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 496/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.297716:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253ea00 with x1830881272392448 ext(0->7) 00010000:00010000:0.0:1746065127.297721:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87dfa1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f12 expref: 49 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.297730:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f87dfa1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f12 expref: 49 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.297736:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253ea00 00000100:00100000:0.0:1746065127.302202:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.305180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.306271:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272392960 00000100:00100000:0.0:1746065127.306275:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272392960 00002000:00100000:0.0:1746065127.306301:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918e00 x1830881272392960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.306310:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918e00 with x1830881272392960 ext(0->4095) 00010000:00010000:0.0:1746065127.306316:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb000/0x392ae0376f87dfa8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f19 expref: 7 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.306326:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb000/0x392ae0376f87dfa8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f19 expref: 7 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.306331:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918e00 00000100:00100000:0.0:1746065127.308052:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.309603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.311720:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.313556:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.316593:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.318075:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.320047:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.328322:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.328396:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.332564:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.334941:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.336555:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.338494:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.340610:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.343489:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.348313:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.350915:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.352574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.361391:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.365917:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.369424:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.369477:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.372841:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.377145:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.383814:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.384598:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13060 00000100:00100000:0.0:1746065127.384606:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881272397952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065127.384718:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881272397952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (904us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065127.384724:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13060 00002000:00100000:0.0:1746065127.384729:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ea00 x1830881272397952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.384736:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ea00 with x1830881272397952 ext(0->4095) 00002000:00010000:0.0:1746065127.384738:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549ea00 00000100:00100000:0.0:1746065127.387199:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.390569:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.394785:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.395503:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.400026:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.403306:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.406178:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.409895:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.420822:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.420983:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.427269:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.431186:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.438868:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.442487:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.443556:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+51:2005:x1830881272400768:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 879us (1072us total) trans 4294972008 rc 0/0 00000100:00100000:0.0:1746065127.443563:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2236 00002000:00100000:0.0:1746065127.443568:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d1e1c00 x1830881272400768/t4294972008(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 496/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.443575:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1c00 with x1830881272400768 ext(0->7) 00010000:00010000:0.0:1746065127.443580:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e011 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f82 expref: 51 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.443589:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e011 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f82 expref: 51 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.443594:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e1c00 00000100:00100000:0.0:1746065127.446568:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.446607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.448397:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.449805:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.451543:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.454229:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.456534:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.458631:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2005:x1830881272401920:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1955us (2091us total) trans 4294972009 rc 0/0 00000100:00100000:0.0:1746065127.458640:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2238 00002000:00100000:0.0:1746065127.458647:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009faf9c00 x1830881272401920/t4294972009(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 496/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.458661:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9c00 with x1830881272401920 ext(0->7) 00010000:00010000:0.0:1746065127.458667:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e01f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f90 expref: 53 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.458680:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e01f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3f90 expref: 53 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.458686:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009faf9c00 00000100:00100000:0.0:1746065127.461198:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.464273:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.464329:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.467218:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.467559:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.470795:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.473835:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.476333:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.477989:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.479601:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.481214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.482589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.483817:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.486472:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.488966:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.492287:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.494405:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2003:x1830881272404608:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1962us (2113us total) trans 4294972010 rc 0/0 00000100:00100000:0.0:1746065127.494417:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2241 00002000:00100000:0.0:1746065127.494424:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d4a1180 x1830881272404608/t4294972010(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 496/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.494432:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1180 with x1830881272404608 ext(0->7) 00010000:00010000:0.0:1746065127.494438:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f87e042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fb3 expref: 55 pid: 9635 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.494451:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f87e042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fb3 expref: 55 pid: 9635 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.494457:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1180 00000100:00100000:0.0:1746065127.504544:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.507291:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.516776:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.516865:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.522498:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.526570:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272405760 00000100:00100000:0.0:1746065127.526577:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272405760 00010000:00010000:0.0:1746065127.526608:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fc1 expref: 56 pid: 9635 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065127.526633:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13254 00000100:00100000:0.0:1746065127.526639:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881272405760:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.526649:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.526665:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fc1 expref: 56 pid: 9635 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.526681:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fc1 expref: 56 pid: 9635 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.526700:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e050 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fc1 expref: 56 pid: 9635 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.526728:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.526730:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.526735:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fbe00/0x392ae0376f87e057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fc8 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.526742:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09fbe00/0x392ae0376f87e057 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fc8 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.526769:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09fbe00/0x392ae0376f87e057 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fc8 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065127.526780:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267407488:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065127.526849:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.530780:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.536032:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.540989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.541098:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.544305:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.546962:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.551238:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272407040 00000100:00100000:0.0:1746065127.551245:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272407040 00002000:00100000:0.0:1746065127.551273:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a6d80 x1830881272407040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.551281:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a6d80 with x1830881272407040 ext(0->4095) 00002000:00010000:0.0:1746065127.551285:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a6d80 00000100:00100000:0.0:1746065127.551300:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13069 00000100:00100000:0.0:1746065127.551306:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2003:x1830881272407040:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:0.0:1746065127.551415:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2003:x1830881272407040:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 109us (231us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065127.551421:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13069 00002000:00100000:0.0:1746065127.551426:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a6d80 x1830881272407040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.551432:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a6d80 with x1830881272407040 ext(0->4095) 00002000:00010000:0.0:1746065127.551435:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a6d80 00000100:00100000:0.0:1746065127.561802:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.574051:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.575146:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.576110:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881272407424:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 861us (962us total) trans 4294972011 rc 0/0 00000100:00100000:0.0:1746065127.576118:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2245 00002000:00100000:0.0:1746065127.576124:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fb64e00 x1830881272407424/t4294972011(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 496/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.576132:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64e00 with x1830881272407424 ext(0->7) 00010000:00010000:0.0:1746065127.576139:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f02de00/0x392ae0376f87e065 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fd6 expref: 58 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.576149:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f02de00/0x392ae0376f87e065 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fd6 expref: 58 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.576160:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64e00 00000100:00100000:0.0:1746065127.577163:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.580906:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.584073:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267408768:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.584118:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065127.584133:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3766:1830881267409280:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.584153:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267408768 00000100:00100000:0.0:1746065127.584156:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267408768 00000100:00100000:0.0:1746065127.584176:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1746065127.584181:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3766:x1830881267408768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.584207:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3766:x1830881267408768:12345-0@lo:400:kworker.0 Request processed in 27us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.584212:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1746065127.584227:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830881267408896:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.585409:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065127.585424:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3766:1830881267409792:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.585442:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065127.585458:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267408768:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.585472:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065127.585483:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009549f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267409408:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.586513:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3766:1830881267409280:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.586521:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3766:1830881267409792:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.586536:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065127.586549:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267409920:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.586563:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065127.586577:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830881267408896:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.586589:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267409408 00000100:00100000:0.0:1746065127.586591:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267409408 00000100:00100000:0.0:1746065127.586606:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267409920 00000100:00100000:0.0:1746065127.586607:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267409920 00000100:00100000:0.0:1746065127.586618:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1746065127.586622:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267409408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.586645:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267409408:12345-0@lo:400:kworker.0 Request processed in 23us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.586649:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1746065127.586658:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:0.0:1746065127.586662:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267409920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.586679:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267409920:12345-0@lo:400:kworker.0 Request processed in 17us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.586683:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:0.0:1746065127.586698:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009549f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267409408:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.586704:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267409920:0@lo:400:kworker.0 00000100:00100000:0.0:1746065127.589725:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.597195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.600484:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.602888:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272408448:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1649us (2402us total) trans 4294972012 rc 0/0 00000100:00100000:0.0:1746065127.602897:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2247 00002000:00100000:0.0:1746065127.602912:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009ea75f80 x1830881272408448/t4294972012(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 496/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.602920:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881272408448 ext(0->7) 00010000:00010000:0.0:1746065127.602927:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87e073 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fe4 expref: 59 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.602939:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f02c600/0x392ae0376f87e073 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3fe4 expref: 59 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.602945:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea75f80 00000100:00100000:0.0:1746065127.605366:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.608067:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.610426:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.612774:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.614728:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.617841:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.619892:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.621360:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881272409600:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 847us (1465us total) trans 4294972013 rc 0/0 00000100:00100000:0.0:1746065127.621366:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2249 00002000:00100000:0.0:1746065127.621371:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012f085c00 x1830881272409600/t4294972013(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 496/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.621383:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f085c00 with x1830881272409600 ext(0->7) 00010000:00010000:0.0:1746065127.621388:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e081 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3ff2 expref: 61 pid: 9558 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.621398:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e081 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3ff2 expref: 61 pid: 9558 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.621403:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f085c00 00000100:00100000:0.0:1746065127.625254:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.629055:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c321c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267410944:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065127.629074:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.629118:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881272409728:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3711us (3872us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.629127:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13261 00000100:00100000:0.0:1746065127.631645:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.631680:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.634182:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.635864:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.635922:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.638268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.640282:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.642787:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.646062:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.648749:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.650943:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.654550:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.655740:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.658333:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.661239:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.666384:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.668218:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.670645:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.674567:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.677531:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.680291:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.683184:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.683690:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.688187:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.691872:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.697654:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.703829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.708337:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.708873:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.712380:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272415232 00000100:00100000:0.0:1746065127.712386:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272415232 00002000:00100000:0.0:1746065127.712418:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f2d80 x1830881272415232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.712427:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2d80 with x1830881272415232 ext(0->4095) 00010000:00010000:0.0:1746065127.712432:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e0ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e403f expref: 7 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.712442:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e0ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e403f expref: 7 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.712452:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f2d80 00000100:00100000:0.0:1746065127.712479:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2255 00000100:00100000:0.0:1746065127.712485:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272415232:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065127.712583:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272415232:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 99us (435us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065127.712588:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2255 00002000:00100000:0.0:1746065127.712593:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f2d80 x1830881272415232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.712600:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2d80 with x1830881272415232 ext(0->4095) 00010000:00010000:0.0:1746065127.712604:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e0ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e403f expref: 7 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.712613:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e0ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e403f expref: 7 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.712618:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f2d80 00000100:00100000:0.0:1746065127.714870:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.717819:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.736314:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.737424:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:2003:x1830881272415872:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 876us (1118us total) trans 4294972014 rc 0/0 00000100:00100000:0.0:1746065127.737429:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2256 00002000:00100000:0.0:1746065127.737433:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009385b480 x1830881272415872/t4294972014(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 496/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.737442:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b480 with x1830881272415872 ext(0->7) 00010000:00010000:0.0:1746065127.737445:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e0d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4046 expref: 63 pid: 9560 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.737454:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e0d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4046 expref: 63 pid: 9560 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.737459:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385b480 00000100:00100000:0.0:1746065127.741838:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.744881:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267414144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065127.747528:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.752127:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.752309:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.755585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.758466:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.760128:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.762811:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.764842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.770941:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.772818:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.773901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.774893:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.777411:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.779464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.779532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.782373:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.784707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.784749:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.788126:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.790880:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.794112:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.796151:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.798676:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.801374:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.803865:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.803903:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.807320:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.810308:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.813569:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.815068:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.817636:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.819855:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.819890:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.822749:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.825636:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.828661:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.830187:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.832967:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.838740:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.839982:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.842971:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.844474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.848833:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.867063:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.878041:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.886008:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.891497:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2005:x1830881272424192:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 5267us (5485us total) trans 4294972015 rc 0/0 00000100:00100000:0.0:1746065127.891508:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2265 00002000:00100000:0.0:1746065127.891519:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012f728a80 x1830881272424192/t4294972015(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:43/0 lens 496/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065127.891528:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728a80 with x1830881272424192 ext(0->7) 00010000:00010000:0.0:1746065127.891538:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40b6 expref: 65 pid: 9560 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.891552:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40b6 expref: 65 pid: 9560 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746065127.891558:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f728a80 00000100:00100000:0.0:1746065127.899788:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.924152:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.928389:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.931895:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.937514:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.956238:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.958524:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29319 00000100:00100000:0.0:1746065127.958536:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272425216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065127.958553:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.958572:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f87e15a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e40cb expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.958602:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fac00/0x392ae0376f87e153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40c4 expref: 64 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.958609:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065127.958610:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065127.958613:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f87e15a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40cb expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.958641:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09fac00/0x392ae0376f87e153 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40c4 expref: 64 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.958651:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a09fac00/0x392ae0376f87e153 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40c4 expref: 64 pid: 9559 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065127.958662:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267418880:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065127.958756:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.975990:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.979342:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272425472 00000100:00100000:0.0:1746065127.979348:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272425472 00000100:00100000:0.0:1746065127.979383:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29320 00000100:00100000:0.0:1746065127.979389:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:1791:x1830881272425472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065127.979400:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.979412:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87e161 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e40d2 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.979429:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065127.979435:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f87e15a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40cb expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.979439:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065127.979442:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87e161 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40d2 expref: 69 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.979472:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f87e15a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40cb expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.979481:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87e161 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40d2 expref: 69 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.979489:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:0.0:1746065127.979537:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:1791:x1830881272425472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 147us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.979542:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29320 00000100:00100000:0.0:1746065127.984154:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.988386:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.992230:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.996307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065127.998237:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.001876:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.005615:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.007019:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065128.007442:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065128.009903:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.013601:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.025456:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.028458:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:2004:x1830881272427520:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 773us (3005us total) trans 4294972017 rc 0/0 00000100:00100000:0.0:1746065128.028465:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2270 00002000:00100000:0.0:1746065128.028471:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a091f100 x1830881272427520/t4294972017(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:44/0 lens 496/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065128.028479:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f100 with x1830881272427520 ext(0->7) 00010000:00010000:0.0:1746065128.028484:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e16f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40e0 expref: 69 pid: 9559 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.028494:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e16f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e40e0 expref: 69 pid: 9559 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746065128.028499:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091f100 00000100:00100000:0.0:1746065128.030462:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.032635:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.034798:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.035285:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.037599:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.039366:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.043024:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.046324:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.049979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.054463:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.056317:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.057766:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.058524:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.061464:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.071388:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.076309:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.078563:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.081162:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.084116:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.086041:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.086579:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.089266:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.094244:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.096952:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.099145:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.100622:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.102732:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.105863:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.108837:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.110027:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.112204:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.115547:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.118249:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.118877:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.126444:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.134303:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.134388:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.138922:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.144045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.147788:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.150970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.154188:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.158574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.158685:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.162845:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.163954:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.167941:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.172176:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.173409:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13311 00000100:00100000:0.0:1746065128.173417:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:2005:x1830881272435840:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.173429:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.173445:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb000/0x392ae0376f87e1df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4150 expref: 70 pid: 9635 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.173457:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb000/0x392ae0376f87e1df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4150 expref: 70 pid: 9635 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.173476:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb000/0x392ae0376f87e1df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4150 expref: 70 pid: 9635 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.173847:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.173850:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.173856:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e1e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4157 expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.173864:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e1e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4157 expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.173895:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e1e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4157 expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.173910:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267424128:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065128.173980:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.175653:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.177376:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.183849:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.187387:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.190221:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.192902:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.208059:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.211479:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.217612:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272437760 00000100:00100000:0.0:1746065128.217618:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272437760 00000100:00100000:0.0:1746065128.217739:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29343 00000100:00100000:0.0:1746065128.217746:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272437760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065128.217759:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.217772:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f87e202 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4173 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.217793:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f02de00/0x392ae0376f87e1fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e416c expref: 68 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.217798:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065128.217800:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065128.217802:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f87e202 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4173 expref: 7 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.217828:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f02de00/0x392ae0376f87e1fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e416c expref: 68 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.217847:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f02de00/0x392ae0376f87e1fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e416c expref: 68 pid: 9558 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.217857:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267425024:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065128.219133:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.221306:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.224628:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.224710:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.227438:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.228972:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.232389:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.240211:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.244322:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.247490:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.254495:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.254533:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.257335:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.261617:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.263752:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.265317:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.267876:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.269962:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:2004:x1830881272440448:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 700us (2086us total) trans 4294972018 rc 0/0 00000100:00100000:0.0:1746065128.269971:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2282 00002000:00100000:0.0:1746065128.269976:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880093859500 x1830881272440448/t4294972018(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:44/0 lens 496/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065128.269983:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859500 with x1830881272440448 ext(0->7) 00010000:00010000:0.0:1746065128.269988:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e21e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e418f expref: 71 pid: 9635 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.269996:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e21e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e418f expref: 71 pid: 9635 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746065128.270001:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859500 00000100:00100000:0.0:1746065128.272411:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.272582:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13320 00000100:00100000:0.0:1746065128.272589:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:2003:x1830881272440576:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.272601:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.272666:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e21e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e418f expref: 71 pid: 9635 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.272677:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e21e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e418f expref: 71 pid: 9635 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.272695:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e21e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e418f expref: 71 pid: 9635 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.272715:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.272717:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.272723:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e225 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4196 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.272731:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4196 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.272755:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4196 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.272764:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009385a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267426432:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065128.272979:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.275711:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.276817:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.279426:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.279462:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.281443:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.283416:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.285903:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.287874:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.293236:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.295212:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.297263:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.299211:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.301412:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.303601:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.306733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.309714:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.313577:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.317892:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.322147:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.322656:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.327381:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.327955:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272444288 00000100:00100000:0.0:1746065128.327959:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272444288 00010000:00010000:0.0:1746065128.327973:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e24f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e41c0 expref: 7 pid: 9635 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.328003:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13327 00000100:00100000:0.0:1746065128.328008:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272444288:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.328016:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.328041:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e24f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e41c0 expref: 7 pid: 9635 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.328050:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e24f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e41c0 expref: 7 pid: 9635 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.328065:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e24f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e41c0 expref: 7 pid: 9635 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.328074:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.328076:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.328105:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e256 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e41c7 expref: 71 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.328112:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e41c7 expref: 71 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.328130:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e41c7 expref: 71 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.328139:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e256 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e41c7 expref: 71 pid: 9558 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.328148:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d510700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267428352:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065128.328342:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.329886:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.331906:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.334629:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.336575:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.339591:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.342906:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.346124:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.346195:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.348965:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.351858:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.354172:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.356651:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.359529:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.363447:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.366535:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.368688:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.368770:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.373229:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.375993:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.378328:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.381694:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.385116:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.390172:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.393542:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.394321:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.396329:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.396573:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.398775:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.400916:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.403898:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.405534:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.411410:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.415956:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.416880:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.420913:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.420992:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.426002:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.429671:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.429922:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.434665:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.437541:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.442687:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.446255:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.449812:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.452655:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.453795:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.456963:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.459295:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.464313:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.467579:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.471537:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.474725:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.477775:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.480763:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.483412:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.485401:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.487806:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.493752:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.496911:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.499902:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.502771:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.505576:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.510309:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.511129:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.514658:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.515857:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.515880:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272455552 00000100:00100000:0.0:1746065128.515884:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272455552 00010000:00010000:0.0:1746065128.515898:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e2e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e425a expref: 7 pid: 9560 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.515919:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13349 00000100:00100000:0.0:1746065128.515923:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272455552:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.515929:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.515942:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e2e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e425a expref: 7 pid: 9560 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.515951:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e2e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e425a expref: 7 pid: 9560 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.515963:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.515964:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.515968:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e2f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4261 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.515974:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e2f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4261 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.515989:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e2f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4261 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.515996:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e2f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4261 expref: 72 pid: 9560 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.516005:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267433984:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065128.516058:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.519851:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.523341:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.527278:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.529852:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.533716:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.537564:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.538008:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.541204:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.546962:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.550222:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.552684:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.555841:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.560049:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.563631:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.563669:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.566668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.566776:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.569914:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.572400:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.574676:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.576816:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.578955:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.581866:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.583579:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.585480:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.587700:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.590919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.596586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.610063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.612480:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.612536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.616727:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.621941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.629680:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.636395:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.643221:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.646745:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2004:x1830881272462080:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2352us (3519us total) trans 4294972019 rc 0/0 00000100:00100000:0.0:1746065128.646754:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2302 00002000:00100000:0.0:1746065128.646763:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880098524a80 x1830881272462080/t4294972019(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:44/0 lens 496/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065128.646770:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098524a80 with x1830881272462080 ext(0->7) 00010000:00010000:0.0:1746065128.646777:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42b5 expref: 73 pid: 9560 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.646790:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42b5 expref: 73 pid: 9560 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746065128.646795:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098524a80 00000100:00100000:0.0:1746065128.652340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.658659:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267437184:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065128.658677:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065128.658722:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2003:x1830881272462208:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3083us (6387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.658731:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13362 00000100:00100000:0.0:1746065128.659065:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272462464 00000100:00100000:0.0:1746065128.659070:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272462464 00002000:00100000:0.0:1746065128.659130:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88ad80 x1830881272462464/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065128.659139:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88ad80 with x1830881272462464 ext(0->4095) 00002000:00010000:0.0:1746065128.659143:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e88ad80 00000100:00100000:0.0:1746065128.659163:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13126 00000100:00100000:0.0:1746065128.659169:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2002:x1830881272462464:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746065128.659865:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2002:x1830881272462464:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 694us (1049us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065128.659872:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13126 00002000:00100000:0.0:1746065128.659878:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88ad80 x1830881272462464/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065128.659885:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88ad80 with x1830881272462464 ext(0->4095) 00002000:00010000:0.0:1746065128.659888:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e88ad80 00000100:00100000:0.0:1746065128.662154:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.668058:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.668276:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.672930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.677206:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.679208:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272463360 00000100:00100000:0.0:1746065128.679213:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272463360 00010000:00010000:0.0:1746065128.679232:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42c3 expref: 74 pid: 9560 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.679298:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13364 00000100:00100000:0.0:1746065128.679304:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2005:x1830881272463360:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.679313:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.679327:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42c3 expref: 74 pid: 9560 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.679341:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42c3 expref: 74 pid: 9560 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.679356:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e352 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42c3 expref: 74 pid: 9560 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.679628:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.679630:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.679637:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42ca expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.679643:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e359 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42ca expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.679667:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e359 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42ca expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.679676:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e359 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42ca expref: 73 pid: 9560 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.679686:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098525c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267437824:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065128.679819:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.683625:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.686846:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.689526:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.694103:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.696981:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.700588:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.704235:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.710901:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.712096:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.712132:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272464896 00000100:00100000:0.0:1746065128.712135:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272464896 00000100:00100000:0.0:1746065128.712156:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29396 00000100:00100000:0.0:1746065128.712161:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:1791:x1830881272464896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065128.712172:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.712182:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87e375 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e42e6 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.712980:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e36e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42df expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.712987:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.712988:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.712990:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87e375 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42e6 expref: 74 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.713008:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e36e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42df expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.713017:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e36e lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42df expref: 7 pid: 9560 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.713037:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267438592:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065128.713056:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.715434:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.716120:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267438592:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065128.716136:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87e375 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42e6 expref: 73 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.716147:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:0.0:1746065128.716165:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1791:x1830881272464896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4004us (4069us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.716171:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29396 00000100:00100000:0.0:1746065128.718728:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.723153:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.725827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.731917:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.735843:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2003:x1830881272465792:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 3708us (3917us total) trans 4294972020 rc 0/0 00000100:00100000:0.0:1746065128.735855:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2307 00002000:00100000:0.0:1746065128.735865:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d54bb80 x1830881272465792/t4294972020(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:44/0 lens 496/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065128.735872:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54bb80 with x1830881272465792 ext(0->7) 00010000:00010000:0.0:1746065128.735880:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87e375 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42e6 expref: 75 pid: 9559 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.735895:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87e375 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e42e6 expref: 75 pid: 9559 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746065128.735906:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54bb80 00000100:00100000:0.0:1746065128.748686:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.748764:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.752439:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.757479:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.761718:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.765375:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.769613:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.772636:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.772720:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.777973:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.780507:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.784922:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.788292:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.790878:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.794591:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.798833:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.800657:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.805123:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.806499:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.809651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.812500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.815404:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.817630:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.822287:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.826258:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.826294:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.829676:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.831225:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.834375:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.839370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.841157:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.844170:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.846510:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.849172:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.851370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.854546:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.860403:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.865311:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.865358:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.901371:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272472960 00000100:00100000:0.0:1746065128.901383:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272472960 00002000:00100000:0.0:1746065128.901422:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54a680 x1830881272472960/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065128.901431:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a680 with x1830881272472960 ext(0->4095) 00010000:00010000:0.0:1746065128.901439:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f835a00/0x392ae0376f87e3d7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4348 expref: 75 pid: 9558 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.901451:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f835a00/0x392ae0376f87e3d7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4348 expref: 75 pid: 9558 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065128.901457:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54a680 00000100:00100000:0.0:1746065128.901472:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2315 00000100:00100000:0.0:1746065128.901477:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2004:x1830881272472960:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065128.901805:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2004:x1830881272472960:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 326us (8440us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065128.901897:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2315 00002000:00100000:0.0:1746065128.901904:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54a680 x1830881272472960/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065128.901910:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a680 with x1830881272472960 ext(0->4095) 00010000:00010000:0.0:1746065128.901915:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f835a00/0x392ae0376f87e3d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4348 expref: 75 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.901923:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f835a00/0x392ae0376f87e3d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4348 expref: 75 pid: 9558 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065128.901927:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54a680 00000100:00100000:0.0:1746065128.903797:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.905150:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272473216 00000100:00100000:0.0:1746065128.905154:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272473216 00010000:00010000:0.0:1746065128.905172:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f835a00/0x392ae0376f87e3d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4348 expref: 76 pid: 9558 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065128.905201:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13383 00000100:00100000:0.0:1746065128.905206:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b403dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2002:x1830881272473216:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.905214:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.905228:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f835a00/0x392ae0376f87e3d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4348 expref: 76 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.905238:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f835a00/0x392ae0376f87e3d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4348 expref: 76 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.905254:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f835a00/0x392ae0376f87e3d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4348 expref: 76 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.905267:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.905268:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.905273:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.905280:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.905300:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.905310:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 6 pid: 9559 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065128.905320:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d511500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267442688:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065128.905383:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.907428:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.907449:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272473472 00000100:00100000:0.0:1746065128.907454:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272473472 00002000:00100000:0.0:1746065128.907485:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d512300 x1830881272473472/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065128.907493:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d512300 with x1830881272473472 ext(0->4095) 00010000:00010000:0.0:1746065128.907500:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.907511:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065128.907516:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d512300 00000100:00100000:0.0:1746065128.907530:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2316 00000100:00100000:0.0:1746065128.907536:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272473472:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065128.907643:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272473472:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 107us (220us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065128.907649:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2316 00002000:00100000:0.0:1746065128.907653:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d512300 x1830881272473472/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065128.907660:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d512300 with x1830881272473472 ext(0->4095) 00010000:00010000:0.0:1746065128.907664:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.907673:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065128.907678:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d512300 00000100:00100000:0.0:1746065128.911421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.911444:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272473600 00000100:00100000:0.0:1746065128.911450:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272473600 00010000:00010000:0.0:1746065128.911472:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065128.911508:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13384 00000100:00100000:0.0:1746065128.911514:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d511f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272473600:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.911524:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.911539:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.911549:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.911565:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e3de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e434f expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.911576:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.911578:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.911583:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e3e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4356 expref: 74 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.911590:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e3e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4356 expref: 74 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.911610:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e3e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4356 expref: 74 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.911619:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d513480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267442816:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065128.911673:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.918109:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d513480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267442816:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065128.918121:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065128.918306:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d511f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272473600:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6790us (6889us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.918314:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13384 00000100:00100000:0.0:1746065128.921292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.925670:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.925711:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.929511:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.931985:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.936007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.939440:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.943289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.946513:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.947277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.952046:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.952788:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.956787:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.959631:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.963299:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.965784:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.968351:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.972853:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.973265:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.978623:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.978662:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.982718:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.988922:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065128.998185:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.002724:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.020906:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.023438:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272478208:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1662us (2534us total) trans 4294972021 rc 0/0 00000100:00100000:0.0:1746065129.023446:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2321 00002000:00100000:0.0:1746065129.023453:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d5a1500 x1830881272478208/t4294972021(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:45/0 lens 496/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.023461:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1500 with x1830881272478208 ext(0->7) 00010000:00010000:0.0:1746065129.023467:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e41d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e438e expref: 77 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.023480:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e41d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e438e expref: 77 pid: 9559 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.023486:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a1500 00000100:00100000:0.0:1746065129.028413:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.028432:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272478464 00000100:00100000:0.0:1746065129.028437:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272478464 00010000:00010000:0.0:1746065129.028457:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e41d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e438e expref: 78 pid: 9559 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.028480:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13393 00000100:00100000:0.0:1746065129.028485:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2002:x1830881272478464:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065129.028494:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065129.028508:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e41d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e438e expref: 78 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.028521:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e41d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e438e expref: 78 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.028536:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e41d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e438e expref: 78 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.028553:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.028554:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.028559:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e424 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4395 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.028565:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e424 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4395 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.028584:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e424 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4395 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.028593:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e424 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4395 expref: 6 pid: 9559 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.028601:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d5a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267445504:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065129.032165:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.032194:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d5a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267445504:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065129.032209:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065129.032243:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2002:x1830881272478464:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3756us (3832us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.032255:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13393 00000100:00100000:0.0:1746065129.033735:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272478720 00000100:00100000:0.0:1746065129.033741:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272478720 00002000:00100000:0.0:1746065129.033772:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939180 x1830881272478720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.033781:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939180 with x1830881272478720 ext(0->4095) 00010000:00010000:0.0:1746065129.033788:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e424 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4395 expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.033800:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e424 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4395 expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.033806:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939180 00000100:00100000:0.0:1746065129.034827:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2322 00000100:00100000:0.0:1746065129.034836:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2002:x1830881272478720:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746065129.034950:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2002:x1830881272478720:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 115us (1258us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065129.034955:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2322 00002000:00100000:0.0:1746065129.034960:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939180 x1830881272478720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.034968:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939180 with x1830881272478720 ext(0->4095) 00010000:00010000:0.0:1746065129.034973:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e424 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4395 expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.034987:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87e424 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4395 expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.034993:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939180 00000100:00100000:0.0:1746065129.041785:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.045576:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.047975:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.050452:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.055837:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.057936:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272479744 00000100:00100000:0.0:1746065129.057941:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272479744 00000100:00100000:0.0:1746065129.057973:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29424 00000100:00100000:0.0:1746065129.057978:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1791:x1830881272479744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065129.057988:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.058000:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87e439 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e43aa expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.058030:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e432 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43a3 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.058036:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.058038:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.058041:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87e439 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43aa expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.058061:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43a3 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.058074:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43a3 expref: 6 pid: 9560 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.058104:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d5a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267446016:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065129.060625:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.063468:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272480000 00000100:00100000:0.0:1746065129.063473:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272480000 00010000:00010000:0.0:1746065129.063491:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43a3 expref: 7 pid: 9560 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.063519:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13396 00000100:00100000:0.0:1746065129.063524:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2003:x1830881272480000:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065129.063532:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065129.063546:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43a3 expref: 7 pid: 9560 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.063555:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43a3 expref: 7 pid: 9560 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.063570:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa800/0x392ae0376f87e432 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43a3 expref: 7 pid: 9560 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.063582:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.063584:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.063589:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87e439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43aa expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.063598:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87e439 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43aa expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.063616:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87e439 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43aa expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.063625:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87e439 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43aa expref: 77 pid: 9560 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.063633:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d5a2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267446272:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065129.063685:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.066658:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.068852:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.071996:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.075003:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.077239:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267446528:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065129.077255:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e447 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43b8 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.077266:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09fa000, rc 0) 00000100:00100000:0.0:1746065129.078126:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1795:x1830881272480768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2433us (3125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.078133:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29426 00000100:00100000:0.0:1746065129.082743:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.084158:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.086600:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.091840:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272481536 00000100:00100000:0.0:1746065129.091845:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272481536 00010000:00010000:0.0:1746065129.091863:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e447 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43b8 expref: 7 pid: 9558 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.091891:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13399 00000100:00100000:0.0:1746065129.091897:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272481536:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065129.091905:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065129.091919:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e447 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43b8 expref: 7 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.091928:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e447 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43b8 expref: 7 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.091944:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fa000/0x392ae0376f87e447 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43b8 expref: 7 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.091958:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.091960:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.091966:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800728f8200/0x392ae0376f87e44e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43bf expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.091973:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800728f8200/0x392ae0376f87e44e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43bf expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.092010:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800728f8200/0x392ae0376f87e44e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43bf expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.092034:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800728f8200/0x392ae0376f87e44e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43bf expref: 77 pid: 9558 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.092043:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d5a1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267447168:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065129.092102:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.097329:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.099792:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.103857:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.107283:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.112017:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.115017:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.115399:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272482816 00000100:00100000:0.0:1746065129.115403:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272482816 00002000:00100000:0.0:1746065129.115428:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b480 x1830881272482816/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.115437:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b480 with x1830881272482816 ext(0->4095) 00010000:00010000:0.0:1746065129.115443:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87e45c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43cd expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.115452:0:27164:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87e45c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43cd expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065129.115458:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54b480 00000100:00100000:0.0:1746065129.115473:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2325 00000100:00100000:0.0:1746065129.115478:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272482816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065129.115651:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881272482816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 172us (340us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065129.115657:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2325 00002000:00100000:0.0:1746065129.115663:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b480 x1830881272482816/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.115671:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b480 with x1830881272482816 ext(0->4095) 00010000:00010000:0.0:1746065129.115799:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87e45c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43cd expref: 7 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.115808:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87e45c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43cd expref: 7 pid: 9558 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.115814:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54b480 00000100:00100000:0.0:1746065129.120936:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.126012:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.129435:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.131744:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.137405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.140657:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.142993:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.147497:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.150695:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267448576:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065129.150714:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065129.151150:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272484480:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3443us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.151158:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13405 00000100:00100000:0.0:1746065129.163752:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.172002:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.175799:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272484992:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 800us (993us total) trans 4294972022 rc 0/0 00000100:00100000:0.0:1746065129.175805:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2328 00002000:00100000:0.0:1746065129.175811:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f938a80 x1830881272484992/t4294972022(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:45/0 lens 496/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.175818:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938a80 with x1830881272484992 ext(0->7) 00010000:00010000:0.0:1746065129.175823:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f87e478 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43e9 expref: 80 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.175832:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f87e478 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43e9 expref: 80 pid: 9558 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.175837:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938a80 00000100:00100000:0.0:1746065129.178136:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.181013:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.184708:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.188802:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.192666:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.195670:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.198672:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272486144:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2167us (2996us total) trans 4294972023 rc 0/0 00000100:00100000:0.0:1746065129.198681:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2330 00002000:00100000:0.0:1746065129.198690:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a0918380 x1830881272486144/t4294972023(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:45/0 lens 496/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.198704:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918380 with x1830881272486144 ext(0->7) 00010000:00010000:0.0:1746065129.198713:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e486 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43f7 expref: 81 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.198726:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09fae00/0x392ae0376f87e486 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e43f7 expref: 81 pid: 9558 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.198733:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918380 00000100:00100000:0.0:1746065129.203017:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.210767:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.215669:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.215759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.218700:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.220009:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.221538:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.228766:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.230921:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.230988:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.233536:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.236828:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.242600:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.247229:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.249760:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.250624:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.251702:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.253612:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.255838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.261445:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.268097:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.269799:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.273495:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.279476:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.290935:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.298287:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.306671:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.312317:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.317775:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.325771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.325854:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.325886:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272492288 00000100:00100000:0.0:1746065129.325889:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272492288 00000100:00100000:0.0:1746065129.325917:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29448 00000100:00100000:0.0:1746065129.325927:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272492288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065129.325939:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.325952:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87e4e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4452 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.325975:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e4da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e444b expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.325982:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.325984:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.325987:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87e4e1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4452 expref: 82 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.326011:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e4da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e444b expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.326034:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87e4da lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e444b expref: 7 pid: 9559 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.326044:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267452288:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065129.326125:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.329824:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.330597:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.334451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.337346:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.344377:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.348874:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.348955:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.350140:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.350210:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.350223:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272494080 00000100:00100000:0.0:1746065129.350225:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272494080 00000100:00100000:0.0:1746065129.350251:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 807 00000100:00100000:0.0:1746065129.350256:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2003:x1830881272494080:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065129.350283:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2003:x1830881272494080:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 27us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.350289:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 807 00000100:00100000:0.0:1746065129.350314:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.350353:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.350376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.350393:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.350413:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.350424:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272494464 00000100:00100000:0.0:1746065129.350426:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272494464 00000100:00100000:0.0:1746065129.355865:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.360826:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.363933:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.363988:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.368609:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.373524:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.379242:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.379296:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.384776:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.387836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.388912:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.392342:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.396883:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272496640 00000100:00100000:0.0:1746065129.396890:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272496640 00010000:00010000:0.0:1746065129.396919:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e50b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e447c expref: 7 pid: 9635 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.397282:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13427 00000100:00100000:0.0:1746065129.397289:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2002:x1830881272496640:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065129.397301:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065129.397315:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e50b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e447c expref: 7 pid: 9635 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.397326:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e50b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e447c expref: 7 pid: 9635 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.397347:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e50b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e447c expref: 7 pid: 9635 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.397367:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.397369:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.397377:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87e512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4483 expref: 80 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.397384:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87e512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4483 expref: 80 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.397409:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87e512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4483 expref: 80 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065129.397419:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267454208:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065129.397482:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.400175:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.403754:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.407591:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.409815:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.411716:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.418896:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.425544:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.439843:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.442862:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881272498176:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 719us (3018us total) trans 4294972024 rc 0/0 00000100:00100000:0.0:1746065129.442872:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2342 00002000:00100000:0.0:1746065129.442878:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d653800 x1830881272498176/t4294972024(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:45/0 lens 496/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.442886:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d653800 with x1830881272498176 ext(0->7) 00010000:00010000:0.0:1746065129.442892:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072f36400/0x392ae0376f87e520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4491 expref: 83 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.442903:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072f36400/0x392ae0376f87e520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4491 expref: 83 pid: 9558 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.442909:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d653800 00000001:00080000:0.0:1746065129.444410:0:10896:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294972024 is committed 00000001:00080000:0.0:1746065129.444492:0:10896:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294971985 is committed 00000100:00100000:0.0:1746065129.446808:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.453656:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.457999:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.458072:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.464967:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.470559:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.473666:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.477201:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.480173:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.484046:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.488800:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.489131:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.492814:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.495468:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.498541:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.501481:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.508471:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.510279:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.513779:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.516744:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.518243:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.521881:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.523937:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.527221:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.529740:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.535294:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.537980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.540412:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.543549:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.545415:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.548925:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.549025:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.552723:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.555816:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.560365:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.563230:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.567864:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.570520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.571680:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.572333:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.574431:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.576013:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.577663:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.581501:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.583800:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.586268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.589901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.591793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.593127:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.594737:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.596585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.599060:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.601576:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.603623:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.605210:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.607523:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.610254:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.611995:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.613692:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.616770:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.618498:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.619507:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.622310:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.625073:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.625332:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.627436:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.628877:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.632797:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.634917:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.638058:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.641955:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.643144:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.645845:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.647618:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.653835:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.656843:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.660827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.663845:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.667226:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.672278:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272511872 00000100:00100000:0.0:1746065129.672282:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272511872 00002000:00100000:0.0:1746065129.672305:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938e00 x1830881272511872/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.672313:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938e00 with x1830881272511872 ext(0->4095) 00010000:00010000:0.0:1746065129.672318:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e5dd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e454e expref: 6 pid: 9635 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.672327:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e5dd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e454e expref: 6 pid: 9635 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.672332:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938e00 00000100:00100000:0.0:1746065129.672344:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2354 00000100:00100000:0.0:1746065129.672348:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272511872:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065129.672430:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272511872:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 80us (973us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065129.672435:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2354 00002000:00100000:0.0:1746065129.672440:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938e00 x1830881272511872/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.672447:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938e00 with x1830881272511872 ext(0->4095) 00010000:00010000:0.0:1746065129.672450:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e5dd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e454e expref: 6 pid: 9635 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.672458:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87e5dd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e454e expref: 6 pid: 9635 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.672463:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938e00 00000100:00100000:0.0:1746065129.675892:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.675956:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.680415:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.683153:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.686366:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.689296:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.692647:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.695641:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.697643:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.698011:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.702686:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.708767:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.712633:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.713163:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.716171:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.722140:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.722187:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.728324:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.733182:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.733262:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.739026:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.743727:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.747447:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.748520:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.751964:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.754668:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272516352 00000100:00100000:0.0:1746065129.754673:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272516352 00002000:00100000:0.0:1746065129.754700:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548700 x1830881272516352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.754708:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548700 with x1830881272516352 ext(0->4095) 00010000:00010000:0.0:1746065129.754715:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e61c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e458d expref: 7 pid: 9635 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.754725:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e61c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e458d expref: 7 pid: 9635 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.754731:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548700 00000100:00100000:0.0:1746065129.754752:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2359 00000100:00100000:0.0:1746065129.754758:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881272516352:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:0.0:1746065129.754848:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881272516352:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 90us (259us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065129.754853:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2359 00002000:00100000:0.0:1746065129.754858:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548700 x1830881272516352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.754870:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548700 with x1830881272516352 ext(0->4095) 00010000:00010000:0.0:1746065129.754874:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e61c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e458d expref: 7 pid: 9635 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.754883:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e61c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e458d expref: 7 pid: 9635 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.754888:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548700 00000100:00100000:0.0:1746065129.756666:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.756824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.759339:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.761635:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.763201:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.767172:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.772262:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.775516:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.777479:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.780243:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.786000:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.786069:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.791140:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272518528 00000100:00100000:0.0:1746065129.791147:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272518528 00000100:00100000:0.0:1746065129.791189:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29499 00000100:00100000:0.0:1746065129.791196:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:1795:x1830881272518528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065129.791210:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.791222:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f87e646 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e45b7 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.791241:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.791245:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184000/0x392ae0376f87e63f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e45b0 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.791249:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065129.791252:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f87e646 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e45b7 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.791275:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184000/0x392ae0376f87e63f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e45b0 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.791284:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f87e646 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e45b7 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.791291:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb69e00, rc 0) 00000100:00100000:0.0:1746065129.791329:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:1795:x1830881272518528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 134us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.791334:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29499 00000100:00100000:0.0:1746065129.792033:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.795518:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.798787:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.802239:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.804914:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.807723:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.811532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.813687:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.816978:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.818591:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.824390:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.829465:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.834434:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.839149:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.846930:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.847562:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.853096:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.853114:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272521472 00000100:00100000:0.0:1746065129.853119:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272521472 00002000:00100000:0.0:1746065129.853145:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4ea680 x1830881272521472/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.853154:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ea680 with x1830881272521472 ext(0->4095) 00010000:00010000:0.0:1746065129.853159:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87e662 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e45d3 expref: 6 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.853171:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87e662 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e45d3 expref: 6 pid: 9558 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.853177:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4ea680 00000100:00100000:0.0:1746065129.853199:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2364 00000100:00100000:0.0:1746065129.853206:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272521472:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746065129.853293:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272521472:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 87us (213us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065129.853298:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2364 00002000:00100000:0.0:1746065129.853302:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4ea680 x1830881272521472/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.853315:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ea680 with x1830881272521472 ext(0->4095) 00010000:00010000:0.0:1746065129.853319:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87e662 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e45d3 expref: 6 pid: 9558 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.853327:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87e662 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e45d3 expref: 6 pid: 9558 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.853332:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4ea680 00000100:00100000:0.0:1746065129.858663:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.878037:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.886163:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.896111:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.902242:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.905223:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267467264:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065129.905234:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065129.905253:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881272522624:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 8643us (9144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.905260:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13478 00000100:00100000:0.0:1746065129.909662:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.917833:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.921703:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.934065:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.938475:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.939422:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881272523648:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 781us (948us total) trans 4294972025 rc 0/0 00000100:00100000:0.0:1746065129.939432:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2367 00002000:00100000:0.0:1746065129.939437:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f7c0000 x1830881272523648/t4294972025(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:45/0 lens 496/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065129.939445:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0000 with x1830881272523648 ext(0->7) 00010000:00010000:0.0:1746065129.939449:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87e67e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e45ef expref: 8 pid: 9560 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065129.939459:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87e67e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e45ef expref: 8 pid: 9560 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065129.939464:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0000 00000100:00100000:0.0:1746065129.944940:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.949903:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.953676:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.955615:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.959774:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.968277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.970632:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.974459:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.976927:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.981538:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.984416:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.986202:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.988579:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.990304:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.994348:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065129.996819:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.001297:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.003812:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065130.003988:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065130.008123:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.011844:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.013302:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.014512:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.017972:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.020715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.023680:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.026817:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.029418:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.034564:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.038337:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.038379:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.043455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.043489:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.047418:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.047454:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272529280 00000100:00100000:0.0:1746065130.047459:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272529280 00002000:00100000:0.0:1746065130.047490:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a2680 x1830881272529280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:46/0 lens 488/0 e 0 to 0 dl 1746065141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.047499:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a2680 with x1830881272529280 ext(0->4095) 00010000:00010000:0.0:1746065130.047505:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185000/0x392ae0376f87e6cb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e463c expref: 10 pid: 9560 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.047516:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185000/0x392ae0376f87e6cb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e463c expref: 10 pid: 9560 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.047523:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a2680 00000100:00100000:0.0:1746065130.047537:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2373 00000100:00100000:0.0:1746065130.047543:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881272529280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065130.047632:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881272529280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 89us (216us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065130.047638:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2373 00002000:00100000:0.0:1746065130.047642:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a2680 x1830881272529280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:46/0 lens 488/4536 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.047648:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a2680 with x1830881272529280 ext(0->4095) 00010000:00010000:0.0:1746065130.047652:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185000/0x392ae0376f87e6cb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e463c expref: 9 pid: 9560 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.047661:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185000/0x392ae0376f87e6cb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e463c expref: 9 pid: 9560 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.047665:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a2680 00000100:00100000:0.0:1746065130.052650:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.057850:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267470592:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065130.057868:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.057909:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881272529408:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5105us (5265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.057918:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13491 00000100:00100000:0.0:1746065130.061434:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.063915:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.068005:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2003:x1830881272529920:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 3856us (4087us total) trans 4294972026 rc 0/0 00000100:00100000:0.0:1746065130.068027:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2374 00002000:00100000:0.0:1746065130.068037:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8801306a1880 x1830881272529920/t4294972026(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:46/0 lens 496/448 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.068046:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1880 with x1830881272529920 ext(0->7) 00010000:00010000:0.0:1746065130.068054:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87e6d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4643 expref: 10 pid: 9560 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.068071:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87e6d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4643 expref: 10 pid: 9560 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.068076:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a1880 00000100:00100000:0.0:1746065130.076566:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.084005:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.084069:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.087774:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.087824:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.094836:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.099289:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.107752:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.114486:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.119145:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.122513:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.128838:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.129539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.134362:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.134399:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272532480 00000100:00100000:0.0:1746065130.134404:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272532480 00002000:00100000:0.0:1746065130.134437:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbdf80 x1830881272532480/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:46/0 lens 488/0 e 0 to 0 dl 1746065141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.134446:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdf80 with x1830881272532480 ext(0->4095) 00002000:00010000:0.0:1746065130.134450:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbdf80 00000100:00100000:0.0:1746065130.134465:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13191 00000100:00100000:0.0:1746065130.134470:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272532480:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065130.134557:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272532480:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 87us (197us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065130.134562:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13191 00002000:00100000:0.0:1746065130.134566:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbdf80 x1830881272532480/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:46/0 lens 488/4536 e 0 to 0 dl 1746065141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.134573:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdf80 with x1830881272532480 ext(0->4095) 00002000:00010000:0.0:1746065130.134575:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbdf80 00000100:00100000:0.0:1746065130.139811:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.140068:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.155863:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.164072:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.164690:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.183037:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272533504 00000100:00100000:0.0:1746065130.183046:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272533504 00002000:00100000:0.0:1746065130.183105:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e888700 x1830881272533504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:46/0 lens 488/0 e 0 to 0 dl 1746065141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.183120:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e888700 with x1830881272533504 ext(0->4095) 00010000:00010000:0.0:1746065130.183127:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e703 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4674 expref: 6 pid: 9560 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.183140:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e703 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4674 expref: 6 pid: 9560 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.183146:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e888700 00000100:00100000:0.0:1746065130.183164:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2379 00000100:00100000:0.0:1746065130.183169:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272533504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065130.183295:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272533504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 125us (2431us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065130.183301:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2379 00002000:00100000:0.0:1746065130.183306:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e888700 x1830881272533504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:46/0 lens 488/4536 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.183313:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e888700 with x1830881272533504 ext(0->4095) 00010000:00010000:0.0:1746065130.183318:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e703 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4674 expref: 6 pid: 9560 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.183327:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e703 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4674 expref: 6 pid: 9560 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.183332:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e888700 00000100:00100000:0.0:1746065130.200292:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.206754:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.209748:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.213335:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.216315:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.217554:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.219610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.221395:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.225209:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.228139:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.232439:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.234604:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.238251:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.240575:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.246335:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272536064 00000100:00100000:0.0:1746065130.246342:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272536064 00000100:00100000:0.0:1746065130.246388:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29532 00000100:00100000:0.0:1746065130.246395:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1791:x1830881272536064:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065130.246409:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.246422:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb69800/0x392ae0376f87e72d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e469e expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.246446:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87e726 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4697 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.246453:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.246454:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.246457:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69800/0x392ae0376f87e72d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e469e expref: 10 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.246487:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87e726 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4697 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.246497:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87e726 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4697 expref: 5 pid: 9559 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065130.246508:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267473792:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065130.246582:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.246649:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.249843:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.253077:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.263257:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.270298:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.276546:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.280840:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.283761:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.293393:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.304283:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.309553:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.316180:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.323877:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.324830:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881272538240:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 704us (959us total) trans 4294972027 rc 0/0 00000100:00100000:0.0:1746065130.324837:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2383 00002000:00100000:0.0:1746065130.324842:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8801306f2d80 x1830881272538240/t4294972027(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:46/0 lens 496/448 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.324854:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2d80 with x1830881272538240 ext(0->7) 00010000:00010000:0.0:1746065130.324859:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87e742 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e46b3 expref: 12 pid: 9559 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.324867:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87e742 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e46b3 expref: 12 pid: 9559 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.324872:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f2d80 00000100:00100000:0.0:1746065130.335996:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.338389:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.342837:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.344681:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.347835:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.351882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.351930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.354235:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.357388:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.357610:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.361217:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.364660:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.368793:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.371276:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.374626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.379000:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272541312 00000100:00100000:0.0:1746065130.379006:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272541312 00002000:00100000:0.0:1746065130.379043:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b480 x1830881272541312/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:46/0 lens 488/0 e 0 to 0 dl 1746065141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.379056:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b480 with x1830881272541312 ext(0->4095) 00002000:00010000:0.0:1746065130.379060:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93b480 00000100:00100000:0.0:1746065130.379100:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13200 00000100:00100000:0.0:1746065130.379106:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272541312:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065130.379196:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272541312:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 90us (244us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065130.379201:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13200 00002000:00100000:0.0:1746065130.379206:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b480 x1830881272541312/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:46/0 lens 488/4536 e 0 to 0 dl 1746065141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.379212:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b480 with x1830881272541312 ext(0->4095) 00002000:00010000:0.0:1746065130.379214:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93b480 00000100:00100000:0.0:1746065130.384385:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.385206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.390997:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.396597:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.402841:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.406155:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.413070:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.419820:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.428505:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.435783:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.461871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.464981:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2004:x1830881272543488:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2217us (3106us total) trans 4294972028 rc 0/0 00000100:00100000:0.0:1746065130.464994:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2389 00002000:00100000:0.0:1746065130.465002:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012f72b480 x1830881272543488/t4294972028(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:46/0 lens 496/448 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.465018:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72b480 with x1830881272543488 ext(0->7) 00010000:00010000:0.0:1746065130.465025:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87e788 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e46f9 expref: 14 pid: 9559 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.465040:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87e788 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e46f9 expref: 14 pid: 9559 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.465045:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72b480 00000100:00100000:0.0:1746065130.471487:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.476686:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.478803:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.478863:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.481617:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.484538:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.489894:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.492601:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.495525:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.500069:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.509801:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.509879:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.512955:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.515070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.515141:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.517757:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.519830:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.524408:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.526889:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.529326:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.531971:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.533628:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.533663:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.536829:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.540608:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.543421:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.544728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.547335:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.549767:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.551420:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.555241:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.559195:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.563808:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.566271:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.568214:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.571123:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.573645:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.574076:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.578166:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.581184:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.584145:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.586636:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.588746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.591352:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.593167:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.596455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.597518:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.599151:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.602210:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.605456:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.606459:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.606854:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13535 00000100:00100000:0.0:1746065130.606860:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2004:x1830881272552192:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.606868:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.606881:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87e7ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4770 expref: 15 pid: 9559 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.606891:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87e7ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4770 expref: 15 pid: 9559 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.606905:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87e7ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4770 expref: 15 pid: 9559 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.606924:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.606925:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.606930:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87e806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4777 expref: 14 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.606935:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87e806 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4777 expref: 14 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.606954:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87e806 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4777 expref: 14 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.606963:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87e806 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4777 expref: 14 pid: 9560 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065130.606971:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267481984:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065130.607030:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.609527:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.611621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.611688:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.617428:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.620762:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.626420:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.628366:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.630409:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.633799:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.635668:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.635807:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.638947:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.642951:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267483008:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065130.642965:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.643014:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272554240:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3569us (4064us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.643024:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13539 00000100:00100000:0.0:1746065130.648387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.659154:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.663944:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.668974:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.675062:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.677579:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.682582:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.688581:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272556160 00000100:00100000:0.0:1746065130.688588:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272556160 00010000:00010000:0.0:1746065130.688617:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e837 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47a8 expref: 15 pid: 9635 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065130.688651:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13543 00000100:00100000:0.0:1746065130.688656:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881272556160:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.688667:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.688682:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e837 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47a8 expref: 15 pid: 9635 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.688692:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e837 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47a8 expref: 15 pid: 9635 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.688710:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e837 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47a8 expref: 15 pid: 9635 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.688725:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.688727:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.688732:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e83e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47af expref: 14 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.688744:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e83e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47af expref: 14 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.688769:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e83e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47af expref: 14 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065130.688778:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc13100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267483904:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065130.688840:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.692305:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc13100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267483904:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065130.692320:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.692366:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2005:x1830881272556160:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3709us (4566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.692375:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13543 00000100:00100000:0.0:1746065130.704116:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.704195:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.704214:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272556800 00000100:00100000:0.0:1746065130.704218:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272556800 00010000:00010000:0.0:1746065130.704233:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e83e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47af expref: 16 pid: 9635 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065130.704249:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13544 00000100:00100000:0.0:1746065130.704253:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881272556800:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.704261:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.704275:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e83e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47af expref: 16 pid: 9635 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.704286:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87e83e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47af expref: 16 pid: 9635 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.704315:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.704316:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.704321:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e845 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47b6 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.704327:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47b6 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.704346:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47b6 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.704354:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e845 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47b6 expref: 6 pid: 9635 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065130.704364:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130691500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267484288:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065130.704420:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.721966:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272557056 00000100:00100000:0.0:1746065130.721974:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272557056 00002000:00100000:0.0:1746065130.722019:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbe300 x1830881272557056/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:46/0 lens 488/0 e 0 to 0 dl 1746065141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.722027:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbe300 with x1830881272557056 ext(0->4095) 00010000:00010000:0.0:1746065130.722035:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47b6 expref: 6 pid: 9635 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.722051:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47b6 expref: 6 pid: 9635 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.722056:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbe300 00000100:00100000:0.0:1746065130.722073:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2404 00000100:00100000:0.0:1746065130.722079:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272557056:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065130.722193:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272557056:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 114us (329us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065130.722199:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2404 00002000:00100000:0.0:1746065130.722204:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbe300 x1830881272557056/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:46/0 lens 488/4536 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.722210:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbe300 with x1830881272557056 ext(0->4095) 00010000:00010000:0.0:1746065130.722214:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47b6 expref: 6 pid: 9635 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.722222:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87e845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47b6 expref: 6 pid: 9635 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.722227:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbe300 00000100:00100000:0.0:1746065130.727897:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.731340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.736068:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.744450:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.750284:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881272557696:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2663us (5832us total) trans 4294972029 rc 0/0 00000100:00100000:0.0:1746065130.750294:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2405 00002000:00100000:0.0:1746065130.750303:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880130691500 x1830881272557696/t4294972029(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:46/0 lens 496/448 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.750310:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130691500 with x1830881272557696 ext(0->7) 00010000:00010000:0.0:1746065130.750317:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87e84c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47bd expref: 16 pid: 9558 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.750330:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87e84c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47bd expref: 16 pid: 9558 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.750335:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130691500 00000100:00100000:0.0:1746065130.751917:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.752544:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.755711:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.758068:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.763424:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.766019:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.769110:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.776732:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.777579:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.782986:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.783734:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.787903:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272559744 00000100:00100000:0.0:1746065130.787909:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272559744 00002000:00100000:0.0:1746065130.787939:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbc000 x1830881272559744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:46/0 lens 488/0 e 0 to 0 dl 1746065141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.787952:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc000 with x1830881272559744 ext(0->4095) 00010000:00010000:0.0:1746065130.787959:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47d9 expref: 17 pid: 9559 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.787971:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47d9 expref: 17 pid: 9559 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.787977:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbc000 00000100:00100000:0.0:1746065130.788934:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2408 00000100:00100000:0.0:1746065130.788942:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2004:x1830881272559744:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065130.789050:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2004:x1830881272559744:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 109us (1447us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065130.789054:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2408 00002000:00100000:0.0:1746065130.789060:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbc000 x1830881272559744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:46/0 lens 488/4536 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.789066:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc000 with x1830881272559744 ext(0->4095) 00010000:00010000:0.0:1746065130.789071:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47d9 expref: 17 pid: 9559 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.789091:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47d9 expref: 17 pid: 9559 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.789096:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbc000 00000100:00100000:0.0:1746065130.791322:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.796363:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.802874:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.806581:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.806868:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.813077:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.814540:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.819427:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.822363:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.826851:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.829846:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272561792 00000100:00100000:0.0:1746065130.829852:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272561792 00000100:00100000:0.0:1746065130.829891:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29582 00000100:00100000:0.0:1746065130.829896:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272561792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065130.829907:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.829921:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb68400/0x392ae0376f87e88b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e47fc expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.829942:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87e884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47f5 expref: 15 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.829948:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065130.829949:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065130.829952:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68400/0x392ae0376f87e88b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47fc expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.829974:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87e884 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47f5 expref: 15 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.829984:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87e884 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47f5 expref: 15 pid: 9635 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065130.829994:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d650a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267486592:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065130.830673:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.834591:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.837291:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.839310:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272562304 00000100:00100000:0.0:1746065130.839314:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272562304 00002000:00100000:0.0:1746065130.839338:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88bb80 x1830881272562304/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:46/0 lens 488/0 e 0 to 0 dl 1746065141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.839346:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88bb80 with x1830881272562304 ext(0->4095) 00010000:00010000:0.0:1746065130.839351:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68400/0x392ae0376f87e88b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47fc expref: 6 pid: 9559 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.839361:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb68400/0x392ae0376f87e88b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47fc expref: 6 pid: 9559 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.839366:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e88bb80 00000100:00100000:0.0:1746065130.839388:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2411 00000100:00100000:0.0:1746065130.839393:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272562304:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065130.839489:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272562304:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (347us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065130.839494:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2411 00002000:00100000:0.0:1746065130.839498:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88bb80 x1830881272562304/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:46/0 lens 488/4536 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.839510:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88bb80 with x1830881272562304 ext(0->4095) 00010000:00010000:0.0:1746065130.839514:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68400/0x392ae0376f87e88b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47fc expref: 6 pid: 9559 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.839522:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb68400/0x392ae0376f87e88b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e47fc expref: 6 pid: 9559 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.839527:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e88bb80 00000100:00100000:0.0:1746065130.842528:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267486848:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065130.842552:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87e892 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4803 expref: 16 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.842565:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d185400, rc 0) 00000100:00100000:0.0:1746065130.842612:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:1791:x1830881272562048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4956us (5325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.842619:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29583 00000100:00100000:0.0:1746065130.843629:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.849166:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.852114:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.856329:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.862763:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.864842:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.867990:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2003:x1830881272563456:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2783us (3145us total) trans 4294972030 rc 0/0 00000100:00100000:0.0:1746065130.868000:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2413 00002000:00100000:0.0:1746065130.868022:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fafb800 x1830881272563456/t4294972030(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:46/0 lens 496/448 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.868031:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafb800 with x1830881272563456 ext(0->7) 00010000:00010000:0.0:1746065130.868038:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87e899 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e480a expref: 18 pid: 9559 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065130.868052:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87e899 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e480a expref: 18 pid: 9559 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065130.868058:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fafb800 00000100:00100000:0.0:1746065130.893717:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.915983:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.918767:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.925717:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.928300:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.934531:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.934558:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272564480 00000100:00100000:0.0:1746065130.934565:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272564480 00000100:00100000:0.0:1746065130.934602:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29587 00000100:00100000:0.0:1746065130.934608:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272564480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065130.934624:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.934638:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f87e8ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e481f expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.934661:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87e8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4818 expref: 17 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.934671:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065130.934672:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065130.934675:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f87e8ae lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e481f expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.934699:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87e8a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4818 expref: 17 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.934709:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87e8a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4818 expref: 17 pid: 9635 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746065130.934719:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267487872:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065130.934773:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.937708:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267487872:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065130.937732:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f87e8ae lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e481f expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.937745:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb69600, rc 0) 00000100:00100000:0.0:1746065130.937786:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272564480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3178us (3261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.937792:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29587 00000100:00100000:0.0:1746065130.950170:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.951073:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881272564608:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 712us (908us total) trans 4294972031 rc 0/0 00000100:00100000:0.0:1746065130.951100:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2415 00002000:00100000:0.0:1746065130.951107:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a0938a80 x1830881272564608/t4294972031(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:46/0 lens 496/448 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065130.951115:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0938a80 with x1830881272564608 ext(0->7) 00010000:00010000:0.0:1746065130.951119:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87e8a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4818 expref: 20 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065130.951128:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87e8a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4818 expref: 20 pid: 9635 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065130.951134:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0938a80 00000100:00100000:0.0:1746065130.956961:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.959455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.963866:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272565120 00000100:00100000:0.0:1746065130.963873:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272565120 00000100:00100000:0.0:1746065130.963910:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29588 00000100:00100000:0.0:1746065130.963916:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:1791:x1830881272565120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065130.963927:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.963940:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb69800/0x392ae0376f87e8b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4826 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.963959:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f87e8ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e481f expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.963965:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.963966:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.963969:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69800/0x392ae0376f87e8b5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4826 expref: 20 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.963994:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f87e8ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e481f expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.964011:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f87e8ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e481f expref: 5 pid: 9559 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746065130.964021:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a093a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267488128:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065130.964104:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.973015:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.976155:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.981528:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.985484:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.991133:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065130.991176:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.002451:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.005212:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.009048:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.012776:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.016227:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.020886:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.022984:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.025233:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.028708:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.029707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.034554:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272568704 00000100:00100000:0.0:1746065131.034559:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272568704 00002000:00100000:0.0:1746065131.034590:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548380 x1830881272568704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.034597:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548380 with x1830881272568704 ext(0->4095) 00010000:00010000:0.0:1746065131.034604:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87e8df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4850 expref: 21 pid: 9558 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.034613:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87e8df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4850 expref: 21 pid: 9558 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.034618:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548380 00000100:00100000:0.0:1746065131.034631:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2420 00000100:00100000:0.0:1746065131.034636:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:2004:x1830881272568704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065131.034725:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:2004:x1830881272568704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 88us (257us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065131.034729:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2420 00002000:00100000:0.0:1746065131.034734:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548380 x1830881272568704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.034740:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548380 with x1830881272568704 ext(0->4095) 00010000:00010000:0.0:1746065131.034744:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87e8df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4850 expref: 21 pid: 9558 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.034751:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87e8df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4850 expref: 21 pid: 9558 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.034756:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548380 00000100:00100000:0.0:1746065131.037892:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.041976:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.044291:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.047186:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065131.047496:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065131.047531:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272569216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3082us (3244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.047538:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29596 00000100:00100000:0.0:1746065131.051368:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.053208:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272569728 00000100:00100000:0.0:1746065131.053212:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272569728 00000100:00100000:0.0:1746065131.053245:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29597 00000100:00100000:0.0:1746065131.053251:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:1791:x1830881272569728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065131.053260:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.053273:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb6d600/0x392ae0376f87e8f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4865 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.053294:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87e8ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e485e expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.053301:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.053302:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.053305:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb6d600/0x392ae0376f87e8f4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4865 expref: 20 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.053328:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87e8ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e485e expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.053338:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87e8ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e485e expref: 5 pid: 9558 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746065131.053348:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d510a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267490432:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065131.053399:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.056424:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.056515:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.061306:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.064832:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.067427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.067844:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272570624 00000100:00100000:1.0:1746065131.067850:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272570624 00002000:00100000:1.0:1746065131.067879:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d511880 x1830881272570624/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.067887:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d511880 with x1830881272570624 ext(0->4095) 00002000:00010000:1.0:1746065131.067891:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d511880 00000100:00100000:1.0:1746065131.068330:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13225 00000100:00100000:1.0:1746065131.068336:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881272570624:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.068424:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881272570624:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 88us (1003us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.068430:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13225 00002000:00100000:1.0:1746065131.068434:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d511880 x1830881272570624/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.068441:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d511880 with x1830881272570624 ext(0->4095) 00002000:00010000:1.0:1746065131.068443:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d511880 00000100:00100000:0.0:1746065131.070596:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.074522:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.077297:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.078607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.080216:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.083115:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.087732:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.090403:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.093893:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.097194:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.099806:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.103041:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.106329:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.108210:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29604 00000100:00100000:1.0:1746065131.108218:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1795:x1830881272572928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.108224:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.108230:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87e925 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4896 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.108245:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.108248:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e91e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e488f expref: 22 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.108253:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.108255:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87e925 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4896 expref: 22 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.108272:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e91e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e488f expref: 22 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.108281:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87e925 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4896 expref: 22 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.108289:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065131.108311:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:1795:x1830881272572928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 95us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.108316:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29604 00000100:00100000:0.0:1746065131.110651:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.114281:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.116468:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.120212:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.123659:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.125903:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.129172:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.131461:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.131535:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.134938:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.137366:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.140200:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.143571:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.146789:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.150134:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.154120:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.155524:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.159831:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.161451:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.166249:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.168688:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.175168:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.177868:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.182226:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.183053:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.187110:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.190310:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.193837:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.194311:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272577792 00000100:00100000:0.0:1746065131.194318:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272577792 00002000:00100000:0.0:1746065131.194347:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04700 x1830881272577792/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.194355:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04700 with x1830881272577792 ext(0->4095) 00002000:00010000:0.0:1746065131.194359:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04700 00000100:00100000:0.0:1746065131.194372:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13233 00000100:00100000:0.0:1746065131.194377:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881272577792:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065131.194466:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881272577792:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 88us (635us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065131.194471:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13233 00002000:00100000:0.0:1746065131.194477:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04700 x1830881272577792/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.194484:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04700 with x1830881272577792 ext(0->4095) 00002000:00010000:0.0:1746065131.194486:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04700 00000100:00100000:0.0:1746065131.200525:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.205503:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.206765:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881272578048:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 960us (1267us total) trans 4294972032 rc 0/0 00000100:00100000:0.0:1746065131.206771:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2428 00002000:00100000:0.0:1746065131.206777:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fb67800 x1830881272578048/t4294972032(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/448 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.206784:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67800 with x1830881272578048 ext(0->7) 00010000:00010000:0.0:1746065131.206788:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87e95d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48ce expref: 22 pid: 9558 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.206798:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87e95d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48ce expref: 22 pid: 9558 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.206803:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb67800 00000100:00100000:0.0:1746065131.210189:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.216855:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.220129:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.222667:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.227529:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.231691:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.234728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.238217:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.240291:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272579584 00000100:00100000:0.0:1746065131.240295:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272579584 00002000:00100000:0.0:1746065131.240321:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548000 x1830881272579584/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.240328:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548000 with x1830881272579584 ext(0->4095) 00010000:00010000:0.0:1746065131.240334:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e972 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48e3 expref: 6 pid: 9558 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.240345:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e972 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48e3 expref: 6 pid: 9558 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.240350:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548000 00000100:00100000:0.0:1746065131.240373:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2430 00000100:00100000:0.0:1746065131.240379:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272579584:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065131.240489:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272579584:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 109us (434us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065131.240494:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2430 00002000:00100000:0.0:1746065131.240499:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548000 x1830881272579584/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.240505:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548000 with x1830881272579584 ext(0->4095) 00010000:00010000:0.0:1746065131.240509:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e972 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48e3 expref: 6 pid: 9558 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.240517:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e972 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48e3 expref: 6 pid: 9558 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.240525:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548000 00000100:00100000:0.0:1746065131.243721:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.244836:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.247578:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.251633:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.254272:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.254344:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272580480 00000100:00100000:1.0:1746065131.254350:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272580480 00002000:00100000:1.0:1746065131.254382:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1f80 x1830881272580480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.254396:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1f80 with x1830881272580480 ext(0->4095) 00002000:00010000:1.0:1746065131.254401:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a1f80 00000100:00100000:1.0:1746065131.254429:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13235 00000100:00100000:1.0:1746065131.254436:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2004:x1830881272580480:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.254543:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2004:x1830881272580480:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 107us (277us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.254549:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13235 00002000:00100000:1.0:1746065131.254554:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1f80 x1830881272580480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.254560:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1f80 with x1830881272580480 ext(0->4095) 00002000:00010000:1.0:1746065131.254563:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a1f80 00000100:00100000:0.0:1746065131.256663:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.257054:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272580608 00000100:00100000:1.0:1746065131.257060:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272580608 00000100:00100000:1.0:1746065131.257110:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29618 00000100:00100000:1.0:1746065131.257116:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272580608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.257127:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.257140:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87e987 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e48f8 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.257161:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87e980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48f1 expref: 21 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.257167:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.257169:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.257172:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87e987 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48f8 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.257194:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87e980 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48f1 expref: 21 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.257203:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87e980 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48f1 expref: 21 pid: 9558 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.257213:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267495808:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065131.257280:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.260048:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.260137:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267495808:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065131.260157:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87e987 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48f8 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.260170:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065131.260202:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272580608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3086us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.260208:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29618 00000100:00100000:0.0:1746065131.262612:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.266241:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.266324:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.266383:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272581120 00000100:00100000:1.0:1746065131.266390:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272581120 00000100:00100000:1.0:1746065131.266419:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272581248 00000100:00100000:1.0:1746065131.266421:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272581248 00000100:00100000:1.0:1746065131.266445:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29619 00000100:00100000:1.0:1746065131.266452:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:1795:x1830881272581120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.266463:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.266476:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e98e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e48ff expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.266498:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87e987 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48f8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.266505:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.266506:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.266509:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e98e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48ff expref: 23 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.266534:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87e987 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48f8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.266544:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87e987 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48f8 expref: 5 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.266554:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267496064:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065131.266606:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.269693:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267496064:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065131.269716:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e98e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48ff expref: 23 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.269728:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065131.269771:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:1795:x1830881272581120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3319us (3534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.269778:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29619 00000100:00100000:0.0:1746065131.270535:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.273635:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.273752:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272581632 00000100:00100000:1.0:1746065131.273758:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272581632 00002000:00100000:1.0:1746065131.273787:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c8700 x1830881272581632/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.273795:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8700 with x1830881272581632 ext(0->4095) 00010000:00010000:1.0:1746065131.273801:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e98e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48ff expref: 23 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.273810:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e98e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48ff expref: 23 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.273816:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c8700 00000100:00100000:1.0:1746065131.274072:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2432 00000100:00100000:1.0:1746065131.274244:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2004:x1830881272581632:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.274334:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2004:x1830881272581632:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 256us (699us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.274340:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2432 00002000:00100000:1.0:1746065131.274344:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c8700 x1830881272581632/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.274351:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8700 with x1830881272581632 ext(0->4095) 00010000:00010000:1.0:1746065131.274356:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e98e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48ff expref: 23 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.274364:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e98e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e48ff expref: 23 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.274369:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c8700 00000100:00100000:0.0:1746065131.276876:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.277529:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272581760 00000100:00100000:1.0:1746065131.277536:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272581760 00000100:00100000:1.0:1746065131.277580:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29621 00000100:00100000:1.0:1746065131.277586:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272581760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.277598:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.277612:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e99c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e490d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.277632:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.277637:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e995 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4906 expref: 22 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.277642:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065131.277645:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e99c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e490d expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.277675:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e995 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4906 expref: 22 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.277685:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e99c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e490d expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.277694:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065131.277727:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272581760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.277732:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29621 00000100:00100000:1.0:1746065131.278749:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.283344:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272582144 00000100:00100000:0.0:1746065131.283350:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272582144 00002000:00100000:0.0:1746065131.283380:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549180 x1830881272582144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.283389:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549180 with x1830881272582144 ext(0->4095) 00010000:00010000:0.0:1746065131.283396:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e995 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4906 expref: 22 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.283407:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e995 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4906 expref: 22 pid: 9635 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.283413:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549180 00000100:00100000:0.0:1746065131.283530:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2433 00000100:00100000:0.0:1746065131.283536:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2004:x1830881272582144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065131.283630:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2004:x1830881272582144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (340us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065131.283635:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2433 00002000:00100000:0.0:1746065131.283639:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549180 x1830881272582144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.283645:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549180 with x1830881272582144 ext(0->4095) 00010000:00010000:0.0:1746065131.283649:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e995 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4906 expref: 22 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.283657:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e995 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4906 expref: 22 pid: 9635 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.283661:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549180 00000100:00100000:0.0:1746065131.285632:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.285923:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.290611:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.290659:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272582656 00000100:00100000:0.0:1746065131.290666:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272582656 00002000:00100000:0.0:1746065131.290698:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a07100 x1830881272582656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.290708:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a07100 with x1830881272582656 ext(0->4095) 00010000:00010000:0.0:1746065131.290715:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e99c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e490d expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.290728:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e99c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e490d expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.290735:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a07100 00000100:00100000:0.0:1746065131.290751:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2434 00000100:00100000:0.0:1746065131.290757:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272582656:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065131.290852:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272582656:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 96us (248us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065131.290857:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2434 00002000:00100000:0.0:1746065131.290861:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a07100 x1830881272582656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.290867:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a07100 with x1830881272582656 ext(0->4095) 00010000:00010000:0.0:1746065131.290871:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e99c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e490d expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.290878:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e99c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e490d expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.291649:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a07100 00000100:00100000:0.0:1746065131.295113:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.299262:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.300556:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272583040 00000100:00100000:1.0:1746065131.300563:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272583040 00002000:00100000:1.0:1746065131.300596:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cbb80 x1830881272583040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.300604:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cbb80 with x1830881272583040 ext(0->4095) 00002000:00010000:1.0:1746065131.300609:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cbb80 00000100:00100000:1.0:1746065131.300969:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13237 00000100:00100000:1.0:1746065131.300976:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881272583040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.301127:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881272583040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 151us (1871us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.301133:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13237 00002000:00100000:1.0:1746065131.301138:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cbb80 x1830881272583040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.301144:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cbb80 with x1830881272583040 ext(0->4095) 00002000:00010000:1.0:1746065131.301147:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cbb80 00000100:00100000:0.0:1746065131.303580:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.307484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.309892:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.313842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.319919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.323059:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.323392:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272584064 00000100:00100000:1.0:1746065131.323397:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272584064 00002000:00100000:1.0:1746065131.323428:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9500 x1830881272584064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.323437:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9500 with x1830881272584064 ext(0->4095) 00002000:00010000:1.0:1746065131.323440:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c9500 00000100:00100000:1.0:1746065131.323468:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13238 00000100:00100000:1.0:1746065131.323474:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881272584064:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.323573:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881272584064:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 99us (519us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.323579:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13238 00002000:00100000:1.0:1746065131.323584:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9500 x1830881272584064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.323590:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9500 with x1830881272584064 ext(0->4095) 00002000:00010000:1.0:1746065131.323593:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c9500 00000100:00100000:0.0:1746065131.333751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.347327:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.349810:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881272584320:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2250us (2483us total) trans 4294972033 rc 0/0 00000100:00100000:1.0:1746065131.349819:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2436 00002000:00100000:1.0:1746065131.349827:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d6cb800 x1830881272584320/t4294972033(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/448 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.349835:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb800 with x1830881272584320 ext(0->7) 00010000:00010000:1.0:1746065131.349841:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87e9b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4922 expref: 24 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.349852:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87e9b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4922 expref: 24 pid: 9635 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.349857:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6cb800 00000100:00100000:0.0:1746065131.353362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.360287:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.361590:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13597 00000100:00100000:1.0:1746065131.361601:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881272584576:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065131.361615:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.361634:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87e9b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4922 expref: 25 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.361650:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87e9b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4922 expref: 25 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.361668:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87e9b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4922 expref: 25 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.361989:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.361991:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.361998:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.362015:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.362045:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.362054:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 5 pid: 9635 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.362064:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267497856:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065131.362151:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.364519:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267497856:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065131.364535:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065131.364566:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2005:x1830881272584576:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2968us (4285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.364579:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13597 00000100:00100000:0.0:1746065131.366639:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.366717:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272584832 00000100:00100000:1.0:1746065131.366724:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272584832 00002000:00100000:1.0:1746065131.366757:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9180 x1830881272584832/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.366764:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9180 with x1830881272584832 ext(0->4095) 00010000:00010000:1.0:1746065131.366770:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 6 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.366779:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 6 pid: 9635 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.366783:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9180 00000100:00100000:1.0:1746065131.366807:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2437 00000100:00100000:1.0:1746065131.366811:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272584832:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.366914:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272584832:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (280us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.366920:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2437 00002000:00100000:1.0:1746065131.366925:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9180 x1830881272584832/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.366932:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9180 with x1830881272584832 ext(0->4095) 00010000:00010000:1.0:1746065131.366935:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 6 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.366946:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 6 pid: 9635 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.366951:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9180 00000100:00100000:0.0:1746065131.369061:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.369458:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272584960 00000100:00100000:1.0:1746065131.369465:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272584960 00010000:00010000:1.0:1746065131.369494:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 6 pid: 9635 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.369529:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13598 00000100:00100000:1.0:1746065131.369535:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272584960:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065131.369545:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.369561:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 6 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.369570:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 6 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.369587:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87e9b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4929 expref: 6 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.369609:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.369611:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.369617:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e9bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4930 expref: 23 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.369627:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e9bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4930 expref: 23 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.369651:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e9bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4930 expref: 23 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.369663:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267497984:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065131.369728:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.372378:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.372727:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267497984:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065131.372742:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065131.372776:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881272584960:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3240us (3719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.372783:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13598 00000100:00100000:1.0:1746065131.376202:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272585344 00000100:00100000:1.0:1746065131.376210:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272585344 00000100:00100000:1.0:1746065131.376322:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29627 00000100:00100000:1.0:1746065131.376329:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272585344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.376343:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.376358:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4937 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.376380:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e9bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4930 expref: 23 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.376386:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.376388:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.376391:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.376412:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e9bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4930 expref: 23 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.376422:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e9bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4930 expref: 23 pid: 9635 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.376431:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267498112:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065131.376943:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.378586:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267498112:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065131.378607:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.378618:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065131.378915:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272585344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2585us (3368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.378921:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29627 00000100:00100000:0.0:1746065131.380400:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.380462:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272585472 00000100:00100000:1.0:1746065131.380469:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272585472 00010000:00010000:1.0:1746065131.380493:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e9bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4930 expref: 24 pid: 9635 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.380734:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13599 00000100:00100000:1.0:1746065131.380740:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2005:x1830881272585472:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065131.380754:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.380768:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e9bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4930 expref: 24 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.380778:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e9bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4930 expref: 24 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.380796:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87e9bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4930 expref: 24 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.380876:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.380878:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.380885:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.380893:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.380917:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.380927:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267498240:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065131.381265:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.383642:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.383815:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272585600 00000100:00100000:1.0:1746065131.383823:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272585600 00000100:00100000:1.0:1746065131.383865:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29628 00000100:00100000:1.0:1746065131.383872:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1791:x1830881272585600:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.383887:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.383900:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e493e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.383921:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.383928:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.383929:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.383932:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 25 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.383955:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.383964:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 5 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.383973:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267498368:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065131.384046:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.384807:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.384939:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a04a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267498240:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065131.384952:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065131.384974:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881272585472:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4234us (4577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.384981:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13599 00000100:00100000:1.0:1746065131.385892:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267498368:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065131.385905:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 24 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.385916:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065131.385935:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1791:x1830881272585600:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2064us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.385940:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29628 00000100:00100000:0.0:1746065131.388955:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.389101:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272585984 00000100:00100000:1.0:1746065131.389109:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272585984 00010000:00010000:1.0:1746065131.389134:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.389201:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13600 00000100:00100000:1.0:1746065131.389209:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272585984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065131.389219:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.389235:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.389246:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.389264:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87e9c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4937 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.389295:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.389297:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.389303:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 23 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.389314:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 23 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.389340:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 23 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.389349:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267498496:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065131.389412:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.390806:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267498496:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065131.390819:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065131.390857:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881272585984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1648us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.390865:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13600 00000100:00100000:0.0:1746065131.391326:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.396204:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.396263:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272586368 00000100:00100000:1.0:1746065131.396271:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272586368 00000100:00100000:1.0:1746065131.396384:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29629 00000100:00100000:1.0:1746065131.396391:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272586368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.396406:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.396420:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4945 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.396442:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 23 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.396448:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.396450:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.396454:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.396478:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 23 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.396487:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 23 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.396497:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267498624:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065131.397478:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.400402:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.401153:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267498624:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065131.401177:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.401191:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:0.0:1746065131.401261:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272586368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4869us (5063us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.401268:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29629 00000100:00100000:0.0:1746065131.403665:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881272586496:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2278us (3263us total) trans 4294972034 rc 0/0 00000100:00100000:0.0:1746065131.403674:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2439 00002000:00100000:0.0:1746065131.403681:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f9f8e00 x1830881272586496/t4294972034(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/448 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.403690:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f8e00 with x1830881272586496 ext(0->7) 00010000:00010000:0.0:1746065131.403697:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 26 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.403710:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 26 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.403717:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9f8e00 00000100:00100000:0.0:1746065131.407860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.409608:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272586624 00000100:00100000:1.0:1746065131.409617:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272586624 00010000:00010000:1.0:1746065131.409649:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 26 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.409682:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13601 00000100:00100000:1.0:1746065131.409689:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881272586624:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065131.409701:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.409717:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 26 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.409730:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 26 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.409748:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87e9cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e493e expref: 26 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.409762:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.409763:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.409769:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.409775:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.409799:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.409808:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267498752:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065131.410668:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.411870:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267498752:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065131.411882:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065131.411906:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881272586624:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2218us (4053us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.411914:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13601 00000100:00100000:0.0:1746065131.412756:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.413745:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.414025:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272587008 00000100:00100000:1.0:1746065131.414030:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272587008 00002000:00100000:1.0:1746065131.414052:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9fa680 x1830881272587008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.414061:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9fa680 with x1830881272587008 ext(0->4095) 00010000:00010000:1.0:1746065131.414067:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.414077:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.414111:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9fa680 00000100:00100000:1.0:1746065131.414125:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2440 00000100:00100000:1.0:1746065131.414131:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272587008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.414219:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272587008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 88us (474us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.414224:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2440 00002000:00100000:1.0:1746065131.414229:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9fa680 x1830881272587008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.414236:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9fa680 with x1830881272587008 ext(0->4095) 00010000:00010000:1.0:1746065131.414240:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.414248:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.414254:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9fa680 00000100:00100000:0.0:1746065131.416179:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.416218:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.416653:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272587264 00000100:00100000:1.0:1746065131.416657:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272587264 00010000:00010000:1.0:1746065131.416670:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.416685:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13602 00000100:00100000:1.0:1746065131.416690:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272587264:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065131.416697:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.416710:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.416720:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.416734:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87e9d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4945 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.416746:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.416747:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.416751:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87e9db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e494c expref: 26 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.416757:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87e9db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e494c expref: 26 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.416775:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87e9db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e494c expref: 26 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.416789:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87e9db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e494c expref: 26 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.416798:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267499136:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065131.416833:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.423637:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267499136:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065131.423656:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065131.424494:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881272587264:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 7801us (8273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.424505:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13602 00000100:00100000:0.0:1746065131.424895:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.430297:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.430332:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272587648 00000100:00100000:0.0:1746065131.430338:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272587648 00010000:00010000:0.0:1746065131.430363:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87e9db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e494c expref: 27 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746065131.430394:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13603 00000100:00100000:0.0:1746065131.430399:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2003:x1830881272587648:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.430409:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.430424:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87e9db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e494c expref: 27 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.430434:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87e9db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e494c expref: 27 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.430451:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87e9db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e494c expref: 27 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.430467:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.430470:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.430475:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e9e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4953 expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.430482:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e9e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4953 expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.430508:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e9e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4953 expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.430519:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267499264:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065131.431357:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.433960:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.440866:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.447875:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.449796:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2005:x1830881272588160:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1400us (1921us total) trans 4294972035 rc 0/0 00000100:00100000:0.0:1746065131.449804:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2442 00002000:00100000:0.0:1746065131.449811:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8801306f3100 x1830881272588160/t4294972035(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/448 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.449818:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3100 with x1830881272588160 ext(0->7) 00010000:00010000:0.0:1746065131.449824:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e9e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4953 expref: 28 pid: 9635 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.449835:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87e9e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4953 expref: 28 pid: 9635 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.449845:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3100 00000100:00100000:0.0:1746065131.453475:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.457669:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.461312:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.464328:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.466871:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.469387:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.474229:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.476067:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2005:x1830881272589312:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 871us (1838us total) trans 4294972036 rc 0/0 00000100:00100000:0.0:1746065131.476074:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2443 00002000:00100000:0.0:1746065131.476079:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f7c1500 x1830881272589312/t4294972036(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/448 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.476101:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1500 with x1830881272589312 ext(0->7) 00010000:00010000:0.0:1746065131.476106:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87e9f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4961 expref: 30 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.476115:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87e9f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4961 expref: 30 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.476120:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c1500 00000100:00100000:0.0:1746065131.482575:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.483266:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.487173:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.487232:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272589824 00000100:00100000:1.0:1746065131.487238:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272589824 00002000:00100000:1.0:1746065131.487271:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a4380 x1830881272589824/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.487280:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4380 with x1830881272589824 ext(0->4095) 00010000:00010000:1.0:1746065131.487287:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87e9f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4968 expref: 6 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.487299:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87e9f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4968 expref: 6 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.487304:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a4380 00000100:00100000:1.0:1746065131.487332:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2444 00000100:00100000:1.0:1746065131.487338:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272589824:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.487426:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272589824:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 89us (254us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.487431:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2444 00002000:00100000:1.0:1746065131.487435:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a4380 x1830881272589824/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.487442:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4380 with x1830881272589824 ext(0->4095) 00010000:00010000:1.0:1746065131.487446:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87e9f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4968 expref: 6 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.487454:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87e9f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4968 expref: 6 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.487459:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a4380 00000100:00100000:0.0:1746065131.489991:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.493404:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.497157:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.497342:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272590336 00000100:00100000:1.0:1746065131.497350:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272590336 00000100:00100000:1.0:1746065131.497397:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29636 00000100:00100000:1.0:1746065131.497403:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272590336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.497417:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.497431:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4976 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.497454:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87e9fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e496f expref: 29 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.497460:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.497461:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.497464:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4976 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.497487:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87e9fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e496f expref: 29 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.497497:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87e9fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e496f expref: 29 pid: 9559 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.497506:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267500416:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065131.497570:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.500729:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267500416:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065131.500752:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4976 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.500767:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065131.500796:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272590336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3393us (3645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.500802:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29636 00000100:00100000:0.0:1746065131.501956:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.502114:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13608 00000100:00100000:1.0:1746065131.502122:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881272590464:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065131.502134:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.502155:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87e9fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e496f expref: 30 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.502164:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87e9fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e496f expref: 30 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.502181:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87e9fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e496f expref: 30 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.502205:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.502207:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.502217:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4976 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.502225:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4976 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.502249:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4976 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.502259:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267500544:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065131.502312:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.503227:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267500544:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065131.503238:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065131.503258:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:2004:x1830881272590464:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1137us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.503265:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13608 00000100:00100000:1.0:1746065131.508021:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272590720 00000100:00100000:1.0:1746065131.508028:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272590720 00002000:00100000:1.0:1746065131.508063:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549500 x1830881272590720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.508077:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549500 with x1830881272590720 ext(0->4095) 00002000:00010000:1.0:1746065131.508097:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d549500 00000100:00100000:0.0:1746065131.508242:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272590848 00000100:00100000:0.0:1746065131.508247:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272590848 00000100:00100000:1.0:1746065131.508264:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13245 00000100:00100000:0.0:1746065131.508269:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29637 00000100:00100000:1.0:1746065131.508271:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272590720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065131.508274:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:1791:x1830881272590848:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065131.508282:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.508296:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f87ea0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e497d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.508317:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4976 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.508323:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.508325:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.508327:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f87ea0c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e497d expref: 30 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.508349:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4976 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.508360:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4976 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746065131.508370:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267500672:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065131.508379:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272590720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 108us (487us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.508385:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13245 00002000:00100000:1.0:1746065131.508390:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549500 x1830881272590720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.508396:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549500 with x1830881272590720 ext(0->4095) 00010000:00010000:1.0:1746065131.508401:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4976 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.508412:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea05 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4976 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.508417:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549500 00000100:00100000:0.0:1746065131.508423:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.512512:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.513848:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.517782:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272591360 00000100:00100000:0.0:1746065131.517788:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272591360 00002000:00100000:0.0:1746065131.517820:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54a680 x1830881272591360/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.517829:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a680 with x1830881272591360 ext(0->4095) 00010000:00010000:0.0:1746065131.517836:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f87ea0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e497d expref: 31 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.517848:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f87ea0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e497d expref: 31 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.517855:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54a680 00000100:00100000:0.0:1746065131.518065:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2445 00000100:00100000:0.0:1746065131.518071:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881272591360:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065131.518493:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881272591360:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 421us (786us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065131.518500:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2445 00002000:00100000:0.0:1746065131.518505:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54a680 x1830881272591360/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.518512:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a680 with x1830881272591360 ext(0->4095) 00010000:00010000:0.0:1746065131.518517:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f87ea0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e497d expref: 31 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.518526:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f87ea0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e497d expref: 31 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.518532:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54a680 00000100:00100000:0.0:1746065131.520392:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.522743:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.523412:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272591744 00000100:00100000:1.0:1746065131.523418:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272591744 00002000:00100000:1.0:1746065131.523447:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084380 x1830881272591744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.523456:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084380 with x1830881272591744 ext(0->4095) 00002000:00010000:1.0:1746065131.523460:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f084380 00000100:00100000:1.0:1746065131.523486:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13246 00000100:00100000:1.0:1746065131.523493:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881272591744:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.523602:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881272591744:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 110us (859us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.523607:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13246 00002000:00100000:1.0:1746065131.523612:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084380 x1830881272591744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.523618:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084380 with x1830881272591744 ext(0->4095) 00002000:00010000:1.0:1746065131.523621:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f084380 00000100:00100000:0.0:1746065131.525168:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.527870:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.532274:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.532328:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272592256 00000100:00100000:1.0:1746065131.532334:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272592256 00002000:00100000:1.0:1746065131.532363:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f086680 x1830881272592256/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.532371:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086680 with x1830881272592256 ext(0->4095) 00002000:00010000:1.0:1746065131.532375:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f086680 00000100:00100000:1.0:1746065131.532398:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13247 00000100:00100000:1.0:1746065131.532403:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272592256:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.532494:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272592256:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 91us (223us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.532500:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13247 00002000:00100000:1.0:1746065131.532505:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f086680 x1830881272592256/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.532512:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086680 with x1830881272592256 ext(0->4095) 00002000:00010000:1.0:1746065131.532514:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f086680 00000100:00100000:0.0:1746065131.533582:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.535762:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.540134:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.540258:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272592896 00000100:00100000:1.0:1746065131.540264:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272592896 00002000:00100000:1.0:1746065131.540290:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76300 x1830881272592896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.540299:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76300 with x1830881272592896 ext(0->4095) 00010000:00010000:1.0:1746065131.540306:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ea21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4992 expref: 31 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.540316:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ea21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4992 expref: 31 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.540322:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76300 00000100:00100000:1.0:1746065131.540348:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2446 00000100:00100000:1.0:1746065131.540354:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881272592896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.540619:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881272592896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 264us (485us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.540625:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2446 00002000:00100000:1.0:1746065131.540630:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76300 x1830881272592896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.540637:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76300 with x1830881272592896 ext(0->4095) 00010000:00010000:1.0:1746065131.540641:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ea21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4992 expref: 31 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.540650:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ea21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4992 expref: 31 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.540660:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76300 00000100:00100000:0.0:1746065131.542598:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.545524:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.545637:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272593280 00000100:00100000:1.0:1746065131.545642:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272593280 00002000:00100000:1.0:1746065131.545671:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75f80 x1830881272593280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.545678:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881272593280 ext(0->4095) 00002000:00010000:1.0:1746065131.545681:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea75f80 00000100:00100000:1.0:1746065131.545774:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13248 00000100:00100000:1.0:1746065131.545781:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881272593280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.546057:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881272593280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 276us (537us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.546063:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13248 00002000:00100000:1.0:1746065131.546068:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75f80 x1830881272593280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.546074:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881272593280 ext(0->4095) 00002000:00010000:1.0:1746065131.546077:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea75f80 00000100:00100000:0.0:1746065131.548770:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.553620:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.556122:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.556217:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.556289:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272593920 00000100:00100000:1.0:1746065131.556294:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272593920 00002000:00100000:1.0:1746065131.556325:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea77800 x1830881272593920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.556334:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77800 with x1830881272593920 ext(0->4095) 00002000:00010000:1.0:1746065131.556338:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea77800 00000100:00100000:1.0:1746065131.556355:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13249 00000100:00100000:1.0:1746065131.556362:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272593920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.556473:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272593920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 110us (255us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.556478:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13249 00002000:00100000:1.0:1746065131.556483:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea77800 x1830881272593920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.556489:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77800 with x1830881272593920 ext(0->4095) 00002000:00010000:1.0:1746065131.556492:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea77800 00000100:00100000:0.0:1746065131.559481:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.560385:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.564048:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.565638:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.568026:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272594816 00000100:00100000:0.0:1746065131.568032:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272594816 00002000:00100000:0.0:1746065131.568057:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548a80 x1830881272594816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.568065:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548a80 with x1830881272594816 ext(0->4095) 00002000:00010000:0.0:1746065131.568068:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548a80 00000100:00100000:1.0:1746065131.570392:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272594944 00000100:00100000:1.0:1746065131.570397:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272594944 00000100:00100000:1.0:1746065131.570482:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29645 00000100:00100000:1.0:1746065131.570489:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272594944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.570501:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.570514:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ea44 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e49b5 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.570532:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ea3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ae expref: 29 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.570537:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.570539:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.570542:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ea44 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49b5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.570562:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ea3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ae expref: 29 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.570576:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ea3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ae expref: 29 pid: 9635 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.570584:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267502720:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065131.570969:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.573226:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.573610:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267502720:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065131.573634:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ea44 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49b5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.573648:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065131.573680:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272594944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3190us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.573686:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29645 00000100:00100000:0.0:1746065131.576184:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.577461:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.577500:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272595456 00000100:00100000:1.0:1746065131.577505:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272595456 00000100:00100000:1.0:1746065131.577535:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29646 00000100:00100000:1.0:1746065131.577541:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:1795:x1830881272595456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.577550:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.577563:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea4b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e49bc expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.577584:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ea44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49b5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.577594:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.577595:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.577599:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea4b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49bc expref: 30 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.577621:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ea44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49b5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.577630:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ea44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49b5 expref: 5 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.577639:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267502976:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065131.577706:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.578562:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.579624:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267502976:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065131.579637:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ea4b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49bc expref: 31 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.579645:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065131.579671:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1795:x1830881272595456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2130us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.579676:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29646 00000100:00100000:0.0:1746065131.579991:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.583189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.588445:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.588542:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.589073:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272596096 00000100:00100000:1.0:1746065131.589103:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272596096 00000100:00100000:1.0:1746065131.589567:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29648 00000100:00100000:1.0:1746065131.589573:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272596096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.589586:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.589598:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ea59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e49ca expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.589612:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87ea52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49c3 expref: 30 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.589619:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.589621:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.589623:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ea59 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ca expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.589637:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87ea52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49c3 expref: 30 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.589645:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87ea52 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49c3 expref: 30 pid: 9635 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065131.589652:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267503488:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065131.589673:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.592033:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267503488:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065131.592054:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ea59 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ca expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.592065:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065131.592119:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272596096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2546us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.592128:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29648 00000100:00100000:0.0:1746065131.594221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.597073:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.597200:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.597337:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272596736 00000100:00100000:1.0:1746065131.597344:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272596736 00000100:00100000:1.0:1746065131.597387:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29649 00000100:00100000:1.0:1746065131.597394:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:1791:x1830881272596736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.597406:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.597420:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ea60 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e49d1 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.597440:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.597446:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ea59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ca expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.597451:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065131.597454:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ea60 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49d1 expref: 31 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.597480:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ea59 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ca expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.597489:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ea60 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49d1 expref: 31 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.597496:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065131.597525:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1791:x1830881272596736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 132us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.597531:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29649 00000100:00100000:0.0:1746065131.600065:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.600667:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272596992 00000100:00100000:1.0:1746065131.600672:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272596992 00002000:00100000:1.0:1746065131.600698:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92680 x1830881272596992/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.600706:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92680 with x1830881272596992 ext(0->4095) 00010000:00010000:1.0:1746065131.600712:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ea59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ca expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.600722:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ea59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ca expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.600728:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c92680 00000100:00100000:1.0:1746065131.600752:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2450 00000100:00100000:1.0:1746065131.600758:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272596992:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.601228:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272596992:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 470us (1169us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.601234:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2450 00002000:00100000:1.0:1746065131.601239:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92680 x1830881272596992/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.601245:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92680 with x1830881272596992 ext(0->4095) 00010000:00010000:1.0:1746065131.601250:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ea59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ca expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.601258:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ea59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ca expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.601268:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c92680 00000100:00100000:0.0:1746065131.606669:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.610290:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.610387:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272597376 00000100:00100000:1.0:1746065131.610392:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272597376 00002000:00100000:1.0:1746065131.610420:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90a80 x1830881272597376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.610430:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90a80 with x1830881272597376 ext(0->4095) 00002000:00010000:1.0:1746065131.610433:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90a80 00000100:00100000:1.0:1746065131.610460:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13252 00000100:00100000:1.0:1746065131.610466:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881272597376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.610683:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881272597376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 216us (393us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.610689:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13252 00002000:00100000:1.0:1746065131.610694:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90a80 x1830881272597376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.610700:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90a80 with x1830881272597376 ext(0->4095) 00002000:00010000:1.0:1746065131.610702:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90a80 00000100:00100000:0.0:1746065131.614610:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.620399:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.621008:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.625447:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.625504:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272598016 00000100:00100000:1.0:1746065131.625511:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272598016 00002000:00100000:1.0:1746065131.625540:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c323b80 x1830881272598016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.625550:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323b80 with x1830881272598016 ext(0->4095) 00010000:00010000:1.0:1746065131.625555:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ea67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49d8 expref: 6 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.625571:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ea67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49d8 expref: 6 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.625577:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c323b80 00000100:00100000:1.0:1746065131.625590:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2451 00000100:00100000:1.0:1746065131.625595:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272598016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.626647:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272598016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1048us (1198us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.626654:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2451 00002000:00100000:1.0:1746065131.626660:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c323b80 x1830881272598016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.626667:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323b80 with x1830881272598016 ext(0->4095) 00010000:00010000:1.0:1746065131.626672:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ea67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49d8 expref: 6 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.626681:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ea67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49d8 expref: 6 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.626686:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c323b80 00000100:00100000:0.0:1746065131.629464:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.633807:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.633883:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272598400 00000100:00100000:1.0:1746065131.633890:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272598400 00002000:00100000:1.0:1746065131.633923:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c320a80 x1830881272598400/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.633931:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320a80 with x1830881272598400 ext(0->4095) 00002000:00010000:1.0:1746065131.633936:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c320a80 00000100:00100000:1.0:1746065131.633964:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13253 00000100:00100000:1.0:1746065131.633971:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881272598400:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.634132:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881272598400:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 161us (328us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.634137:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13253 00002000:00100000:1.0:1746065131.634142:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c320a80 x1830881272598400/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.634149:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320a80 with x1830881272598400 ext(0->4095) 00002000:00010000:1.0:1746065131.634152:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c320a80 00000100:00100000:0.0:1746065131.639686:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.641493:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.641969:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272598656 00000100:00100000:1.0:1746065131.641976:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272598656 00002000:00100000:1.0:1746065131.642224:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009c322680 x1830881272598656/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.642232:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322680 with x1830881272598656 ext(0->7) 00010000:00010000:1.0:1746065131.642237:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ea6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49df expref: 30 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.642248:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ea6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49df expref: 30 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.642253:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c322680 00000100:00100000:1.0:1746065131.642273:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2452 00000100:00100000:1.0:1746065131.642278:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2005:x1830881272598656:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065131.643137:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2005:x1830881272598656:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 856us (1642us total) trans 4294972037 rc 0/0 00000100:00100000:0.0:1746065131.643144:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2452 00002000:00100000:0.0:1746065131.643149:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009c322680 x1830881272598656/t4294972037(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/448 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.643156:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322680 with x1830881272598656 ext(0->7) 00010000:00010000:0.0:1746065131.643161:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ea6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49df expref: 32 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.643170:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ea6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49df expref: 32 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.643176:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c322680 00000100:00100000:0.0:1746065131.645015:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.646813:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.647473:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272599040 00000100:00100000:1.0:1746065131.647479:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272599040 00002000:00100000:1.0:1746065131.647506:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130778000 x1830881272599040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.647514:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130778000 with x1830881272599040 ext(0->4095) 00002000:00010000:1.0:1746065131.647518:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130778000 00000100:00100000:1.0:1746065131.647584:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13254 00000100:00100000:1.0:1746065131.647592:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272599040:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.647691:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272599040:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 100us (881us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.647742:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13254 00002000:00100000:1.0:1746065131.647748:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130778000 x1830881272599040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.647755:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130778000 with x1830881272599040 ext(0->4095) 00002000:00010000:1.0:1746065131.647758:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130778000 00000100:00100000:0.0:1746065131.649867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.650198:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.650217:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272599296 00000100:00100000:1.0:1746065131.650221:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272599296 00000100:00100000:1.0:1746065131.650298:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29654 00000100:00100000:1.0:1746065131.650303:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1795:x1830881272599296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.650309:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.650314:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ea83 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e49f4 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.650323:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.650326:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ea7c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ed expref: 34 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.650463:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.650466:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ea83 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49f4 expref: 34 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.650488:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ea7c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ed expref: 34 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.650704:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ea83 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49f4 expref: 34 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.650714:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f400, rc 0) 00000100:00100000:1.0:1746065131.650745:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1795:x1830881272599296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 441us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.650750:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29654 00000100:00100000:0.0:1746065131.651873:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.653778:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.653879:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272599680 00000100:00100000:1.0:1746065131.653884:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272599680 00002000:00100000:1.0:1746065131.653911:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b100 x1830881272599680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.653920:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b100 with x1830881272599680 ext(0->4095) 00010000:00010000:1.0:1746065131.653926:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ea7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ed expref: 33 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.653938:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ea7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ed expref: 33 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.653944:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077b100 00000100:00100000:1.0:1746065131.653970:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2453 00000100:00100000:1.0:1746065131.653975:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881272599680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.654322:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881272599680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 346us (543us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.654330:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2453 00002000:00100000:1.0:1746065131.654335:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b100 x1830881272599680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.654342:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b100 with x1830881272599680 ext(0->4095) 00010000:00010000:1.0:1746065131.654347:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ea7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ed expref: 33 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.654356:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ea7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e49ed expref: 33 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.654362:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077b100 00000100:00100000:0.0:1746065131.656164:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.658111:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.658194:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272600064 00000100:00100000:1.0:1746065131.658198:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272600064 00002000:00100000:1.0:1746065131.658222:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130779880 x1830881272600064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.658286:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779880 with x1830881272600064 ext(0->4095) 00002000:00010000:1.0:1746065131.658289:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130779880 00000100:00100000:1.0:1746065131.658314:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13255 00000100:00100000:1.0:1746065131.658320:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881272600064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.658533:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881272600064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 212us (422us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.658539:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13255 00002000:00100000:1.0:1746065131.658544:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130779880 x1830881272600064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.658550:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779880 with x1830881272600064 ext(0->4095) 00002000:00010000:1.0:1746065131.658553:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130779880 00000100:00100000:0.0:1746065131.659504:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.663948:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.668497:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.668941:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272600576 00000100:00100000:1.0:1746065131.668948:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272600576 00002000:00100000:1.0:1746065131.669992:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b800 x1830881272600576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.670012:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b800 with x1830881272600576 ext(0->4095) 00002000:00010000:1.0:1746065131.670016:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017b800 00000100:00100000:1.0:1746065131.670044:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13256 00000100:00100000:1.0:1746065131.670050:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272600576:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.670177:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272600576:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 127us (1689us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.670183:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13256 00002000:00100000:1.0:1746065131.670188:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b800 x1830881272600576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.670194:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b800 with x1830881272600576 ext(0->4095) 00002000:00010000:1.0:1746065131.670196:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017b800 00000100:00100000:0.0:1746065131.671150:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.675792:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.676712:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.681833:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272601216 00000100:00100000:1.0:1746065131.681838:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272601216 00002000:00100000:1.0:1746065131.681868:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54a300 x1830881272601216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.681876:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a300 with x1830881272601216 ext(0->4095) 00010000:00010000:1.0:1746065131.681883:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184000/0x392ae0376f87ea91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a02 expref: 33 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.681893:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184000/0x392ae0376f87ea91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a02 expref: 33 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.681899:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54a300 00000100:00100000:1.0:1746065131.681923:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2454 00000100:00100000:1.0:1746065131.681928:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881272601216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.682035:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881272601216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 106us (409us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.682040:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2454 00002000:00100000:1.0:1746065131.682045:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54a300 x1830881272601216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.682051:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a300 with x1830881272601216 ext(0->4095) 00010000:00010000:1.0:1746065131.682055:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184000/0x392ae0376f87ea91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a02 expref: 33 pid: 9559 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.682063:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184000/0x392ae0376f87ea91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a02 expref: 33 pid: 9559 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.682068:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54a300 00000100:00100000:0.0:1746065131.686192:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.691015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.693825:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.699755:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.705488:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.705602:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.705659:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272602240 00000100:00100000:1.0:1746065131.705667:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272602240 00002000:00100000:1.0:1746065131.705700:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0919500 x1830881272602240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.705710:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919500 with x1830881272602240 ext(0->4095) 00002000:00010000:1.0:1746065131.705714:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0919500 00000100:00100000:1.0:1746065131.705734:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13258 00000100:00100000:1.0:1746065131.705740:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272602240:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.705839:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272602240:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (237us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.705845:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13258 00002000:00100000:1.0:1746065131.705850:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0919500 x1830881272602240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.705856:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919500 with x1830881272602240 ext(0->4095) 00002000:00010000:1.0:1746065131.705858:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0919500 00000100:00100000:0.0:1746065131.711380:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.711463:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.711498:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272602496 00000100:00100000:0.0:1746065131.711502:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272602496 00010000:00010000:0.0:1746065131.711519:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ea9f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a10 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746065131.711550:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13631 00000100:00100000:0.0:1746065131.711555:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272602496:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.711562:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.711577:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ea9f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a10 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.711588:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ea9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a10 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.711602:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.711603:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.711608:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184000/0x392ae0376f87eaa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a17 expref: 34 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.711615:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184000/0x392ae0376f87eaa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a17 expref: 34 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.712342:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184000/0x392ae0376f87eaa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a17 expref: 33 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.712352:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184000/0x392ae0376f87eaa6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a17 expref: 33 pid: 9560 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746065131.712369:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0918000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267506560:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065131.719186:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.722061:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.725990:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.731370:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.737874:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.737921:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.743388:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.743423:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272603776 00000100:00100000:0.0:1746065131.743430:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272603776 00002000:00100000:0.0:1746065131.743463:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eb480 x1830881272603776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.743471:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eb480 with x1830881272603776 ext(0->4095) 00010000:00010000:0.0:1746065131.743478:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87eab4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a25 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.743490:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87eab4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a25 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.743496:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5eb480 00000100:00100000:0.0:1746065131.744337:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2456 00000100:00100000:0.0:1746065131.744345:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272603776:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065131.744437:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272603776:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 93us (1055us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065131.744445:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2456 00002000:00100000:0.0:1746065131.744450:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eb480 x1830881272603776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.744456:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eb480 with x1830881272603776 ext(0->4095) 00010000:00010000:0.0:1746065131.744461:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87eab4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a25 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.744469:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87eab4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a25 expref: 6 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.744474:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5eb480 00000100:00100000:0.0:1746065131.748040:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.761579:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.763462:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.766581:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.766640:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272604416 00000100:00100000:1.0:1746065131.766647:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272604416 00002000:00100000:1.0:1746065131.766677:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fff6d80 x1830881272604416/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.766686:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6d80 with x1830881272604416 ext(0->7) 00010000:00010000:1.0:1746065131.766692:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eabb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a2c expref: 32 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.766704:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eabb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a2c expref: 32 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.766715:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff6d80 00000100:00100000:1.0:1746065131.766748:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2457 00000100:00100000:1.0:1746065131.766755:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2005:x1830881272604416:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065131.767722:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2005:x1830881272604416:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 966us (1139us total) trans 4294972038 rc 0/0 00000100:00100000:0.0:1746065131.767730:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2457 00002000:00100000:0.0:1746065131.767736:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fff6d80 x1830881272604416/t4294972038(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/448 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.767742:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6d80 with x1830881272604416 ext(0->7) 00010000:00010000:0.0:1746065131.767747:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eabb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a2c expref: 34 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065131.767758:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eabb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a2c expref: 34 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065131.767764:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff6d80 00000100:00100000:0.0:1746065131.774748:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.780583:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.780621:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.780871:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272604800 00000100:00100000:1.0:1746065131.780877:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272604800 00002000:00100000:1.0:1746065131.780904:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5880 x1830881272604800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.780912:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5880 with x1830881272604800 ext(0->4095) 00002000:00010000:1.0:1746065131.780916:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff5880 00000100:00100000:1.0:1746065131.780928:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13261 00000100:00100000:1.0:1746065131.780933:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272604800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.781030:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272604800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (446us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.781035:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13261 00002000:00100000:1.0:1746065131.781039:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5880 x1830881272604800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.781045:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5880 with x1830881272604800 ext(0->4095) 00002000:00010000:1.0:1746065131.781047:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff5880 00000100:00100000:0.0:1746065131.783294:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.786025:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.792028:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.795773:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.800416:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.800664:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272605824 00000100:00100000:1.0:1746065131.800669:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272605824 00002000:00100000:1.0:1746065131.800698:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4000 x1830881272605824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.800711:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4000 with x1830881272605824 ext(0->4095) 00002000:00010000:1.0:1746065131.800715:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff4000 00000100:00100000:1.0:1746065131.800740:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13262 00000100:00100000:1.0:1746065131.800746:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2005:x1830881272605824:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.800859:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2005:x1830881272605824:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 112us (443us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.800864:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13262 00002000:00100000:1.0:1746065131.800869:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4000 x1830881272605824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.800875:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4000 with x1830881272605824 ext(0->4095) 00002000:00010000:1.0:1746065131.800878:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff4000 00000100:00100000:0.0:1746065131.802416:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.805512:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.811663:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.812710:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.816339:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.816374:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.816951:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272606592 00000100:00100000:1.0:1746065131.816958:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272606592 00000100:00100000:1.0:1746065131.816994:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29668 00000100:00100000:1.0:1746065131.817010:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1795:x1830881272606592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065131.817024:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.817039:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eae5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4a56 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.817062:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.817067:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87eade lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a4f expref: 36 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.817073:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065131.817077:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eae5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a56 expref: 36 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.817145:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87eade lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a4f expref: 36 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.817156:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eae5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a56 expref: 36 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.817165:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065131.817206:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:1795:x1830881272606592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 197us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.817212:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29668 00000100:00100000:0.0:1746065131.820578:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.820645:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272606976 00000100:00100000:1.0:1746065131.820650:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272606976 00002000:00100000:1.0:1746065131.820683:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0e00 x1830881272606976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.820691:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0e00 with x1830881272606976 ext(0->4095) 00010000:00010000:1.0:1746065131.820698:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87eade lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a4f expref: 35 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.820711:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87eade lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a4f expref: 35 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.820717:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f0e00 00000100:00100000:1.0:1746065131.820743:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2459 00000100:00100000:1.0:1746065131.820749:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881272606976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.821435:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881272606976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 685us (863us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.821441:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2459 00002000:00100000:1.0:1746065131.821446:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0e00 x1830881272606976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.821453:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0e00 with x1830881272606976 ext(0->4095) 00010000:00010000:1.0:1746065131.821457:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87eade lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a4f expref: 35 pid: 9560 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065131.821466:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87eade lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a4f expref: 35 pid: 9560 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065131.821471:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f0e00 00000100:00100000:0.0:1746065131.824780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.836536:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.838851:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.843227:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.845458:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.848255:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267508992:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065131.848272:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.848314:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2005:x1830881272607616:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3998us (5088us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.848323:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13641 00000100:00100000:0.0:1746065131.852434:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.853470:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.858630:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.862662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.867509:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.870761:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.887980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.888027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.890526:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0901000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.892969:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.897272:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.900589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.902875:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.907159:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.908355:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2002:x1830881272610176:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 919us (1196us total) trans 4294972039 rc 0/0 00000100:00100000:0.0:1746065131.908363:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2463 00002000:00100000:0.0:1746065131.908368:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012f18e300 x1830881272610176/t4294972039(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/448 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.908374:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18e300 with x1830881272610176 ext(0->7) 00010000:00010000:0.0:1746065131.908379:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87eb08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a79 expref: 36 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065131.908388:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87eb08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a79 expref: 36 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065131.908392:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18e300 00000100:00100000:0.0:1746065131.910622:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.914203:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272610560 00000100:00100000:0.0:1746065131.914209:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272610560 00002000:00100000:0.0:1746065131.914240:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548e00 x1830881272610560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.914255:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548e00 with x1830881272610560 ext(0->4095) 00002000:00010000:0.0:1746065131.914259:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548e00 00000100:00100000:0.0:1746065131.914284:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13267 00000100:00100000:0.0:1746065131.914290:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272610560:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065131.914527:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272610560:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 236us (385us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065131.914533:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13267 00002000:00100000:0.0:1746065131.914538:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548e00 x1830881272610560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.914544:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548e00 with x1830881272610560 ext(0->4095) 00002000:00010000:0.0:1746065131.914547:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548e00 00000100:00100000:0.0:1746065131.917524:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.917902:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.921787:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.929736:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.934339:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.939214:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.950904:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.953380:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.953476:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272611840 00000100:00100000:1.0:1746065131.953482:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272611840 00002000:00100000:1.0:1746065131.953516:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fb67480 x1830881272611840/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.953526:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67480 with x1830881272611840 ext(0->7) 00010000:00010000:1.0:1746065131.953534:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eb1d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a8e expref: 36 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065131.953547:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eb1d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a8e expref: 36 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065131.953554:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb67480 00000100:00100000:1.0:1746065131.953581:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2465 00000100:00100000:1.0:1746065131.953588:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2005:x1830881272611840:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065131.955985:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881272611840:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2396us (2608us total) trans 4294972040 rc 0/0 00000100:00100000:0.0:1746065131.955993:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2465 00002000:00100000:0.0:1746065131.956009:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fb67480 x1830881272611840/t4294972040(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 496/448 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065131.956023:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67480 with x1830881272611840 ext(0->7) 00010000:00010000:0.0:1746065131.956030:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eb1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a8e expref: 38 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065131.956042:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eb1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4a8e expref: 38 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065131.956048:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb67480 00000100:00100000:0.0:1746065131.958303:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.961129:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.963969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.967993:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.968102:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.971838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.973563:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.974716:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.977530:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.980164:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.980202:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.982810:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.982858:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272613888 00000100:00100000:1.0:1746065131.982864:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272613888 00002000:00100000:1.0:1746065131.982969:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbf800 x1830881272613888/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.982978:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881272613888 ext(0->4095) 00010000:00010000:1.0:1746065131.982985:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87eb39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4aaa expref: 6 pid: 9558 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065131.983008:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87eb39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4aaa expref: 6 pid: 9558 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065131.983014:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbf800 00000100:00100000:1.0:1746065131.983036:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2468 00000100:00100000:1.0:1746065131.983042:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272613888:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.983154:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272613888:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 112us (344us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.983159:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2468 00002000:00100000:1.0:1746065131.983164:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbf800 x1830881272613888/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.983171:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881272613888 ext(0->4095) 00010000:00010000:1.0:1746065131.983176:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87eb39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4aaa expref: 6 pid: 9558 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065131.983185:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87eb39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4aaa expref: 6 pid: 9558 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065131.983191:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbf800 00000100:00100000:0.0:1746065131.985883:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.988753:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272614272 00000100:00100000:1.0:1746065131.988759:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272614272 00002000:00100000:1.0:1746065131.988789:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54ad80 x1830881272614272/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.988797:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54ad80 with x1830881272614272 ext(0->4095) 00002000:00010000:1.0:1746065131.988801:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54ad80 00000100:00100000:1.0:1746065131.988824:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13270 00000100:00100000:1.0:1746065131.988830:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881272614272:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065131.988919:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881272614272:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 90us (487us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.988924:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13270 00002000:00100000:1.0:1746065131.988928:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54ad80 x1830881272614272/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.988934:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54ad80 with x1830881272614272 ext(0->4095) 00002000:00010000:1.0:1746065131.988937:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54ad80 00000100:00100000:0.0:1746065131.990512:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.992290:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.994440:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065131.994489:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272614784 00000100:00100000:1.0:1746065131.994495:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272614784 00002000:00100000:1.0:1746065131.994522:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72ad80 x1830881272614784/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.994535:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72ad80 with x1830881272614784 ext(0->4095) 00002000:00010000:1.0:1746065131.994539:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72ad80 00000100:00100000:1.0:1746065131.994565:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13271 00000100:00100000:1.0:1746065131.994571:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272614784:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065131.994683:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272614784:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 111us (243us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065131.994688:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13271 00002000:00100000:1.0:1746065131.994693:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72ad80 x1830881272614784/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065131.994700:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72ad80 with x1830881272614784 ext(0->4095) 00002000:00010000:1.0:1746065131.994703:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72ad80 00000100:00100000:0.0:1746065131.996533:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.999447:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065131.999651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.002901:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065132.003229:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065132.005674:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.005762:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065132.006182:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065132.009659:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.009790:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272615936 00000100:00100000:1.0:1746065132.009797:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272615936 00002000:00100000:1.0:1746065132.009826:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72aa00 x1830881272615936/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.009834:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72aa00 with x1830881272615936 ext(0->4095) 00010000:00010000:1.0:1746065132.009841:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87eb55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ac6 expref: 38 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.009852:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87eb55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ac6 expref: 38 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.009858:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72aa00 00000100:00100000:1.0:1746065132.009884:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2470 00000100:00100000:1.0:1746065132.009890:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881272615936:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.009980:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881272615936:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 89us (324us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.009985:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2470 00002000:00100000:1.0:1746065132.009990:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72aa00 x1830881272615936/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.010009:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72aa00 with x1830881272615936 ext(0->4095) 00010000:00010000:1.0:1746065132.010013:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87eb55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ac6 expref: 38 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.010021:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87eb55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ac6 expref: 38 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.010026:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72aa00 00000100:00100000:0.0:1746065132.012338:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.012867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.015927:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.018554:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.021411:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.023032:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.025598:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.031900:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.032289:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.034952:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.037514:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.042721:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272617984 00000100:00100000:1.0:1746065132.042727:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272617984 00002000:00100000:1.0:1746065132.042760:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549f80 x1830881272617984/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.042768:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549f80 with x1830881272617984 ext(0->4095) 00010000:00010000:1.0:1746065132.042776:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87eb71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ae2 expref: 39 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.042789:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87eb71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ae2 expref: 39 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.042795:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549f80 00000100:00100000:1.0:1746065132.042824:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2472 00000100:00100000:1.0:1746065132.042830:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881272617984:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.042936:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881272617984:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 106us (286us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.042942:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2472 00002000:00100000:1.0:1746065132.042947:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549f80 x1830881272617984/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.042954:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549f80 with x1830881272617984 ext(0->4095) 00010000:00010000:1.0:1746065132.042958:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87eb71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ae2 expref: 39 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.042966:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87eb71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ae2 expref: 39 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.042971:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549f80 00000100:00100000:0.0:1746065132.045201:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.049044:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.052653:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.055991:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.060223:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.061378:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.061543:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272618880 00000100:00100000:1.0:1746065132.061549:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272618880 00002000:00100000:1.0:1746065132.061579:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dfff100 x1830881272618880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.061588:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfff100 with x1830881272618880 ext(0->4095) 00002000:00010000:1.0:1746065132.061592:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dfff100 00000100:00100000:1.0:1746065132.061618:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13275 00000100:00100000:1.0:1746065132.061623:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272618880:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.061716:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272618880:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 92us (1499us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.061722:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13275 00002000:00100000:1.0:1746065132.061726:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dfff100 x1830881272618880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.061733:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfff100 with x1830881272618880 ext(0->4095) 00002000:00010000:1.0:1746065132.061735:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dfff100 00000100:00100000:0.0:1746065132.065150:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.066509:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.069258:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.072246:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.075629:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.078773:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.078979:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272620032 00000100:00100000:1.0:1746065132.078985:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272620032 00000100:00100000:1.0:1746065132.079036:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29693 00000100:00100000:1.0:1746065132.079043:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272620032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.079054:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.079068:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87eb94 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b05 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.079120:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87eb8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4afe expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.079127:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.079129:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.079133:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87eb94 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b05 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.079156:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87eb8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4afe expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.079165:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87eb8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4afe expref: 37 pid: 9560 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.079180:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267515008:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.079245:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.080845:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267515008:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.080864:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87eb94 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b05 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.080875:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f400, rc 0) 00000100:00100000:1.0:1746065132.080900:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272620032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1857us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.080907:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29693 00000100:00100000:0.0:1746065132.081364:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.084754:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272620416 00000100:00100000:1.0:1746065132.084763:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272620416 00002000:00100000:1.0:1746065132.084795:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b100 x1830881272620416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.084803:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b100 with x1830881272620416 ext(0->4095) 00002000:00010000:1.0:1746065132.084807:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54b100 00000100:00100000:1.0:1746065132.084824:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13277 00000100:00100000:1.0:1746065132.084830:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272620416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.084953:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272620416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 123us (279us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.084959:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13277 00002000:00100000:1.0:1746065132.084964:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b100 x1830881272620416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.084976:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b100 with x1830881272620416 ext(0->4095) 00002000:00010000:1.0:1746065132.084978:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54b100 00000100:00100000:0.0:1746065132.087672:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.087782:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272620544 00000100:00100000:1.0:1746065132.087789:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272620544 00000100:00100000:1.0:1746065132.087830:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29694 00000100:00100000:1.0:1746065132.087836:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:1791:x1830881272620544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.087850:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.087862:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87eb9b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b0c expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.087884:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87eb94 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b05 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.087890:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.087891:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.087894:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87eb9b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b0c expref: 38 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.087915:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87eb94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b05 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.087925:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87eb94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b05 expref: 5 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.087935:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267515264:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.088663:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.088829:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.091904:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267515264:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.091926:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87eb9b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b0c expref: 39 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.091941:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e400, rc 0) 00000100:00100000:1.0:1746065132.091973:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1791:x1830881272620544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4137us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.091981:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29694 00000100:00100000:0.0:1746065132.093066:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.096719:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.100007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.105329:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.105436:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272621440 00000100:00100000:1.0:1746065132.105442:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272621440 00002000:00100000:1.0:1746065132.105473:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2680 x1830881272621440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.105481:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2680 with x1830881272621440 ext(0->4095) 00002000:00010000:1.0:1746065132.105485:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a2680 00000100:00100000:1.0:1746065132.105510:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13278 00000100:00100000:1.0:1746065132.105514:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881272621440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.105607:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881272621440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 92us (282us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.105613:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13278 00002000:00100000:1.0:1746065132.105617:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2680 x1830881272621440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.105623:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2680 with x1830881272621440 ext(0->4095) 00002000:00010000:1.0:1746065132.105625:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a2680 00000100:00100000:0.0:1746065132.106913:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.107167:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272621568 00000100:00100000:1.0:1746065132.107172:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272621568 00000100:00100000:1.0:1746065132.107207:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29696 00000100:00100000:1.0:1746065132.107212:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272621568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.107222:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.107234:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eba9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b1a expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.107455:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87eba2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b13 expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.107461:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.107463:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.107466:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eba9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b1a expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.107489:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87eba2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b13 expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.107498:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87eba2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b13 expref: 37 pid: 9560 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.107508:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267515776:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.107723:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.108857:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267515776:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.108871:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eba9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b1a expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.108881:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065132.108902:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272621568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1690us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.108907:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29696 00000100:00100000:0.0:1746065132.109717:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.112800:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.115693:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.115920:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272622080 00000100:00100000:1.0:1746065132.115926:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272622080 00000100:00100000:1.0:1746065132.115965:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29697 00000100:00100000:1.0:1746065132.115971:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:1791:x1830881272622080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.115981:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.116005:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ebb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b21 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.116027:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eba9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b1a expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.116033:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.116035:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.116038:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ebb0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b21 expref: 38 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.116060:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eba9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b1a expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.116069:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eba9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b1a expref: 5 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.116101:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267516032:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.116165:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.116505:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.119149:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267516032:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.119169:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ebb0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b21 expref: 39 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.119180:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065132.119216:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1791:x1830881272622080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3245us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.119221:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29697 00000100:00100000:0.0:1746065132.121078:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.124203:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.126676:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.130647:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.131341:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272622976 00000100:00100000:1.0:1746065132.131348:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272622976 00002000:00100000:1.0:1746065132.131379:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfa680 x1830881272622976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.131388:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfa680 with x1830881272622976 ext(0->4095) 00002000:00010000:1.0:1746065132.131392:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfa680 00000100:00100000:1.0:1746065132.131485:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13280 00000100:00100000:1.0:1746065132.131492:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881272622976:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.131832:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881272622976:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 340us (1185us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.131838:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13280 00002000:00100000:1.0:1746065132.131844:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfa680 x1830881272622976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.131850:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfa680 with x1830881272622976 ext(0->4095) 00002000:00010000:1.0:1746065132.131853:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfa680 00000100:00100000:0.0:1746065132.134337:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.134481:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272623104 00000100:00100000:1.0:1746065132.134488:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272623104 00000100:00100000:1.0:1746065132.134519:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29699 00000100:00100000:1.0:1746065132.134525:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272623104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.134537:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.134550:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebbe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b2f expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.134574:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ebb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b28 expref: 37 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.134580:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.134582:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.134585:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebbe lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b2f expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.134607:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ebb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b28 expref: 37 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.134617:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ebb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b28 expref: 37 pid: 9558 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.134628:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267516544:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.134702:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.136440:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267516544:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.136458:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebbe lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b2f expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.136469:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065132.136495:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272623104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1970us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.136501:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29699 00000100:00100000:0.0:1746065132.137702:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.141491:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.141640:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272623488 00000100:00100000:1.0:1746065132.141646:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272623488 00000100:00100000:1.0:1746065132.141674:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29700 00000100:00100000:1.0:1746065132.141680:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:1791:x1830881272623488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.141693:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.141706:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebc5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b36 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.141729:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebbe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b2f expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.141735:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.141737:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.141740:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebc5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b36 expref: 38 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.141761:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b2f expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.141770:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b2f expref: 5 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.141780:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267516800:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.141836:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.142542:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.142850:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272623616 00000100:00100000:1.0:1746065132.142855:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272623616 00002000:00100000:1.0:1746065132.142878:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0e00 x1830881272623616/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.142886:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0e00 with x1830881272623616 ext(0->4095) 00010000:00010000:1.0:1746065132.142891:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebbe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b2f expref: 6 pid: 9559 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.142900:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebbe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b2f expref: 6 pid: 9559 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.142906:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a0e00 00000100:00100000:1.0:1746065132.142927:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2476 00000100:00100000:1.0:1746065132.142932:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272623616:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.143025:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272623616:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 91us (483us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.143030:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2476 00002000:00100000:1.0:1746065132.143035:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0e00 x1830881272623616/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.143042:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0e00 with x1830881272623616 ext(0->4095) 00010000:00010000:1.0:1746065132.143046:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebbe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b2f expref: 6 pid: 9559 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.143054:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebbe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b2f expref: 6 pid: 9559 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.143059:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a0e00 00000100:00100000:1.0:1746065132.145774:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267516800:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.145796:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebc5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b36 expref: 38 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.145809:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065132.145841:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:1791:x1830881272623488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4161us (4351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.145848:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29700 00000100:00100000:0.0:1746065132.146677:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.146755:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272623744 00000100:00100000:1.0:1746065132.146761:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272623744 00000100:00100000:1.0:1746065132.146785:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29701 00000100:00100000:1.0:1746065132.146790:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:1795:x1830881272623744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.146802:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.146815:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ebcc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b3d expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.146831:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.146835:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebc5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b36 expref: 39 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.146840:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.146843:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ebcc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b3d expref: 39 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.146867:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebc5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b36 expref: 39 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.146876:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ebcc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b3d expref: 39 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.146884:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065132.146919:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881272623744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 128us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.146924:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29701 00000100:00100000:0.0:1746065132.150237:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.152724:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.154869:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.160764:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272624512 00000100:00100000:1.0:1746065132.160770:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272624512 00002000:00100000:1.0:1746065132.160799:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b100 x1830881272624512/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.160808:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b100 with x1830881272624512 ext(0->4095) 00002000:00010000:1.0:1746065132.160812:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017b100 00000100:00100000:1.0:1746065132.160838:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13281 00000100:00100000:1.0:1746065132.160845:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881272624512:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.160955:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881272624512:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 110us (503us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.160961:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13281 00002000:00100000:1.0:1746065132.160966:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b100 x1830881272624512/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.160973:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b100 with x1830881272624512 ext(0->4095) 00002000:00010000:1.0:1746065132.160975:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017b100 00000100:00100000:0.0:1746065132.165198:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.169249:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.171051:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.176161:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.180914:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.183867:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.190835:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272625664 00000100:00100000:1.0:1746065132.190843:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272625664 00000100:00100000:1.0:1746065132.190870:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29704 00000100:00100000:1.0:1746065132.190876:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272625664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.190890:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.190902:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ebe1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b52 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.190924:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ebda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b4b expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.190929:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.190931:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.190933:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ebe1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b52 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.190956:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ebda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b4b expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.190966:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ebda lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b4b expref: 37 pid: 9560 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.190975:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267517824:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.191056:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.196924:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267517824:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.196950:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ebe1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b52 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.196964:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065132.197022:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272625664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6145us (6335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.197032:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29704 00000100:00100000:0.0:1746065132.198561:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.198630:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272625792 00000100:00100000:1.0:1746065132.198635:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272625792 00002000:00100000:1.0:1746065132.198665:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072978000 x1830881272625792/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 496/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.198674:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978000 with x1830881272625792 ext(0->7) 00010000:00010000:1.0:1746065132.198680:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ebda lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b4b expref: 38 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.198691:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ebda lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b4b expref: 38 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.198697:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978000 00000100:00100000:1.0:1746065132.198723:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2479 00000100:00100000:1.0:1746065132.198729:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881272625792:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065132.199667:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2004:x1830881272625792:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 936us (1106us total) trans 4294972041 rc 0/0 00000100:00100000:0.0:1746065132.199673:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2479 00002000:00100000:0.0:1746065132.199679:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072978000 x1830881272625792/t4294972041(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 496/448 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.199686:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978000 with x1830881272625792 ext(0->7) 00010000:00010000:0.0:1746065132.199690:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ebda lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b4b expref: 40 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065132.199699:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ebda lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b4b expref: 40 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065132.199704:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978000 00000100:00100000:1.0:1746065132.203872:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272625920 00000100:00100000:1.0:1746065132.203879:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272625920 00000100:00100000:1.0:1746065132.204653:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29705 00000100:00100000:1.0:1746065132.204660:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1791:x1830881272625920:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.204673:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.204687:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ebe8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b59 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.204706:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.204711:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ebe1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b52 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.204720:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065132.204723:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ebe8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b59 expref: 41 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.204749:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ebe1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b52 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.204757:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ebe8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b59 expref: 41 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.204765:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065132.205382:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:1791:x1830881272625920:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 721us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.205388:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29705 00000100:00100000:0.0:1746065132.207459:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.212701:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.216956:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.230364:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272626688 00000100:00100000:0.0:1746065132.230372:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272626688 00002000:00100000:0.0:1746065132.230407:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130178380 x1830881272626688/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.230416:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130178380 with x1830881272626688 ext(0->4095) 00002000:00010000:0.0:1746065132.230421:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130178380 00000100:00100000:0.0:1746065132.230439:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13283 00000100:00100000:0.0:1746065132.230446:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2004:x1830881272626688:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065132.230563:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2004:x1830881272626688:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 117us (281us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065132.230569:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13283 00002000:00100000:0.0:1746065132.230575:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130178380 x1830881272626688/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.230582:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130178380 with x1830881272626688 ext(0->4095) 00002000:00010000:0.0:1746065132.230585:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130178380 00000100:00100000:0.0:1746065132.233125:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.233203:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272626816 00000100:00100000:1.0:1746065132.233210:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272626816 00000100:00100000:1.0:1746065132.234900:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29706 00000100:00100000:1.0:1746065132.234911:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272626816:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.234926:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.234940:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b60 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.234967:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ebe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b59 expref: 39 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.234974:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.234976:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.234980:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebef lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b60 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.235030:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ebe8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b59 expref: 39 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.235041:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ebe8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b59 expref: 39 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.235050:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267518336:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.235143:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.236198:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267518336:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.236214:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebef lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b60 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.236226:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065132.236250:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272626816:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1342us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.236257:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29706 00000100:00100000:0.0:1746065132.239321:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.240121:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.241539:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272627072 00000100:00100000:1.0:1746065132.241543:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272627072 00000100:00100000:1.0:1746065132.241565:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29707 00000100:00100000:1.0:1746065132.241570:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1791:x1830881272627072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.241581:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.241591:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebf6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b67 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.241609:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b60 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.241614:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.241615:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.241618:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebf6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b67 expref: 41 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.241633:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b60 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.241643:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ebef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b60 expref: 5 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.241650:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267518592:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.241694:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.244564:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.245006:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267518592:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.245021:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebf6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b67 expref: 40 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.245032:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065132.245049:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1791:x1830881272627072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3479us (5737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.245055:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29707 00000100:00100000:0.0:1746065132.247042:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.247292:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272627456 00000100:00100000:1.0:1746065132.247299:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272627456 00000100:00100000:1.0:1746065132.247338:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29708 00000100:00100000:1.0:1746065132.247344:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1795:x1830881272627456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.247356:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.247368:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ebfd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b6e expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.248150:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.248155:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebf6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b67 expref: 41 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.248160:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.248162:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ebfd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b6e expref: 41 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.248186:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ebf6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b67 expref: 41 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.248196:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ebfd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b6e expref: 41 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.248202:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065132.248239:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:1795:x1830881272627456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 895us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.248244:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29708 00000100:00100000:0.0:1746065132.270693:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.277029:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.281232:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.284648:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.285467:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272628352 00000100:00100000:1.0:1746065132.285475:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272628352 00000100:00100000:1.0:1746065132.286049:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29709 00000100:00100000:1.0:1746065132.286056:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272628352:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.286073:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.286144:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ec04 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b75 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.286170:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ebfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b6e expref: 39 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.286178:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.286179:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.286182:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ec04 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b75 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.286206:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ebfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b6e expref: 39 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.286218:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ebfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b6e expref: 39 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.286229:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267519104:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.286301:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.289343:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267519104:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.289367:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ec04 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b75 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.289381:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065132.289414:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272628352:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3359us (4773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.289425:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29709 00000100:00100000:0.0:1746065132.291138:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.292136:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.292192:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272628608 00000100:00100000:1.0:1746065132.292196:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272628608 00000100:00100000:1.0:1746065132.292230:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29710 00000100:00100000:1.0:1746065132.292236:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1791:x1830881272628608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.292246:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.292257:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87ec0b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b7c expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.292272:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ec04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b75 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.292278:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.292279:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.292282:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87ec0b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b7c expref: 41 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.292298:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ec04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b75 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.292306:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ec04 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b75 expref: 5 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.292314:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267519360:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.292597:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.293983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.294264:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267519360:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.294280:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87ec0b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b7c expref: 40 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.294290:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e400, rc 0) 00000100:00100000:1.0:1746065132.294304:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1791:x1830881272628608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2070us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.294310:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29710 00000100:00100000:0.0:1746065132.296355:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.299699:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.310275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.310339:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272629376 00000100:00100000:1.0:1746065132.310347:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272629376 00000100:00100000:0.0:1746065132.328700:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.328906:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.330057:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2005:x1830881272629504:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 931us (1148us total) trans 4294972042 rc 0/0 00000100:00100000:0.0:1746065132.330066:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2484 00002000:00100000:0.0:1746065132.330071:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009dc10700 x1830881272629504/t4294972042(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 496/448 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.330079:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10700 with x1830881272629504 ext(0->7) 00010000:00010000:0.0:1746065132.330097:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87ec0b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b7c expref: 43 pid: 9559 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065132.330107:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87ec0b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b7c expref: 43 pid: 9559 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065132.330112:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc10700 00000100:00100000:0.0:1746065132.331108:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.334722:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.334919:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272630016 00000100:00100000:1.0:1746065132.334925:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272630016 00002000:00100000:1.0:1746065132.334950:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc10a80 x1830881272630016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.334958:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10a80 with x1830881272630016 ext(0->4095) 00010000:00010000:1.0:1746065132.334964:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ec12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b83 expref: 6 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.334975:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ec12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b83 expref: 6 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.334980:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc10a80 00000100:00100000:1.0:1746065132.335017:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2485 00000100:00100000:1.0:1746065132.335027:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272630016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.335128:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272630016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 101us (411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.335133:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2485 00002000:00100000:1.0:1746065132.335138:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc10a80 x1830881272630016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.335144:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10a80 with x1830881272630016 ext(0->4095) 00010000:00010000:1.0:1746065132.335149:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ec12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b83 expref: 6 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.335156:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ec12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b83 expref: 6 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.335162:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc10a80 00000100:00100000:0.0:1746065132.337423:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.342117:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.344575:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.344863:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272630528 00000100:00100000:1.0:1746065132.344870:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272630528 00000100:00100000:1.0:1746065132.344908:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29713 00000100:00100000:1.0:1746065132.344915:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272630528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.344927:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.344941:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ec20 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b91 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.344963:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ec19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b8a expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.344970:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.344971:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.344974:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ec20 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b91 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.345013:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ec19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b8a expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.345027:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ec19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b8a expref: 41 pid: 9560 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.345037:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267520128:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.345497:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.346725:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267520128:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.346744:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ec20 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b91 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.346757:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f400, rc 0) 00000100:00100000:1.0:1746065132.346796:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272630528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1881us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.346802:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29713 00000100:00100000:0.0:1746065132.347039:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.348906:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.350383:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.350418:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272631040 00000100:00100000:1.0:1746065132.350422:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272631040 00000100:00100000:1.0:1746065132.350454:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29714 00000100:00100000:1.0:1746065132.350463:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:1795:x1830881272631040:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.350473:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.350529:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ec27 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b98 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.350551:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ec20 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b91 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.350561:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.350563:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.350566:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ec27 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b98 expref: 42 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.350589:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ec20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b91 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.350598:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ec20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b91 expref: 5 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.350607:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267520384:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.350795:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.352631:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267520384:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.352652:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ec27 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b98 expref: 42 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.352665:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065132.352694:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1795:x1830881272631040:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2230us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.352700:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29714 00000100:00100000:0.0:1746065132.353279:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.353392:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272631168 00000100:00100000:1.0:1746065132.353397:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272631168 00000100:00100000:1.0:1746065132.353421:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29715 00000100:00100000:1.0:1746065132.353426:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1791:x1830881272631168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.353440:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.353450:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec2e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4b9f expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.353466:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.353470:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ec27 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b98 expref: 43 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.353475:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.353478:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec2e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b9f expref: 43 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.353500:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ec27 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b98 expref: 43 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.353509:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec2e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b9f expref: 43 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.353516:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065132.353536:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1791:x1830881272631168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 109us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.353541:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29715 00000100:00100000:0.0:1746065132.354526:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.357057:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.358842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.358882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.363704:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.363797:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272632064 00000100:00100000:1.0:1746065132.363804:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272632064 00002000:00100000:1.0:1746065132.363836:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091fb80 x1830881272632064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.363845:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091fb80 with x1830881272632064 ext(0->4095) 00010000:00010000:1.0:1746065132.363852:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b9f expref: 42 pid: 9559 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.363864:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b9f expref: 42 pid: 9559 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.363870:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091fb80 00000100:00100000:1.0:1746065132.363897:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2487 00000100:00100000:1.0:1746065132.363903:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881272632064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.364009:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881272632064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 106us (307us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.364015:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2487 00002000:00100000:1.0:1746065132.364020:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091fb80 x1830881272632064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.364026:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091fb80 with x1830881272632064 ext(0->4095) 00010000:00010000:1.0:1746065132.364030:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b9f expref: 42 pid: 9559 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.364039:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4b9f expref: 42 pid: 9559 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.364043:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091fb80 00000100:00100000:0.0:1746065132.365739:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.365970:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272632192 00000100:00100000:1.0:1746065132.365977:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272632192 00000100:00100000:1.0:1746065132.366589:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29717 00000100:00100000:1.0:1746065132.366597:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1791:x1830881272632192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.366611:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.366624:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ec3c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4bad expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.366644:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.366649:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ec35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ba6 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.366654:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065132.366657:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ec3c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bad expref: 43 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.366685:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ec35 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ba6 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.366695:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ec3c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bad expref: 43 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.366704:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065132.366737:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1791:x1830881272632192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 142us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.366742:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29717 00000100:00100000:0.0:1746065132.370006:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.372915:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.375796:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.377418:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.380449:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.383606:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.387819:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.388387:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.388548:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272633728 00000100:00100000:1.0:1746065132.388553:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272633728 00000100:00100000:1.0:1746065132.388572:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29720 00000100:00100000:1.0:1746065132.388577:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1795:x1830881272633728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.388583:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.388589:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87ec51 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4bc2 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.388600:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.388603:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ec4a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bbb expref: 44 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.388607:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.388610:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87ec51 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bc2 expref: 44 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.388627:0:9559:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ec4a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bbb expref: 44 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.388636:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87ec51 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bc2 expref: 44 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.388644:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e400, rc 0) 00000100:00100000:1.0:1746065132.388666:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1795:x1830881272633728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.388671:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29720 00000100:00100000:0.0:1746065132.390976:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.398391:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.402284:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.406652:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.407775:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272634496 00000100:00100000:1.0:1746065132.407782:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272634496 00002000:00100000:1.0:1746065132.407811:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0a80 x1830881272634496/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.407820:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0a80 with x1830881272634496 ext(0->4095) 00002000:00010000:1.0:1746065132.407824:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b0a80 00000100:00100000:1.0:1746065132.408179:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13290 00000100:00100000:1.0:1746065132.408187:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881272634496:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.408295:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881272634496:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 108us (1648us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.408300:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13290 00002000:00100000:1.0:1746065132.408306:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0a80 x1830881272634496/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.408312:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0a80 with x1830881272634496 ext(0->4095) 00002000:00010000:1.0:1746065132.408315:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b0a80 00000100:00100000:0.0:1746065132.410111:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.412518:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.421706:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272635008 00000100:00100000:0.0:1746065132.421710:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272635008 00002000:00100000:0.0:1746065132.421730:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b480 x1830881272635008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.421738:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b480 with x1830881272635008 ext(0->4095) 00010000:00010000:0.0:1746065132.421743:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87ec58 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bc9 expref: 6 pid: 9558 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065132.421751:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87ec58 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bc9 expref: 6 pid: 9558 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065132.421756:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017b480 00000100:00100000:0.0:1746065132.421766:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2490 00000100:00100000:0.0:1746065132.421770:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272635008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065132.421848:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272635008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 77us (1053us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065132.421853:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2490 00002000:00100000:0.0:1746065132.421857:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b480 x1830881272635008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.421864:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b480 with x1830881272635008 ext(0->4095) 00010000:00010000:0.0:1746065132.421868:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87ec58 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bc9 expref: 6 pid: 9558 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065132.421875:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87ec58 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bc9 expref: 6 pid: 9558 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065132.421880:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017b480 00000100:00100000:0.0:1746065132.423622:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.425307:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.429210:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.429284:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272635648 00000100:00100000:1.0:1746065132.429291:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272635648 00002000:00100000:1.0:1746065132.429328:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2680 x1830881272635648/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.429336:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2680 with x1830881272635648 ext(0->4095) 00010000:00010000:1.0:1746065132.429343:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87ec5f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bd0 expref: 43 pid: 9558 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.429356:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87ec5f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bd0 expref: 43 pid: 9558 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.429361:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b2680 00000100:00100000:1.0:1746065132.429377:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2491 00000100:00100000:1.0:1746065132.429383:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2005:x1830881272635648:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.429587:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2005:x1830881272635648:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 203us (387us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.429595:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2491 00002000:00100000:1.0:1746065132.429600:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2680 x1830881272635648/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.429607:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2680 with x1830881272635648 ext(0->4095) 00010000:00010000:1.0:1746065132.429611:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87ec5f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bd0 expref: 43 pid: 9558 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.429619:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f87ec5f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bd0 expref: 43 pid: 9558 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.429625:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b2680 00000100:00100000:0.0:1746065132.433806:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.436048:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.436209:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272636032 00000100:00100000:1.0:1746065132.436215:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272636032 00002000:00100000:1.0:1746065132.436241:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a3100 x1830881272636032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.436249:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a3100 with x1830881272636032 ext(0->4095) 00002000:00010000:1.0:1746065132.436253:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a3100 00000100:00100000:1.0:1746065132.436277:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13291 00000100:00100000:1.0:1746065132.436283:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2003:x1830881272636032:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065132.436423:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2003:x1830881272636032:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 138us (374us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.436428:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13291 00002000:00100000:1.0:1746065132.436433:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a3100 x1830881272636032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.436445:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a3100 with x1830881272636032 ext(0->4095) 00002000:00010000:1.0:1746065132.436447:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a3100 00000100:00100000:0.0:1746065132.437853:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.442543:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.447573:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.448111:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272636544 00000100:00100000:1.0:1746065132.448117:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272636544 00002000:00100000:1.0:1746065132.448146:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a3480 x1830881272636544/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.448154:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a3480 with x1830881272636544 ext(0->4095) 00002000:00010000:1.0:1746065132.448158:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a3480 00000100:00100000:1.0:1746065132.448180:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13292 00000100:00100000:1.0:1746065132.448185:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272636544:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.448282:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272636544:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 97us (711us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.448287:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13292 00002000:00100000:1.0:1746065132.448291:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a3480 x1830881272636544/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.448297:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a3480 with x1830881272636544 ext(0->4095) 00002000:00010000:1.0:1746065132.448300:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a3480 00000100:00100000:0.0:1746065132.448916:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.451567:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.454916:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.458718:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.463073:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.467457:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.468035:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272637568 00000100:00100000:1.0:1746065132.468042:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272637568 00002000:00100000:1.0:1746065132.468077:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e8e00 x1830881272637568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.468250:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8e00 with x1830881272637568 ext(0->4095) 00002000:00010000:1.0:1746065132.468254:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4e8e00 00000100:00100000:1.0:1746065132.468283:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13293 00000100:00100000:1.0:1746065132.468290:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2002:x1830881272637568:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065132.468701:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2002:x1830881272637568:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 409us (1244us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.468707:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13293 00002000:00100000:1.0:1746065132.468713:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e8e00 x1830881272637568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.468719:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8e00 with x1830881272637568 ext(0->4095) 00002000:00010000:1.0:1746065132.468722:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4e8e00 00000100:00100000:0.0:1746065132.470522:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.475530:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.478281:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272638208 00000100:00100000:1.0:1746065132.478284:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272638208 00002000:00100000:1.0:1746065132.478304:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017a300 x1830881272638208/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.478312:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017a300 with x1830881272638208 ext(0->4095) 00010000:00010000:1.0:1746065132.478317:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87ec82 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bf3 expref: 6 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.478325:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87ec82 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bf3 expref: 6 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.478330:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017a300 00000100:00100000:1.0:1746065132.478349:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2493 00000100:00100000:1.0:1746065132.478353:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272638208:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.478450:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272638208:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (565us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.478455:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2493 00002000:00100000:1.0:1746065132.478459:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017a300 x1830881272638208/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.478466:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017a300 with x1830881272638208 ext(0->4095) 00010000:00010000:1.0:1746065132.478470:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87ec82 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bf3 expref: 6 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.478477:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87ec82 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4bf3 expref: 6 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.478482:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017a300 00000100:00100000:0.0:1746065132.480961:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.483802:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.486646:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267524224:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065132.486663:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065132.486703:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272638464:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2541us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065132.486713:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13700 00000100:00100000:0.0:1746065132.487119:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.490315:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.494722:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.496873:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.496926:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272639232 00000100:00100000:1.0:1746065132.496931:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272639232 00000100:00100000:1.0:1746065132.496963:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29730 00000100:00100000:1.0:1746065132.496968:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272639232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.496979:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.497000:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec97 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4c08 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.497020:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ec90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c01 expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.497026:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.497027:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.497030:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec97 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c08 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.497054:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ec90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c01 expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.497063:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ec90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c01 expref: 41 pid: 9560 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.497072:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267524480:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.497148:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.498903:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267524480:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.498924:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec97 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c08 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.498936:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065132.498973:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272639232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2004us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.498980:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29730 00000100:00100000:0.0:1746065132.499522:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.503585:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.503637:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.503684:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272639616 00000100:00100000:1.0:1746065132.503690:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272639616 00002000:00100000:1.0:1746065132.503721:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549fb80 x1830881272639616/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.503730:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549fb80 with x1830881272639616 ext(0->4095) 00002000:00010000:1.0:1746065132.503734:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549fb80 00000100:00100000:1.0:1746065132.504023:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13295 00000100:00100000:1.0:1746065132.504030:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272639616:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.504128:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272639616:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 99us (549us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.504132:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13295 00002000:00100000:1.0:1746065132.504136:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549fb80 x1830881272639616/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.504143:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549fb80 with x1830881272639616 ext(0->4095) 00002000:00010000:1.0:1746065132.504145:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549fb80 00000100:00100000:1.0:1746065132.504158:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272639744 00000100:00100000:1.0:1746065132.504161:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272639744 00000100:00100000:1.0:1746065132.504184:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29731 00000100:00100000:1.0:1746065132.504188:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:1791:x1830881272639744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.504195:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.504206:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ec9e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4c0f expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.504224:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec97 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c08 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.504229:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.504231:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.504234:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ec9e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c0f expref: 42 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.504254:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c08 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.504266:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ec97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c08 expref: 5 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.504275:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267524736:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.504314:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.506595:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.506701:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267524736:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.506723:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f400/0x392ae0376f87ec9e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c0f expref: 42 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.506737:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f400, rc 0) 00000100:00100000:1.0:1746065132.506773:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1791:x1830881272639744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2583us (3135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.506780:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29731 00000100:00100000:1.0:1746065132.507154:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272639872 00000100:00100000:1.0:1746065132.507160:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272639872 00000100:00100000:0.0:1746065132.509187:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.514377:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.517909:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.524563:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.526816:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.528638:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29733 00000100:00100000:1.0:1746065132.528649:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272640768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.528663:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.528677:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4c1d expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.528700:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87eca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c16 expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.528712:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.528714:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.528717:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecac lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c1d expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.528739:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87eca5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c16 expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.528749:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87eca5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c16 expref: 41 pid: 9560 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.528759:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267525248:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.528834:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.530222:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267525248:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.530240:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecac lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c1d expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.530252:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065132.530276:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272640768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1630us (3465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.530282:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29733 00000100:00100000:1.0:1746065132.533664:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.535519:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.540113:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.544970:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.547348:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.550853:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.553035:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.557042:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.558659:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.560999:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.562782:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.564034:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.565855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.567893:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.568107:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272643200 00000100:00100000:1.0:1746065132.568113:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272643200 00002000:00100000:1.0:1746065132.568141:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff7800 x1830881272643200/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.568154:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7800 with x1830881272643200 ext(0->4095) 00002000:00010000:1.0:1746065132.568158:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff7800 00000100:00100000:1.0:1746065132.568185:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13299 00000100:00100000:1.0:1746065132.568192:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881272643200:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.568290:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881272643200:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (399us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.568295:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13299 00002000:00100000:1.0:1746065132.568300:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff7800 x1830881272643200/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.568306:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7800 with x1830881272643200 ext(0->4095) 00002000:00010000:1.0:1746065132.568309:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff7800 00000100:00100000:0.0:1746065132.569875:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.572500:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.572587:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272643456 00000100:00100000:1.0:1746065132.572593:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272643456 00002000:00100000:1.0:1746065132.572620:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fff5f80 x1830881272643456/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 496/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.572629:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5f80 with x1830881272643456 ext(0->7) 00010000:00010000:1.0:1746065132.572635:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ecc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c39 expref: 42 pid: 9559 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.572646:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ecc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c39 expref: 42 pid: 9559 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.572652:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5f80 00000100:00100000:1.0:1746065132.572676:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2498 00000100:00100000:1.0:1746065132.572683:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881272643456:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065132.574910:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.577254:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.579921:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272643968 00000100:00100000:0.0:1746065132.579927:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272643968 00000100:00100000:0.0:1746065132.579960:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29739 00000100:00100000:0.0:1746065132.579965:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1795:x1830881272643968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065132.579977:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065132.580000:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87ecd6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4c47 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.580023:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87eccf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c40 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.580029:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065132.580031:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065132.580034:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87ecd6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c47 expref: 44 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.580054:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87eccf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c40 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.580064:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d185400/0x392ae0376f87eccf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c40 expref: 5 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746065132.580074:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267526784:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065132.580157:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.582396:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.586943:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.587326:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272644352 00000100:00100000:0.0:1746065132.587333:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272644352 00002000:00100000:0.0:1746065132.587364:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18df80 x1830881272644352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.587373:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18df80 with x1830881272644352 ext(0->4095) 00002000:00010000:0.0:1746065132.587378:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f18df80 00000100:00100000:0.0:1746065132.587405:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13301 00000100:00100000:0.0:1746065132.587410:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2004:x1830881272644352:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065132.587511:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2004:x1830881272644352:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 100us (574us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065132.587517:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13301 00002000:00100000:0.0:1746065132.587522:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18df80 x1830881272644352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.587528:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18df80 with x1830881272644352 ext(0->4095) 00002000:00010000:0.0:1746065132.587530:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f18df80 00000100:00100000:1.0:1746065132.592539:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c4d7531-7474-4559-997c-c1b3824c301a:3767:1830881267527040:0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.592569:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065132.592596:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267527552:0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.592614:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065132.592626:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267528064:0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.592643:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065132.592653:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267528576:0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.592664:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065132.592686:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267527040 00000100:00100000:1.0:1746065132.592689:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267527040 00000100:00100000:1.0:1746065132.592711:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1746065132.592715:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3767:x1830881267527040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.592738:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3767:x1830881267527040:12345-0@lo:400:kworker.0 Request processed in 23us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.592742:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1746065132.592761:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267527296 00000100:00100000:1.0:1746065132.592763:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267527296 00000100:00100000:1.0:1746065132.592777:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267527552 00000100:00100000:1.0:1746065132.592778:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267527552 00000100:00100000:1.0:1746065132.592788:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1746065132.592791:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3765:x1830881267527296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.592811:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3765:x1830881267527296:12345-0@lo:400:kworker.0 Request processed in 20us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.592818:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1746065132.592825:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1746065132.592829:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267527552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.592845:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267527552:12345-0@lo:400:kworker.0 Request processed in 17us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.592849:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1746065132.592855:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3766:1830881267527424:0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.592870:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c4d7531-7474-4559-997c-c1b3824c301a:3767:1830881267527040:0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.592878:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267527552:0@lo:400:kworker.0 00000100:00100000:0.0:1746065132.592879:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065132.592891:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267527936:0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.592894:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267528064 00000100:00100000:1.0:1746065132.592896:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267528064 00000100:00100000:0.0:1746065132.592905:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065132.592915:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267528448:0@lo:400:kworker.0 00000100:00100000:0.0:1746065132.592928:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065132.594273:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267528576 00000100:00100000:0.0:1746065132.594273:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3766:1830881267527424:0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.594276:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267528576 00000100:00080000:0.0:1746065132.594289:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065132.594292:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746065132.594293:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065132.594295:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065132.594300:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267527936 00000100:00100000:1.0:1746065132.594302:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267527936 00000100:00100000:1.0:1746065132.594321:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267528448 00000100:00080000:0.0:1746065132.594321:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065132.594322:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267528448 00000100:00080000:0.0:1746065132.594333:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065132.594339:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:1.0:1746065132.594342:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3767:x1830881267528064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065132.594360:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.594371:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3767:x1830881267528064:12345-0@lo:400:kworker.0 Request processed in 28us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.594375:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1746065132.594382:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267528064:0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.594383:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272644480 00000100:00100000:1.0:1746065132.594385:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272644480 00000100:00100000:1.0:1746065132.594394:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1746065132.594397:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267528576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.594435:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267528576:12345-0@lo:400:kworker.0 Request processed in 37us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.594440:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1746065132.594448:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:1.0:1746065132.594452:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267527936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.594473:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267527936:12345-0@lo:400:kworker.0 Request processed in 21us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.594477:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:1.0:1746065132.594484:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1746065132.594488:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267528448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.594504:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267528448:12345-0@lo:400:kworker.0 Request processed in 17us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.594508:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1746065132.594515:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29740 00000100:00100000:1.0:1746065132.594519:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272644480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.594527:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.594539:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecdd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4c4e expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.594559:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87ecd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c47 expref: 43 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.594566:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.594568:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.594572:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecdd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c4e expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.594591:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87ecd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c47 expref: 43 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.594601:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87ecd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c47 expref: 43 pid: 9559 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.594610:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267528704:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.594650:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.595028:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267528576:0@lo:400:kworker.0 00000100:00100000:0.0:1746065132.595045:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267527936:0@lo:400:kworker.0 00000100:00100000:0.0:1746065132.595051:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267528448:0@lo:400:kworker.0 00000100:00100000:1.0:1746065132.603140:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267528704:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.603165:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecdd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c4e expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.603182:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065132.603244:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272644480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8722us (8883us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.603252:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29740 00000100:00100000:0.0:1746065132.603898:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000001:00080000:0.0:1746065132.604648:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970735 is committed 00000100:00100000:0.0:1746065132.609977:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2003:x1830881272644608:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 5069us (6069us total) trans 4294972044 rc 0/0 00000100:00100000:0.0:1746065132.610000:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2499 00002000:00100000:0.0:1746065132.610014:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a0918a80 x1830881272644608/t4294972044(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 496/448 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.610028:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918a80 with x1830881272644608 ext(0->7) 00010000:00010000:0.0:1746065132.610036:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87ecd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c47 expref: 46 pid: 9559 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065132.610051:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87ecd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c47 expref: 46 pid: 9559 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065132.610058:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918a80 00000100:00100000:0.0:1746065132.613447:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.613522:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272644736 00000100:00100000:1.0:1746065132.613529:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272644736 00000100:00100000:1.0:1746065132.613571:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29741 00000100:00100000:1.0:1746065132.613577:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:1791:x1830881272644736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.613591:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.613604:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ece4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4c55 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.613625:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.613630:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecdd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c4e expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.613639:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065132.613642:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ece4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c55 expref: 47 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.613670:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecdd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c4e expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.613680:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ece4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c55 expref: 47 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.613688:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065132.613722:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:1791:x1830881272644736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.613727:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29741 00000100:00100000:0.0:1746065132.614897:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.617644:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.620032:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.624690:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.627366:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.630420:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.632773:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.636851:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.637810:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.640494:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29744 00000100:00100000:1.0:1746065132.640501:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:1795:x1830881272646272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.640508:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.640514:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecf9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4c6a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.640524:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.640528:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87ecf2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c63 expref: 48 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.640532:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.640534:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecf9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c6a expref: 48 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.640559:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87ecf2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c63 expref: 48 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.640568:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ecf9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c6a expref: 48 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.640576:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065132.640629:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:1795:x1830881272646272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 129us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.640635:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29744 00000100:00100000:0.0:1746065132.645520:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.649628:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.652327:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.655284:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065132.655298:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267529984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065132.655338:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065132.655435:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267529984 00000100:00100000:1.0:1746065132.655441:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267529984 00000100:00100000:1.0:1746065132.655476:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1746065132.655482:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267529984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746065132.655499:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 505944896 pending 573440 free 3920867328 avail 3689345024 00000100:00100000:1.0:1746065132.655531:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267529984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.655537:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1746065132.656303:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267529984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065132.657365:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.660131:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.663644:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.666418:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.671900:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.671998:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.677077:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.680723:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.681100:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272648192 00000100:00100000:0.0:1746065132.681105:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272648192 00002000:00100000:0.0:1746065132.681136:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76d80 x1830881272648192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.681144:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76d80 with x1830881272648192 ext(0->4095) 00010000:00010000:0.0:1746065132.681150:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ed0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c7f expref: 47 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065132.681161:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ed0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c7f expref: 47 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065132.681167:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76d80 00000100:00100000:0.0:1746065132.681182:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2502 00000100:00100000:0.0:1746065132.681188:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:2005:x1830881272648192:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065132.681289:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:2005:x1830881272648192:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 101us (566us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065132.681294:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2502 00002000:00100000:0.0:1746065132.681298:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76d80 x1830881272648192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.681311:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76d80 with x1830881272648192 ext(0->4095) 00010000:00010000:0.0:1746065132.681314:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ed0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c7f expref: 47 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065132.681322:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ed0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c7f expref: 47 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065132.681327:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76d80 00000100:00100000:0.0:1746065132.684891:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.685731:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.688258:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.688302:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272648704 00000100:00100000:1.0:1746065132.688307:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272648704 00002000:00100000:1.0:1746065132.688417:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76680 x1830881272648704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.688425:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76680 with x1830881272648704 ext(0->4095) 00010000:00010000:1.0:1746065132.688431:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ed07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c78 expref: 46 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.688444:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ed07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c78 expref: 46 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.688450:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76680 00000100:00100000:1.0:1746065132.688474:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2503 00000100:00100000:1.0:1746065132.688479:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272648704:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.688579:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272648704:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (320us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.688584:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2503 00002000:00100000:1.0:1746065132.688589:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76680 x1830881272648704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.688596:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76680 with x1830881272648704 ext(0->4095) 00010000:00010000:1.0:1746065132.688601:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ed07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c78 expref: 46 pid: 9560 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.688609:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ed07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c78 expref: 46 pid: 9560 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.688614:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76680 00000100:00100000:0.0:1746065132.690005:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.690069:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.692132:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.695077:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.699054:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.699371:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272649600 00000100:00100000:1.0:1746065132.699376:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272649600 00002000:00100000:1.0:1746065132.699404:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5c00 x1830881272649600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.699412:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5c00 with x1830881272649600 ext(0->4095) 00002000:00010000:1.0:1746065132.699416:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a5c00 00000100:00100000:1.0:1746065132.699430:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13306 00000100:00100000:1.0:1746065132.699436:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2004:x1830881272649600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.699537:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2004:x1830881272649600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 101us (488us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.699542:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13306 00002000:00100000:1.0:1746065132.699547:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5c00 x1830881272649600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.699553:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5c00 with x1830881272649600 ext(0->4095) 00002000:00010000:1.0:1746065132.699555:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a5c00 00000100:00100000:0.0:1746065132.701566:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.703761:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.705372:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.707559:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.708599:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.708830:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272650368 00000100:00100000:1.0:1746065132.708834:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272650368 00000100:00100000:1.0:1746065132.708865:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29752 00000100:00100000:1.0:1746065132.708870:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:1791:x1830881272650368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.708878:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.708891:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ed31 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4ca2 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.708904:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.709198:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87ed2a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c9b expref: 48 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.709206:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.709210:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ed31 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ca2 expref: 48 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.709238:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87ed2a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c9b expref: 48 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.709247:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ed31 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ca2 expref: 48 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.709256:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065132.709381:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:1791:x1830881272650368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 509us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.709386:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29752 00000100:00100000:0.0:1746065132.710017:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.713074:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.713348:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272650752 00000100:00100000:1.0:1746065132.713354:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272650752 00002000:00100000:1.0:1746065132.713387:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f9500 x1830881272650752/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.713396:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9500 with x1830881272650752 ext(0->4095) 00010000:00010000:1.0:1746065132.713403:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87ed2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c9b expref: 47 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.713414:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87ed2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c9b expref: 47 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.713419:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9f9500 00000100:00100000:1.0:1746065132.713448:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2505 00000100:00100000:1.0:1746065132.713455:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:2004:x1830881272650752:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.713546:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:2004:x1830881272650752:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 91us (473us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.713552:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2505 00002000:00100000:1.0:1746065132.713557:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f9500 x1830881272650752/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.713564:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9500 with x1830881272650752 ext(0->4095) 00010000:00010000:1.0:1746065132.713568:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87ed2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c9b expref: 47 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.713576:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87ed2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4c9b expref: 47 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.713581:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9f9500 00000100:00100000:0.0:1746065132.715211:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.715301:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.717414:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.719198:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.719228:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.722245:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.722563:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272651776 00000100:00100000:1.0:1746065132.722568:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272651776 00002000:00100000:1.0:1746065132.722593:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b3480 x1830881272651776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.722601:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b3480 with x1830881272651776 ext(0->4095) 00010000:00010000:1.0:1746065132.722607:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ed38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ca9 expref: 6 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.722618:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ed38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ca9 expref: 6 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.722623:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b3480 00000100:00100000:1.0:1746065132.722740:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2507 00000100:00100000:1.0:1746065132.722746:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272651776:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.722829:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272651776:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 83us (585us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.722834:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2507 00002000:00100000:1.0:1746065132.722838:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b3480 x1830881272651776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.722844:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b3480 with x1830881272651776 ext(0->4095) 00010000:00010000:1.0:1746065132.722848:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ed38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ca9 expref: 6 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.722856:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ed38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ca9 expref: 6 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.722861:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b3480 00000100:00100000:0.0:1746065132.725454:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.728380:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.734185:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.735531:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29755 00000100:00100000:1.0:1746065132.735542:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272652288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.735556:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.735571:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4cb7 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.735594:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87ed3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb0 expref: 45 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.735601:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.735602:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.735605:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed46 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb7 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.735634:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87ed3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb0 expref: 45 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.735645:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87ed3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb0 expref: 45 pid: 9635 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.735656:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267532672:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.736107:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.739511:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267532672:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.739536:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed46 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb7 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.739551:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065132.739583:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272652288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4044us (5406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.739590:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29755 00000100:00100000:0.0:1746065132.740630:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.740695:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272652416 00000100:00100000:1.0:1746065132.740701:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272652416 00000100:00100000:1.0:1746065132.740930:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29756 00000100:00100000:1.0:1746065132.740936:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:1791:x1830881272652416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.740948:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.740960:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ed4d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4cbe expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.740977:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.740981:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb7 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.740986:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065132.741023:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ed4d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cbe expref: 47 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.741046:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed46 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb7 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.741055:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ed4d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cbe expref: 47 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.741062:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065132.741104:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:1791:x1830881272652416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 168us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.741110:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29756 00000100:00100000:0.0:1746065132.741615:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.746160:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.746298:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272652800 00000100:00100000:1.0:1746065132.746304:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272652800 00002000:00100000:1.0:1746065132.746335:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ed80 x1830881272652800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.746344:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ed80 with x1830881272652800 ext(0->4095) 00010000:00010000:1.0:1746065132.746351:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb7 expref: 6 pid: 9642 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.746363:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb7 expref: 6 pid: 9642 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.746373:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ed80 00000100:00100000:1.0:1746065132.746391:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2508 00000100:00100000:1.0:1746065132.746396:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272652800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.746481:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272652800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 85us (326us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.746486:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2508 00002000:00100000:1.0:1746065132.746490:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ed80 x1830881272652800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.746497:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ed80 with x1830881272652800 ext(0->4095) 00010000:00010000:1.0:1746065132.746500:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb7 expref: 6 pid: 9642 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.746507:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cb7 expref: 6 pid: 9642 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.746512:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ed80 00000100:00100000:0.0:1746065132.752459:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.756771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.756823:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272653184 00000100:00100000:1.0:1746065132.756833:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272653184 00002000:00100000:1.0:1746065132.756867:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1c00 x1830881272653184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.756878:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1c00 with x1830881272653184 ext(0->4095) 00002000:00010000:1.0:1746065132.756882:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a1c00 00000100:00100000:1.0:1746065132.756910:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13309 00000100:00100000:1.0:1746065132.756916:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272653184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.757046:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272653184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 130us (276us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.757052:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13309 00002000:00100000:1.0:1746065132.757065:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1c00 x1830881272653184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.757073:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1c00 with x1830881272653184 ext(0->4095) 00002000:00010000:1.0:1746065132.757075:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a1c00 00000100:00100000:0.0:1746065132.761591:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.766316:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.779334:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.780807:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.781786:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.781813:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272653952 00000100:00100000:0.0:1746065132.781817:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272653952 00002000:00100000:0.0:1746065132.781842:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091d500 x1830881272653952/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.781850:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091d500 with x1830881272653952 ext(0->4095) 00002000:00010000:0.0:1746065132.781855:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091d500 00000100:00100000:0.0:1746065132.782449:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2510 00000100:00100000:0.0:1746065132.782455:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272653952:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746065132.782554:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272653952:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 99us (769us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065132.782559:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2510 00002000:00100000:0.0:1746065132.782565:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091d500 x1830881272653952/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.782571:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091d500 with x1830881272653952 ext(0->4095) 00010000:00010000:0.0:1746065132.782576:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ed54 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cc5 expref: 6 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065132.782586:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ed54 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cc5 expref: 6 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065132.782592:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091d500 00000100:00100000:0.0:1746065132.784226:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.787806:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.791608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.791937:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272654464 00000100:00100000:1.0:1746065132.791943:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272654464 00002000:00100000:1.0:1746065132.791969:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb96680 x1830881272654464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.791978:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb96680 with x1830881272654464 ext(0->4095) 00010000:00010000:1.0:1746065132.791984:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ed5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ccc expref: 49 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.792004:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ed5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ccc expref: 49 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.792011:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb96680 00000100:00100000:1.0:1746065132.792024:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2511 00000100:00100000:1.0:1746065132.792030:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881272654464:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.792136:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881272654464:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 105us (534us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.792141:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2511 00002000:00100000:1.0:1746065132.792146:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb96680 x1830881272654464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.792153:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb96680 with x1830881272654464 ext(0->4095) 00010000:00010000:1.0:1746065132.792158:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ed5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ccc expref: 49 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.792165:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ed5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ccc expref: 49 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.792170:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb96680 00000100:00100000:0.0:1746065132.796855:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.801896:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.802002:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272654848 00000100:00100000:1.0:1746065132.802012:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272654848 00002000:00100000:1.0:1746065132.802048:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1c00 x1830881272654848/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.802057:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1c00 with x1830881272654848 ext(0->4095) 00002000:00010000:1.0:1746065132.802061:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a1c00 00000100:00100000:1.0:1746065132.802105:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13311 00000100:00100000:1.0:1746065132.802112:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881272654848:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.802220:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881272654848:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 108us (331us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.802225:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13311 00002000:00100000:1.0:1746065132.802230:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1c00 x1830881272654848/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.802237:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1c00 with x1830881272654848 ext(0->4095) 00002000:00010000:1.0:1746065132.802239:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a1c00 00000100:00100000:0.0:1746065132.804752:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.808881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.812432:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.812509:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.812575:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272655360 00000100:00100000:1.0:1746065132.812582:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272655360 00002000:00100000:1.0:1746065132.812614:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a0e00 x1830881272655360/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.812623:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0e00 with x1830881272655360 ext(0->4095) 00002000:00010000:1.0:1746065132.812628:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a0e00 00000100:00100000:1.0:1746065132.812643:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13312 00000100:00100000:1.0:1746065132.812648:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272655360:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.812756:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272655360:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 107us (329us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.812762:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13312 00002000:00100000:1.0:1746065132.812768:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a0e00 x1830881272655360/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.812775:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0e00 with x1830881272655360 ext(0->4095) 00002000:00010000:1.0:1746065132.812777:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a0e00 00000100:00100000:1.0:1746065132.817072:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272655616 00000100:00100000:1.0:1746065132.817103:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272655616 00000100:00100000:0.0:1746065132.821363:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.821412:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272656000 00000100:00100000:1.0:1746065132.821416:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272656000 00002000:00100000:1.0:1746065132.821441:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2d80 x1830881272656000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.821450:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2d80 with x1830881272656000 ext(0->4095) 00010000:00010000:1.0:1746065132.821455:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ed70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ce1 expref: 49 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.821469:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ed70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ce1 expref: 49 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.821474:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a2d80 00000100:00100000:1.0:1746065132.821488:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2512 00000100:00100000:1.0:1746065132.821493:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2005:x1830881272656000:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.821596:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2005:x1830881272656000:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (234us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.821601:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2512 00002000:00100000:1.0:1746065132.821606:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2d80 x1830881272656000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.821617:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2d80 with x1830881272656000 ext(0->4095) 00010000:00010000:1.0:1746065132.821622:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ed70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ce1 expref: 49 pid: 9635 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.821630:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ed70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ce1 expref: 49 pid: 9635 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.821635:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a2d80 00000100:00100000:0.0:1746065132.823536:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.828710:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.828797:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272656384 00000100:00100000:1.0:1746065132.828802:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272656384 00002000:00100000:1.0:1746065132.828832:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f729c00 x1830881272656384/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.828841:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729c00 with x1830881272656384 ext(0->4095) 00002000:00010000:1.0:1746065132.828845:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f729c00 00000100:00100000:1.0:1746065132.828869:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13313 00000100:00100000:1.0:1746065132.828875:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2005:x1830881272656384:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.828975:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2005:x1830881272656384:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 100us (266us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.828980:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13313 00002000:00100000:1.0:1746065132.828984:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f729c00 x1830881272656384/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.829001:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729c00 with x1830881272656384 ext(0->4095) 00002000:00010000:1.0:1746065132.829003:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f729c00 00000100:00100000:0.0:1746065132.830042:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.830106:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272656512 00000100:00100000:1.0:1746065132.830111:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272656512 00000100:00100000:1.0:1746065132.830141:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29763 00000100:00100000:1.0:1746065132.830146:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272656512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.830155:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.830168:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ed7e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4cef expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.830188:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87ed77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ce8 expref: 47 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.830194:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.830196:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.830199:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ed7e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cef expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.830226:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87ed77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ce8 expref: 47 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.830236:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87ed77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ce8 expref: 47 pid: 9635 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.830246:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267534848:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.830304:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.830936:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267534848:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.830954:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ed7e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cef expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.830962:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065132.830976:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272656512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 831us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.830980:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29763 00000100:00100000:1.0:1746065132.831412:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267534976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746065132.831613:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065132.832111:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.832175:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267534976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065132.833699:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.835273:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.835314:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272657024 00000100:00100000:1.0:1746065132.835318:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272657024 00000100:00100000:1.0:1746065132.835352:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29764 00000100:00100000:1.0:1746065132.835357:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:1795:x1830881272657024:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.835368:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.835380:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4cf6 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.835398:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ed7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cef expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.835404:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.835405:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.835408:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed85 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cf6 expref: 48 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.835428:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ed7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cef expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.835437:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ed7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cef expref: 5 pid: 9642 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.835447:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267535232:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.835506:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.836526:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267535232:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.836540:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed85 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cf6 expref: 48 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.836549:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065132.836567:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:1795:x1830881272657024:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1210us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.836575:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29764 00000100:00100000:0.0:1746065132.836690:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.839151:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.840941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.841003:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272657536 00000100:00100000:1.0:1746065132.841008:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272657536 00000100:00100000:1.0:1746065132.841051:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29765 00000100:00100000:1.0:1746065132.841057:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272657536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.841067:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.841110:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ed8c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4cfd expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.841132:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cf6 expref: 47 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.841140:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.841142:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.841145:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ed8c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cfd expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.841169:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cf6 expref: 47 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.841179:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cf6 expref: 47 pid: 9642 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065132.841191:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267535488:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065132.841271:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.845477:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.848159:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2005:x1830881272657664:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2505us (2676us total) trans 4294972046 rc 0/0 00000100:00100000:0.0:1746065132.848168:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2513 00002000:00100000:0.0:1746065132.848175:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d1e0e00 x1830881272657664/t4294972046(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 496/448 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.848184:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0e00 with x1830881272657664 ext(0->7) 00010000:00010000:0.0:1746065132.848191:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cf6 expref: 50 pid: 9642 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065132.848205:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ed85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cf6 expref: 50 pid: 9642 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065132.848211:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e0e00 00000100:00100000:0.0:1746065132.852230:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.852942:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.857031:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.857298:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272658176 00000100:00100000:1.0:1746065132.857303:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272658176 00002000:00100000:1.0:1746065132.857332:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253c700 x1830881272658176/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.857341:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253c700 with x1830881272658176 ext(0->4095) 00010000:00010000:1.0:1746065132.857347:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ed8c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cfd expref: 6 pid: 9642 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.857357:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ed8c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cfd expref: 6 pid: 9642 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.857362:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253c700 00000100:00100000:1.0:1746065132.857487:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2514 00000100:00100000:1.0:1746065132.857494:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272658176:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.857710:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272658176:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 216us (685us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.857716:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2514 00002000:00100000:1.0:1746065132.857721:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253c700 x1830881272658176/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.857729:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253c700 with x1830881272658176 ext(0->4095) 00010000:00010000:1.0:1746065132.857733:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ed8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cfd expref: 6 pid: 9642 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065132.857741:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ed8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4cfd expref: 6 pid: 9642 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065132.857746:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253c700 00000100:00100000:0.0:1746065132.859596:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.862803:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.863009:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272658560 00000100:00100000:1.0:1746065132.863014:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272658560 00002000:00100000:1.0:1746065132.863040:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79e680 x1830881272658560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.863049:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79e680 with x1830881272658560 ext(0->4095) 00002000:00010000:1.0:1746065132.863052:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79e680 00000100:00100000:1.0:1746065132.863653:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13316 00000100:00100000:1.0:1746065132.863661:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2004:x1830881272658560:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.863749:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2004:x1830881272658560:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (953us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.863755:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13316 00002000:00100000:1.0:1746065132.863759:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79e680 x1830881272658560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.863766:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79e680 with x1830881272658560 ext(0->4095) 00002000:00010000:1.0:1746065132.863769:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79e680 00000100:00100000:0.0:1746065132.875122:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.879761:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.879794:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.880914:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2005:x1830881272658816:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 939us (1155us total) trans 4294972047 rc 0/0 00000100:00100000:0.0:1746065132.880922:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2515 00002000:00100000:0.0:1746065132.880928:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d79dc00 x1830881272658816/t4294972047(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 496/448 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.880935:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79dc00 with x1830881272658816 ext(0->7) 00010000:00010000:0.0:1746065132.880939:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87ed93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d04 expref: 53 pid: 9642 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065132.880948:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87ed93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d04 expref: 53 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065132.880953:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79dc00 00000100:00100000:0.0:1746065132.882554:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.885046:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.887356:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.890776:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.891001:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272659712 00000100:00100000:1.0:1746065132.891007:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272659712 00002000:00100000:1.0:1746065132.891036:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb66a00 x1830881272659712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.891044:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb66a00 with x1830881272659712 ext(0->4095) 00002000:00010000:1.0:1746065132.891047:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb66a00 00000100:00100000:1.0:1746065132.891070:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13317 00000100:00100000:1.0:1746065132.891076:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2004:x1830881272659712:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.891194:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2004:x1830881272659712:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 118us (418us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.891202:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13317 00002000:00100000:1.0:1746065132.891206:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb66a00 x1830881272659712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.891212:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb66a00 with x1830881272659712 ext(0->4095) 00002000:00010000:1.0:1746065132.891215:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb66a00 00000100:00100000:0.0:1746065132.892906:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.894959:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.897320:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.899495:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.900366:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.901125:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.903206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.903222:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272660864 00000100:00100000:1.0:1746065132.903226:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272660864 00002000:00100000:1.0:1746065132.903249:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fafad80 x1830881272660864/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.903256:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafad80 with x1830881272660864 ext(0->4095) 00010000:00010000:1.0:1746065132.903262:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87edaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d20 expref: 53 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065132.903271:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87edaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d20 expref: 53 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065132.903276:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fafad80 00000100:00100000:1.0:1746065132.903299:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2517 00000100:00100000:1.0:1746065132.903304:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2004:x1830881272660864:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065132.903400:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2004:x1830881272660864:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (194us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.903405:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2517 00002000:00100000:1.0:1746065132.903410:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fafad80 x1830881272660864/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.903421:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafad80 with x1830881272660864 ext(0->4095) 00010000:00010000:1.0:1746065132.903425:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87edaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d20 expref: 53 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065132.903434:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87edaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d20 expref: 53 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065132.903439:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fafad80 00000100:00100000:0.0:1746065132.905017:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.905108:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.910835:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.911005:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272661376 00000100:00100000:1.0:1746065132.911011:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272661376 00002000:00100000:1.0:1746065132.911046:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0938000 x1830881272661376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.911056:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0938000 with x1830881272661376 ext(0->4095) 00010000:00010000:1.0:1746065132.911062:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87edb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d27 expref: 53 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065132.911074:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87edb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d27 expref: 52 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065132.911102:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0938000 00000100:00100000:1.0:1746065132.911131:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2518 00000100:00100000:1.0:1746065132.911138:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2005:x1830881272661376:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065132.911233:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2005:x1830881272661376:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 96us (405us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065132.911239:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2518 00002000:00100000:1.0:1746065132.911244:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0938000 x1830881272661376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065132.911251:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0938000 with x1830881272661376 ext(0->4095) 00010000:00010000:1.0:1746065132.911257:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87edb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d27 expref: 52 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065132.911264:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87edb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d27 expref: 52 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065132.911269:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0938000 00000100:00100000:0.0:1746065132.913832:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.914731:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.920578:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.924154:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.929824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.932730:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.933029:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272662400 00000100:00100000:1.0:1746065132.933036:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272662400 00000100:00100000:1.0:1746065132.934283:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29774 00000100:00100000:1.0:1746065132.934293:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272662400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.934308:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.934323:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87edcb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4d3c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.934351:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87edc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d35 expref: 51 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.934358:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.934359:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.934362:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87edcb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d3c expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.934391:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87edc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d35 expref: 51 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.934407:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d185800/0x392ae0376f87edc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d35 expref: 51 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065132.934417:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267537792:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065132.935205:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.937843:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267537792:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065132.937867:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87edcb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d3c expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.937882:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065132.937914:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272662400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3623us (5190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.937922:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29774 00000100:00100000:0.0:1746065132.943527:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.943561:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065132.943646:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272662528 00000100:00100000:1.0:1746065132.943654:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272662528 00000100:00100000:1.0:1746065132.943863:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29775 00000100:00100000:1.0:1746065132.943872:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:1791:x1830881272662528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065132.943888:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.943901:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87edd2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4d43 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.943925:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065132.943930:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87edcb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d3c expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.943940:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065132.943943:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87edd2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d43 expref: 53 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.943971:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87edcb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d3c expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.943981:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87edd2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d43 expref: 53 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.944001:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065132.944049:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:1791:x1830881272662528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 178us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.944055:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29775 00000100:00100000:0.0:1746065132.952759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.956857:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.970575:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.989590:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065132.994629:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2002:x1830881272663552:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 4853us (5036us total) trans 4294972048 rc 0/0 00000100:00100000:0.0:1746065132.994640:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2521 00002000:00100000:0.0:1746065132.994648:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f939f80 x1830881272663552/t4294972048(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:48/0 lens 496/448 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065132.994656:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939f80 with x1830881272663552 ext(0->7) 00010000:00010000:0.0:1746065132.994664:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87edd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d43 expref: 54 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065132.994677:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87edd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d43 expref: 54 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065132.994683:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939f80 00000100:00100000:0.0:1746065133.008145:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.008234:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.012477:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.016509:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.021414:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.024855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.032128:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.040341:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881272664704:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 7538us (8208us total) trans 4294972049 rc 0/0 00000100:00100000:0.0:1746065133.040520:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2523 00002000:00100000:0.0:1746065133.040531:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d6c9880 x1830881272664704/t4294972049(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.040539:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9880 with x1830881272664704 ext(0->7) 00010000:00010000:0.0:1746065133.040546:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87ede0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d51 expref: 56 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.040558:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87ede0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d51 expref: 56 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.040564:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9880 00000100:00100000:0.0:1746065133.046178:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.047232:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272664960 00000100:00100000:0.0:1746065133.047237:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272664960 00000100:00100000:0.0:1746065133.047259:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29779 00000100:00100000:0.0:1746065133.047263:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1791:x1830881272664960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065133.047273:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.047282:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4d5f expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.047296:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ede7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d58 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.047306:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.047307:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.047310:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.047325:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ede7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d58 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.047333:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ede7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d58 expref: 5 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065133.047341:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267539072:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065133.047389:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.051343:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267539072:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.051368:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.051380:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:1.0:1746065133.051657:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1791:x1830881272664960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4391us (4524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.051663:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29779 00000100:00100000:0.0:1746065133.055255:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.058572:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.059719:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13751 00000100:00100000:1.0:1746065133.059728:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272665344:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.059737:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.059753:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ede7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d58 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.059762:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ede7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d58 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.059781:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ede7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d58 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.059797:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.059799:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.059805:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 55 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.059813:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 55 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.059846:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 55 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.059857:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267539200:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.061096:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.062621:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267539200:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.062636:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.062751:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272665344:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3024us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.062830:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13751 00000100:00100000:0.0:1746065133.063263:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.063331:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272665600 00000100:00100000:1.0:1746065133.063336:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272665600 00002000:00100000:1.0:1746065133.063360:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cad80 x1830881272665600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.063367:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cad80 with x1830881272665600 ext(0->4095) 00002000:00010000:1.0:1746065133.063371:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cad80 00000100:00100000:1.0:1746065133.063395:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13322 00000100:00100000:1.0:1746065133.063401:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881272665600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.063483:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881272665600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 81us (219us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.063488:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13322 00002000:00100000:1.0:1746065133.063492:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cad80 x1830881272665600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.063499:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cad80 with x1830881272665600 ext(0->4095) 00002000:00010000:1.0:1746065133.063502:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cad80 00000100:00100000:0.0:1746065133.064570:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.064624:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272665728 00000100:00100000:1.0:1746065133.064629:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272665728 00000100:00100000:1.0:1746065133.064663:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29780 00000100:00100000:1.0:1746065133.064668:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272665728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.064677:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.064689:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4d66 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.064712:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 55 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.064718:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.064719:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.064723:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.064744:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 55 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.064753:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 55 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.064763:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267539328:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065133.064822:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.070243:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.070723:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267539328:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.070743:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.070756:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065133.070793:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272665728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6124us (6224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.070798:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29780 00000100:00100000:0.0:1746065133.072709:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2005:x1830881272665856:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2292us (2468us total) trans 4294972050 rc 0/0 00000100:00100000:0.0:1746065133.072716:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2525 00002000:00100000:0.0:1746065133.072723:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072a04a80 x1830881272665856/t4294972050(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.072730:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04a80 with x1830881272665856 ext(0->7) 00010000:00010000:0.0:1746065133.072737:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.072750:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.072756:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a04a80 00000100:00100000:0.0:1746065133.075597:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.075806:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272665984 00000100:00100000:1.0:1746065133.075815:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272665984 00010000:00010000:1.0:1746065133.075846:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.075883:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13752 00000100:00100000:1.0:1746065133.075889:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881272665984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.075901:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.075918:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.075928:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.075947:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87edee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d5f expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.076020:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.076022:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.076029:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.076036:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.076062:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.076072:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267539456:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.076433:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.077647:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267539456:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.077661:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.077684:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881272665984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1795us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.077692:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13752 00000100:00100000:0.0:1746065133.077961:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.078010:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272666240 00000100:00100000:1.0:1746065133.078014:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272666240 00002000:00100000:1.0:1746065133.078037:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8bb80 x1830881272666240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1746065133.078039:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00002000:00100000:1.0:1746065133.078045:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8bb80 with x1830881272666240 ext(0->4095) 00002000:00010000:1.0:1746065133.078048:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8bb80 00000100:00100000:1.0:1746065133.078071:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13323 00000100:00100000:1.0:1746065133.078076:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272666240:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065133.078191:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272666240:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 114us (230us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.078196:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13323 00002000:00100000:1.0:1746065133.078201:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8bb80 x1830881272666240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.078208:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8bb80 with x1830881272666240 ext(0->4095) 00010000:00010000:1.0:1746065133.078212:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.078221:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.078226:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8bb80 00000100:00100000:0.0:1746065133.079823:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.080217:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.080270:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272666624 00000100:00100000:1.0:1746065133.080273:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272666624 00010000:00010000:1.0:1746065133.080287:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.080404:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13753 00000100:00100000:1.0:1746065133.080409:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272666624:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.080416:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.080427:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.080435:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.080448:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87edf5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d66 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.080521:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.080523:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.080528:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.080535:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.080557:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.080566:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.080575:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267539840:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.080620:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.081586:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267539840:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.081595:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.081618:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272666624:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1208us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.081624:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13753 00000100:00100000:0.0:1746065133.081759:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.081879:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272666880 00000100:00100000:1.0:1746065133.081884:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272666880 00002000:00100000:1.0:1746065133.081903:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b89f80 x1830881272666880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.081910:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b89f80 with x1830881272666880 ext(0->4095) 00010000:00010000:1.0:1746065133.081915:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 59 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.081924:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 59 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.081928:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b89f80 00000100:00100000:1.0:1746065133.082012:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2526 00000100:00100000:1.0:1746065133.082021:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2004:x1830881272666880:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.082125:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2004:x1830881272666880:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 107us (366us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.082131:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2526 00002000:00100000:1.0:1746065133.082136:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b89f80 x1830881272666880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.082142:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b89f80 with x1830881272666880 ext(0->4095) 00010000:00010000:1.0:1746065133.082147:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 59 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.082155:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 59 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.082160:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b89f80 00000100:00100000:0.0:1746065133.084160:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.084237:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272667008 00000100:00100000:1.0:1746065133.084243:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272667008 00010000:00010000:1.0:1746065133.084262:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 59 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.084347:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13754 00000100:00100000:1.0:1746065133.084354:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a943dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272667008:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.084368:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.084383:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 59 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.084398:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 59 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.084414:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87edfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d6d expref: 59 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.084547:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.084548:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.084554:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ee03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d74 expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.084561:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ee03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d74 expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.084585:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ee03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d74 expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.084596:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267539968:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.084824:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.087955:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272667264 00000100:00100000:0.0:1746065133.087962:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272667264 00002000:00100000:0.0:1746065133.088041:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a6680 x1830881272667264/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.088050:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a6680 with x1830881272667264 ext(0->4095) 00002000:00010000:0.0:1746065133.088054:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a6680 00000100:00100000:0.0:1746065133.088112:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13324 00000100:00100000:0.0:1746065133.088117:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2004:x1830881272667264:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065133.088205:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2004:x1830881272667264:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 88us (326us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065133.088209:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13324 00002000:00100000:0.0:1746065133.088213:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a6680 x1830881272667264/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.088221:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a6680 with x1830881272667264 ext(0->4095) 00002000:00010000:0.0:1746065133.088222:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a6680 00000100:00100000:1.0:1746065133.088877:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267539968:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.088892:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.089288:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a943dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2005:x1830881272667008:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4932us (5129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.089300:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13754 00000100:00100000:0.0:1746065133.089981:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.090112:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272667392 00000100:00100000:1.0:1746065133.090118:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272667392 00000100:00100000:1.0:1746065133.090238:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29783 00000100:00100000:1.0:1746065133.090244:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272667392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.090254:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.090267:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ee0a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4d7b expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.090287:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ee03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d74 expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.090293:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.090295:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.090298:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ee0a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d7b expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.090319:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ee03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d74 expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.090329:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ee03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d74 expref: 57 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.090338:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267540096:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065133.090403:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.092500:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267540096:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.092524:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ee0a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d7b expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.092538:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065133.092579:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272667392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2334us (2599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.092585:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29783 00000100:00100000:0.0:1746065133.092915:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.093978:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272667520 00000100:00100000:1.0:1746065133.093992:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272667520 00010000:00010000:1.0:1746065133.094017:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ee03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d74 expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.094051:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13755 00000100:00100000:1.0:1746065133.094057:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2005:x1830881272667520:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.094066:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.094111:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ee03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d74 expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.094122:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ee03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d74 expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.094139:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ee03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d74 expref: 58 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.095111:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.095114:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.095122:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ee0a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d7b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.095132:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ee0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d7b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.095166:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ee0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d7b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.095177:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267540224:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.095250:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.100414:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267540224:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.100430:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.100476:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881272667520:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6418us (7561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.100485:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13755 00000100:00100000:1.0:1746065133.100528:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272667904 00000100:00100000:1.0:1746065133.100533:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272667904 00000100:00100000:1.0:1746065133.100557:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29784 00000100:00100000:1.0:1746065133.100563:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1791:x1830881272667904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.100925:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.100939:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ee11 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4d82 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.100959:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ee0a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d7b expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.100965:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.100966:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.100969:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ee11 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d82 expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.101007:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ee0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d7b expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.101017:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87ee0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d7b expref: 6 pid: 9635 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.101026:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267540352:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065133.101240:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.103131:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267540352:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.103151:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ee11 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d82 expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.103162:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065133.103198:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1791:x1830881272667904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2635us (2687us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.103204:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29784 00000100:00100000:0.0:1746065133.106305:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.106399:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.107409:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272668032 00000100:00100000:1.0:1746065133.107414:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272668032 00000100:00100000:1.0:1746065133.107534:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29785 00000100:00100000:1.0:1746065133.107541:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1795:x1830881272668032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.107552:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.107561:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ee18 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4d89 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.107672:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ee11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d82 expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.107679:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.107681:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.107683:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ee18 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d89 expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.107700:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ee11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d82 expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.107709:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87ee11 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d82 expref: 59 pid: 9635 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.107718:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267540608:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065133.108407:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.109537:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.109595:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267540608:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.109610:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ee18 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d89 expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.109620:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065133.109641:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1795:x1830881272668032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2101us (3344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.109646:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29785 00000100:00100000:0.0:1746065133.114428:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.119012:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.120266:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.120326:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272668928 00000100:00100000:1.0:1746065133.120331:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272668928 00000100:00100000:1.0:1746065133.120750:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29786 00000100:00100000:1.0:1746065133.120757:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272668928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.120770:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.120782:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ee1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4d90 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.120802:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ee18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d89 expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.120808:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.120810:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.120813:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ee1f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d90 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.120833:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ee18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d89 expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.120844:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ee18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d89 expref: 57 pid: 9635 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.120853:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267540864:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065133.121320:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.123191:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065133.123375:0:9635:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87ee18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d89 expref: 58 pid: 9635 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.123394:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267540864:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.123410:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ee1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d90 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.123423:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065133.123485:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272668928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2727us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.123518:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29786 00000100:00100000:0.0:1746065133.125060:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.127042:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.127271:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272669440 00000100:00100000:1.0:1746065133.127278:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272669440 00000100:00100000:1.0:1746065133.127847:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29787 00000100:00100000:1.0:1746065133.127855:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1795:x1830881272669440:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.127868:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.127882:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ee26 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4d97 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.127906:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ee1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d90 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.127913:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.127914:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.127917:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ee26 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d97 expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.127941:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ee1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d90 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.127951:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ee1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d90 expref: 5 pid: 9635 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.127967:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267541120:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065133.128073:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.130528:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.130605:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065133.131601:0:9635:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ee1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d90 expref: 6 pid: 9635 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.131615:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f18ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267541120:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.131629:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ee26 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d97 expref: 60 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.131636:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ee26 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d97 expref: 60 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.131643:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065133.131670:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:1795:x1830881272669440:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3816us (4632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.131676:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29787 00000100:00100000:0.0:1746065133.135042:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.135572:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272669952 00000100:00100000:0.0:1746065133.135578:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272669952 00002000:00100000:0.0:1746065133.135605:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fdf80 x1830881272669952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.135613:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fdf80 with x1830881272669952 ext(0->4095) 00010000:00010000:0.0:1746065133.135618:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ee26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d97 expref: 59 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.135629:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ee26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d97 expref: 59 pid: 9635 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.135639:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09fdf80 00000100:00100000:0.0:1746065133.135653:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2528 00000100:00100000:0.0:1746065133.135659:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272669952:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065133.135787:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272669952:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 127us (744us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.135792:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2528 00002000:00100000:1.0:1746065133.135797:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fdf80 x1830881272669952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.135803:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fdf80 with x1830881272669952 ext(0->4095) 00010000:00010000:1.0:1746065133.135806:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ee26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d97 expref: 59 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.135815:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ee26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4d97 expref: 59 pid: 9635 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.135820:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09fdf80 00000100:00100000:0.0:1746065133.137634:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.137828:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.139763:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.142666:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.142748:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.145846:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.148344:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.149373:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.151928:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.154851:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.155459:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272671616 00000100:00100000:1.0:1746065133.155467:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272671616 00002000:00100000:1.0:1746065133.155497:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc39880 x1830881272671616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.155505:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39880 with x1830881272671616 ext(0->4095) 00002000:00010000:1.0:1746065133.155509:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc39880 00000100:00100000:1.0:1746065133.155529:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13328 00000100:00100000:1.0:1746065133.155535:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881272671616:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.155633:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881272671616:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (786us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.155639:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13328 00002000:00100000:1.0:1746065133.155643:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc39880 x1830881272671616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.155650:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39880 with x1830881272671616 ext(0->4095) 00002000:00010000:1.0:1746065133.155653:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc39880 00000100:00100000:0.0:1746065133.157472:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.162065:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.166877:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.169910:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.171639:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.176028:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.176161:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272672768 00000100:00100000:1.0:1746065133.176168:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272672768 00002000:00100000:1.0:1746065133.176198:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ca80 x1830881272672768/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.176211:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ca80 with x1830881272672768 ext(0->4095) 00010000:00010000:1.0:1746065133.176217:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87ee50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4dc1 expref: 59 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.176228:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87ee50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4dc1 expref: 59 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.176234:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ca80 00000100:00100000:1.0:1746065133.176258:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2532 00000100:00100000:1.0:1746065133.176264:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272672768:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065133.176352:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272672768:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 89us (325us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.176357:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2532 00002000:00100000:1.0:1746065133.176362:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ca80 x1830881272672768/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.176368:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ca80 with x1830881272672768 ext(0->4095) 00010000:00010000:1.0:1746065133.176371:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87ee50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4dc1 expref: 59 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.176379:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87ee50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4dc1 expref: 59 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.176384:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ca80 00000100:00100000:0.0:1746065133.178173:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.182572:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.184451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.186874:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.189507:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.189977:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272673664 00000100:00100000:1.0:1746065133.189994:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272673664 00002000:00100000:1.0:1746065133.190026:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a0a80 x1830881272673664/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.190035:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0a80 with x1830881272673664 ext(0->4095) 00002000:00010000:1.0:1746065133.190039:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a0a80 00000100:00100000:1.0:1746065133.190065:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13330 00000100:00100000:1.0:1746065133.190071:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272673664:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.190196:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272673664:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 125us (694us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.190202:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13330 00002000:00100000:1.0:1746065133.190206:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a0a80 x1830881272673664/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.190213:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0a80 with x1830881272673664 ext(0->4095) 00002000:00010000:1.0:1746065133.190216:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a0a80 00000100:00100000:0.0:1746065133.192614:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.192650:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.196385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.201007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.204456:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.205256:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.210099:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.210300:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272674816 00000100:00100000:0.0:1746065133.210305:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272674816 00002000:00100000:0.0:1746065133.210335:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18d880 x1830881272674816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.210344:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18d880 with x1830881272674816 ext(0->4095) 00010000:00010000:0.0:1746065133.210351:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87ee6c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4dd6 expref: 58 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.210362:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87ee6c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4dd6 expref: 58 pid: 9560 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.210368:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18d880 00000100:00100000:0.0:1746065133.210384:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2534 00000100:00100000:0.0:1746065133.210390:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881272674816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065133.210496:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881272674816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 105us (414us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065133.210502:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2534 00002000:00100000:0.0:1746065133.210506:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18d880 x1830881272674816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.210512:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18d880 with x1830881272674816 ext(0->4095) 00010000:00010000:0.0:1746065133.210517:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87ee6c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4dd6 expref: 58 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.210527:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87ee6c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4dd6 expref: 58 pid: 9560 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.210532:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18d880 00000100:00100000:0.0:1746065133.214938:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.214980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.218319:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.218530:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267544192:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065133.218548:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ee7a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4deb expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.218559:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:0.0:1746065133.218581:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1791:x1830881272674944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2961us (3651us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.218587:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29799 00000100:00100000:0.0:1746065133.220372:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272675456 00000100:00100000:0.0:1746065133.220376:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272675456 00010000:00010000:0.0:1746065133.220392:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ee73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4de4 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065133.220423:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13771 00000100:00100000:0.0:1746065133.220429:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272675456:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065133.220437:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065133.220452:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ee73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4de4 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.220463:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ee73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4de4 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.220478:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ee73 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4de4 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.220497:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.220499:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.220505:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ee7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4deb expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.220511:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ee7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4deb expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.220533:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ee7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4deb expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065133.220604:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a091ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267544320:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065133.220799:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.223267:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.225626:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.228705:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.230687:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.232396:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.235014:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.235101:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272676480 00000100:00100000:0.0:1746065133.235106:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272676480 00000100:00100000:0.0:1746065133.235584:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29802 00000100:00100000:0.0:1746065133.235590:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1791:x1830881272676480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065133.235600:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.235930:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b6ca00/0x392ae0376f87ee8f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4e00 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.235946:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.235950:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ee88 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4df9 expref: 59 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.235955:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065133.235958:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6ca00/0x392ae0376f87ee8f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e00 expref: 59 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.235979:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ee88 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4df9 expref: 59 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.236591:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072b6ca00/0x392ae0376f87ee8f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e00 expref: 59 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.236600:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6ca00, rc 0) 00000100:00100000:0.0:1746065133.236625:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1791:x1830881272676480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1035us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.236630:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29802 00000100:00100000:1.0:1746065133.238760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.243267:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.243339:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.245607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.245798:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272677376 00000100:00100000:1.0:1746065133.245804:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272677376 00002000:00100000:1.0:1746065133.245831:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918000 x1830881272677376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.245840:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918000 with x1830881272677376 ext(0->4095) 00010000:00010000:1.0:1746065133.245846:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b6ca00/0x392ae0376f87ee8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e00 expref: 58 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.245862:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b6ca00/0x392ae0376f87ee8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e00 expref: 58 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.245868:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918000 00000100:00100000:1.0:1746065133.245896:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2537 00000100:00100000:1.0:1746065133.245902:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881272677376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.246385:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881272677376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 483us (777us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.246391:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2537 00002000:00100000:1.0:1746065133.246395:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918000 x1830881272677376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.246401:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918000 with x1830881272677376 ext(0->4095) 00010000:00010000:1.0:1746065133.246405:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b6ca00/0x392ae0376f87ee8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e00 expref: 58 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.246412:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b6ca00/0x392ae0376f87ee8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e00 expref: 58 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.246417:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918000 00000100:00100000:0.0:1746065133.250534:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.250630:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.253810:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.253870:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272677888 00000100:00100000:1.0:1746065133.253876:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272677888 00002000:00100000:1.0:1746065133.253909:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f84bb80 x1830881272677888/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.253918:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84bb80 with x1830881272677888 ext(0->4095) 00010000:00010000:1.0:1746065133.253926:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ee96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e07 expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.253937:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ee96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e07 expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.253944:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f84bb80 00000100:00100000:1.0:1746065133.254065:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2538 00000100:00100000:1.0:1746065133.254072:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272677888:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.254359:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272677888:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 287us (550us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.254365:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2538 00002000:00100000:1.0:1746065133.254369:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f84bb80 x1830881272677888/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.254376:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84bb80 with x1830881272677888 ext(0->4095) 00010000:00010000:1.0:1746065133.254380:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ee96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e07 expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.254389:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ee96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e07 expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.254394:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f84bb80 00000100:00100000:0.0:1746065133.258965:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.262561:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267545600:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065133.262577:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065133.262613:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272678016:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3167us (3655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.262622:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13776 00000100:00100000:1.0:1746065133.262699:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.264129:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.267950:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.278677:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.279036:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.279072:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272678912 00000100:00100000:0.0:1746065133.279078:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272678912 00002000:00100000:0.0:1746065133.279344:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f983800 x1830881272678912/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.279352:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983800 with x1830881272678912 ext(0->4095) 00002000:00010000:0.0:1746065133.279356:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f983800 00000100:00100000:0.0:1746065133.279367:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13334 00000100:00100000:0.0:1746065133.279372:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272678912:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065133.279453:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272678912:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 81us (418us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065133.279457:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13334 00002000:00100000:0.0:1746065133.279461:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f983800 x1830881272678912/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.279472:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983800 with x1830881272678912 ext(0->4095) 00002000:00010000:0.0:1746065133.279474:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f983800 00000100:00100000:0.0:1746065133.285194:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272679040 00000100:00100000:0.0:1746065133.285202:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272679040 00000100:00100000:0.0:1746065133.285237:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29807 00000100:00100000:0.0:1746065133.285244:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1795:x1830881272679040:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065133.285258:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.285273:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f87eeb2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4e23 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.285294:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.285299:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeab lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e1c expref: 60 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.285305:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065133.285308:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f87eeb2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e23 expref: 60 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.285336:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeab lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e1c expref: 60 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.285347:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f87eeb2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e23 expref: 60 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.285355:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6c000, rc 0) 00000100:00100000:0.0:1746065133.285391:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:1795:x1830881272679040:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 147us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.285397:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29807 00000100:00100000:0.0:1746065133.288141:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.292795:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.292825:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272679424 00000100:00100000:0.0:1746065133.292832:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272679424 00002000:00100000:0.0:1746065133.292868:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b800 x1830881272679424/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.292877:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b800 with x1830881272679424 ext(0->4095) 00010000:00010000:0.0:1746065133.292885:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeab lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e1c expref: 59 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.292897:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeab lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e1c expref: 59 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.292902:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077b800 00000100:00100000:0.0:1746065133.294336:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2539 00000100:00100000:0.0:1746065133.294347:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272679424:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065133.294463:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272679424:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 119us (1676us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065133.294469:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2539 00002000:00100000:0.0:1746065133.294475:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b800 x1830881272679424/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.294484:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b800 with x1830881272679424 ext(0->4095) 00010000:00010000:0.0:1746065133.294490:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e1c expref: 59 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.294503:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e1c expref: 59 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.294509:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077b800 00000100:00100000:0.0:1746065133.299325:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.303378:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.303460:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272679808 00000100:00100000:1.0:1746065133.303466:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272679808 00002000:00100000:1.0:1746065133.303500:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3800 x1830881272679808/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.303510:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3800 with x1830881272679808 ext(0->4095) 00002000:00010000:1.0:1746065133.303514:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f3800 00000100:00100000:1.0:1746065133.303529:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13335 00000100:00100000:1.0:1746065133.303535:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272679808:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065133.303635:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272679808:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 101us (265us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.303640:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13335 00002000:00100000:1.0:1746065133.303645:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3800 x1830881272679808/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.303651:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3800 with x1830881272679808 ext(0->4095) 00002000:00010000:1.0:1746065133.303653:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f3800 00000100:00100000:0.0:1746065133.308834:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.319483:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.320955:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881272680064:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1258us (1476us total) trans 4294972051 rc 0/0 00000100:00100000:0.0:1746065133.320962:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2540 00002000:00100000:0.0:1746065133.320968:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fff6a00 x1830881272680064/t4294972051(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.320975:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6a00 with x1830881272680064 ext(0->7) 00010000:00010000:0.0:1746065133.320980:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f87eeb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e23 expref: 60 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.321002:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f87eeb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e23 expref: 60 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.321007:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff6a00 00000100:00100000:0.0:1746065133.336172:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.336224:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.340673:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.346827:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.350977:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.351145:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272680960 00000100:00100000:1.0:1746065133.351151:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272680960 00002000:00100000:1.0:1746065133.351181:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d652300 x1830881272680960/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.351190:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652300 with x1830881272680960 ext(0->4095) 00002000:00010000:1.0:1746065133.351194:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d652300 00000100:00100000:1.0:1746065133.351220:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13336 00000100:00100000:1.0:1746065133.351227:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881272680960:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.351339:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881272680960:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 112us (363us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.351344:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13336 00002000:00100000:1.0:1746065133.351350:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d652300 x1830881272680960/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.351357:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652300 with x1830881272680960 ext(0->4095) 00002000:00010000:1.0:1746065133.351359:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d652300 00000100:00100000:0.0:1746065133.353608:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.358180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.360577:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.360703:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.362835:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.362883:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272681728 00000100:00100000:1.0:1746065133.362889:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272681728 00000100:00100000:1.0:1746065133.362928:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29812 00000100:00100000:1.0:1746065133.362934:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:1795:x1830881272681728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.362943:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.362954:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eed5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4e46 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.362970:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.362974:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eece lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e3f expref: 61 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.362979:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.362981:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eed5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e46 expref: 61 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.363014:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eece lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e3f expref: 61 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.363022:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eed5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e46 expref: 61 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.363029:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065133.363046:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1795:x1830881272681728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 112us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.363051:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29812 00000100:00100000:0.0:1746065133.363955:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.364651:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272681856 00000100:00100000:1.0:1746065133.364655:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272681856 00010000:00010000:1.0:1746065133.364672:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eec7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e38 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.364691:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13783 00000100:00100000:1.0:1746065133.364695:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272681856:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.364706:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.364720:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eec7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e38 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.364729:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eec7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e38 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.364744:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eec7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e38 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.364766:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.364768:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.364773:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eece lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e3f expref: 60 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.364780:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eece lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e3f expref: 60 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.364799:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eece lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e3f expref: 60 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.364809:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eece lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e3f expref: 60 pid: 9560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.364818:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267547520:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.364866:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.367520:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267547520:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.367535:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.367572:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272681856:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2876us (3618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.367580:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13783 00000100:00100000:0.0:1746065133.368687:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.372388:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.372459:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272682240 00000100:00100000:1.0:1746065133.372465:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272682240 00010000:00010000:1.0:1746065133.372501:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eece lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e3f expref: 61 pid: 9560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.372538:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13784 00000100:00100000:1.0:1746065133.372545:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2003:x1830881272682240:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.372555:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.372594:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eece lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e3f expref: 61 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.372605:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eece lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e3f expref: 61 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.372635:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eece lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e3f expref: 61 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.372676:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.372678:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.372692:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eed5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e46 expref: 60 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.372699:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eed5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e46 expref: 60 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.372798:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eed5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e46 expref: 60 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.372809:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267547648:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.372879:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.377148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.377254:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267547648:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.377269:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.377304:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2003:x1830881272682240:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4760us (4919us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.377315:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13784 00000100:00100000:0.0:1746065133.382949:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.385431:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.385558:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272682752 00000100:00100000:1.0:1746065133.385563:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272682752 00010000:00010000:1.0:1746065133.385584:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eed5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e46 expref: 60 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.385664:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13785 00000100:00100000:1.0:1746065133.385670:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881272682752:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.385682:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.385697:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eed5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e46 expref: 60 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.385707:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eed5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e46 expref: 60 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.385723:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87eed5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e46 expref: 60 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.385745:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.385747:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.385753:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eedc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e4d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.385760:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eedc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e4d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.385779:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eedc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e4d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.385786:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267547904:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.385828:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.386811:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267547904:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.386821:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.386847:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2004:x1830881272682752:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1176us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.386856:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13785 00000100:00100000:0.0:1746065133.387156:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.388507:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.389077:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.389279:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272683264 00000100:00100000:1.0:1746065133.389282:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272683264 00000100:00100000:1.0:1746065133.389298:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29815 00000100:00100000:1.0:1746065133.389303:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1795:x1830881272683264:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.389308:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.389314:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87eeea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4e5b expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.389323:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.389326:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87eee3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e54 expref: 62 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.389331:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.389333:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87eeea lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e5b expref: 62 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.389350:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87eee3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e54 expref: 62 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.389359:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87eeea lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e5b expref: 62 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.389367:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065133.389385:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:1795:x1830881272683264:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 82us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.389390:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29815 00000100:00100000:0.0:1746065133.391612:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.391661:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272683392 00000100:00100000:1.0:1746065133.391666:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272683392 00010000:00010000:1.0:1746065133.391683:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eedc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e4d expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.391704:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13786 00000100:00100000:1.0:1746065133.391709:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272683392:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.391718:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.391733:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eedc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e4d expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.391742:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eedc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e4d expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.391757:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87eedc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e4d expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.391775:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.391777:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.391781:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87eee3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e54 expref: 60 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.391785:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87eee3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e54 expref: 60 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.391801:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87eee3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e54 expref: 60 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.391810:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87eee3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e54 expref: 60 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.391817:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267548288:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.391863:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.393248:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.393325:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267548288:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.393336:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.393359:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272683392:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1649us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.393371:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13786 00000100:00100000:0.0:1746065133.395462:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.395533:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272683776 00000100:00100000:1.0:1746065133.395538:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272683776 00010000:00010000:1.0:1746065133.395559:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87eee3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e54 expref: 61 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.395631:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13787 00000100:00100000:1.0:1746065133.395638:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2004:x1830881272683776:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.395647:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.395660:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87eee3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e54 expref: 61 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.395669:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87eee3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e54 expref: 61 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.395687:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87eee3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e54 expref: 61 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.395711:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.395712:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.395718:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87eeea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e5b expref: 60 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.395726:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87eeea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e5b expref: 60 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.395753:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87eeea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e5b expref: 60 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.395764:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267548416:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.395854:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.399125:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.399232:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267548416:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.399247:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.399281:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881272683776:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3643us (3821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.399289:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13787 00000100:00100000:0.0:1746065133.401078:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.408311:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.408456:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272684288 00000100:00100000:1.0:1746065133.408465:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272684288 00010000:00010000:1.0:1746065133.408504:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87eeea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e5b expref: 60 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.408580:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13788 00000100:00100000:1.0:1746065133.408588:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881272684288:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.408602:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.408620:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87eeea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e5b expref: 60 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.408632:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87eeea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e5b expref: 60 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.408652:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87eeea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e5b expref: 60 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.408783:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.408786:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.408793:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87eef1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e62 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.408801:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87eef1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e62 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.408831:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87eef1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e62 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.408843:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267548672:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.409002:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.409622:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.410749:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.411122:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267548672:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.411136:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.411176:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881272684288:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2589us (2873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.411188:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13788 00000100:00100000:0.0:1746065133.415652:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.415796:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272684800 00000100:00100000:1.0:1746065133.415803:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272684800 00010000:00010000:1.0:1746065133.415832:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87eef1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e62 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.415890:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13789 00000100:00100000:1.0:1746065133.415897:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272684800:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.415907:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.415922:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87eef1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e62 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.415932:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87eef1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e62 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.415950:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87eef1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e62 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.416034:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.416036:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.416043:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 59 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.416050:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 59 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.416076:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 59 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.416117:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267548928:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.416243:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.417419:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267548928:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.417429:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.417459:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272684800:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1563us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.417466:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13789 00000100:00100000:0.0:1746065133.418372:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.418418:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272685056 00000100:00100000:1.0:1746065133.418422:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272685056 00002000:00100000:1.0:1746065133.418442:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b88a80 x1830881272685056/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.418447:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88a80 with x1830881272685056 ext(0->4095) 00002000:00010000:1.0:1746065133.418450:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b88a80 00000100:00100000:1.0:1746065133.418505:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13341 00000100:00100000:1.0:1746065133.418509:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881272685056:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.418743:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881272685056:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 232us (370us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.418749:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13341 00002000:00100000:1.0:1746065133.418753:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b88a80 x1830881272685056/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.418759:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88a80 with x1830881272685056 ext(0->4095) 00002000:00010000:1.0:1746065133.418762:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b88a80 00000100:00100000:0.0:1746065133.420453:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.425853:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.425967:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272685312 00000100:00100000:1.0:1746065133.425973:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272685312 00002000:00100000:1.0:1746065133.426011:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880124b8b800 x1830881272685312/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.426020:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8b800 with x1830881272685312 ext(0->7) 00010000:00010000:1.0:1746065133.426026:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 60 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.426038:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 60 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.426044:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8b800 00000100:00100000:1.0:1746065133.426435:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2545 00000100:00100000:1.0:1746065133.426442:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881272685312:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065133.427295:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881272685312:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 852us (1445us total) trans 4294972052 rc 0/0 00000100:00100000:0.0:1746065133.427304:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2545 00002000:00100000:0.0:1746065133.427309:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880124b8b800 x1830881272685312/t4294972052(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.427316:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8b800 with x1830881272685312 ext(0->7) 00010000:00010000:0.0:1746065133.427322:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 62 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.427332:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 62 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.427338:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8b800 00000100:00100000:0.0:1746065133.429403:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.429738:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272685440 00000100:00100000:1.0:1746065133.429744:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272685440 00010000:00010000:1.0:1746065133.429768:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 62 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.429822:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13790 00000100:00100000:1.0:1746065133.429829:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2002:x1830881272685440:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.429840:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.429853:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 62 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.429862:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 62 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.429880:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87eef8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e69 expref: 62 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.430210:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.430212:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.430219:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e70 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.430227:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e70 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.430251:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e70 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.430261:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267549184:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.430714:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.432327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.432386:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267549184:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.432399:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.432425:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2002:x1830881272685440:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2596us (3028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.432432:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13790 00000100:00100000:0.0:1746065133.436916:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.441304:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.442124:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.442533:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272686080 00000100:00100000:1.0:1746065133.442536:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272686080 00010000:00010000:1.0:1746065133.442553:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e70 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.442574:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13791 00000100:00100000:1.0:1746065133.442578:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272686080:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.442584:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.442598:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e70 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.442607:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e70 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.442621:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184400/0x392ae0376f87eeff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e70 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.442632:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.442634:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.442639:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ef06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e77 expref: 62 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.442645:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ef06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e77 expref: 62 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.442660:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ef06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e77 expref: 62 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.442668:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ef06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e77 expref: 62 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.442683:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267549568:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.442715:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.445588:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267549568:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.445604:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.445634:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272686080:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3055us (3511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.445642:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13791 00000100:00100000:0.0:1746065133.450802:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.450870:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.451371:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272686592 00000100:00100000:1.0:1746065133.451374:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272686592 00010000:00010000:1.0:1746065133.451390:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ef06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e77 expref: 63 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.451405:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13792 00000100:00100000:1.0:1746065133.451409:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:2005:x1830881272686592:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.451415:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.451427:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ef06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e77 expref: 63 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.451435:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ef06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e77 expref: 63 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.451449:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87ef06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e77 expref: 63 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.451459:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.451461:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.451465:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ef0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e7e expref: 62 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.451471:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ef0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e7e expref: 62 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.451485:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ef0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e7e expref: 62 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.451493:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ef0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e7e expref: 62 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.451502:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267549824:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.451541:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.453321:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267549824:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.453335:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.453359:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2005:x1830881272686592:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1949us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.453367:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13792 00000100:00100000:0.0:1746065133.453661:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.457741:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272686976 00000100:00100000:0.0:1746065133.457750:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272686976 00000100:00100000:0.0:1746065133.457802:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29822 00000100:00100000:0.0:1746065133.457810:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:1791:x1830881272686976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065133.457827:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.457842:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f87ef1b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4e8c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.457868:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065133.457873:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e85 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.457878:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272687104 00010000:00010000:0.0:1746065133.457879:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:1.0:1746065133.457882:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272687104 00010000:00010000:0.0:1746065133.457882:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f87ef1b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e8c expref: 63 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.457897:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ef0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e7e expref: 64 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.457912:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef14 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e85 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.457914:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13793 00000100:00100000:1.0:1746065133.457918:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881272687104:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065133.457923:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f87ef1b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e8c expref: 64 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.457928:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065133.457931:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6c000, rc 0) 00010000:00010000:1.0:1746065133.457942:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ef0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e7e expref: 64 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.457951:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ef0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e7e expref: 64 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.457966:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ef0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e7e expref: 64 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065133.457968:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:1791:x1830881272686976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 159us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.457973:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29822 00010000:00010000:1.0:1746065133.457978:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.457980:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.457996:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e85 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.458003:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e85 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.458035:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e85 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.458045:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e85 expref: 5 pid: 9560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.458054:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267550080:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.458132:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.460729:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.465058:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.465396:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.468769:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.471954:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.474575:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.476854:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.480482:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.480925:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272688512 00000100:00100000:1.0:1746065133.480934:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272688512 00002000:00100000:1.0:1746065133.480974:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728a80 x1830881272688512/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.480993:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728a80 with x1830881272688512 ext(0->4095) 00002000:00010000:1.0:1746065133.480997:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f728a80 00000100:00100000:1.0:1746065133.481024:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13344 00000100:00100000:1.0:1746065133.481031:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881272688512:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.481184:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881272688512:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 153us (703us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.481190:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13344 00002000:00100000:1.0:1746065133.481195:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728a80 x1830881272688512/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.481203:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728a80 with x1830881272688512 ext(0->4095) 00002000:00010000:1.0:1746065133.481205:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f728a80 00000100:00100000:0.0:1746065133.486145:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.488494:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.488581:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272688768 00000100:00100000:1.0:1746065133.488586:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272688768 00002000:00100000:1.0:1746065133.488609:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800729b0700 x1830881272688768/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.488618:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0700 with x1830881272688768 ext(0->7) 00010000:00010000:1.0:1746065133.488623:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ef29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e9a expref: 62 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.488634:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ef29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e9a expref: 62 pid: 9560 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.488644:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b0700 00000100:00100000:1.0:1746065133.488665:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2549 00000100:00100000:1.0:1746065133.488671:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881272688768:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065133.489762:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881272688768:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1088us (1267us total) trans 4294972053 rc 0/0 00000100:00100000:0.0:1746065133.489769:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2549 00002000:00100000:0.0:1746065133.489775:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800729b0700 x1830881272688768/t4294972053(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.489781:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0700 with x1830881272688768 ext(0->7) 00010000:00010000:0.0:1746065133.489786:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ef29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e9a expref: 64 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.489796:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87ef29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4e9a expref: 64 pid: 9560 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.489801:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b0700 00000100:00100000:0.0:1746065133.490774:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.497766:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.507958:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.508016:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.508601:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272689408 00000100:00100000:1.0:1746065133.508605:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272689408 00000100:00100000:1.0:1746065133.508654:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29827 00000100:00100000:1.0:1746065133.508659:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:1791:x1830881272689408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.508666:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.508673:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ef3e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4eaf expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.508751:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.508755:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ef37 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ea8 expref: 66 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.508760:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.508762:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ef3e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4eaf expref: 66 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.508785:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ef37 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ea8 expref: 66 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.508801:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ef3e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4eaf expref: 66 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.508810:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065133.508877:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:1791:x1830881272689408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 217us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.508882:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29827 00000100:00100000:0.0:1746065133.511248:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.514624:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.516461:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.516498:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.519677:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.523200:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.523301:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.525845:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.528601:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.534235:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.538116:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.543421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.543471:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.546372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.549283:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.552593:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.552997:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272692224 00000100:00100000:1.0:1746065133.553002:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272692224 00002000:00100000:1.0:1746065133.553026:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939c00 x1830881272692224/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.553034:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881272692224 ext(0->4095) 00002000:00010000:1.0:1746065133.553038:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f939c00 00000100:00100000:1.0:1746065133.553049:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13347 00000100:00100000:1.0:1746065133.553053:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881272692224:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065133.553145:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881272692224:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 91us (556us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.553149:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13347 00002000:00100000:1.0:1746065133.553153:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939c00 x1830881272692224/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.553160:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881272692224 ext(0->4095) 00002000:00010000:1.0:1746065133.553162:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f939c00 00000100:00100000:0.0:1746065133.555903:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.559930:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.561152:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2004:x1830881272692480:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1017us (1229us total) trans 4294972054 rc 0/0 00000100:00100000:0.0:1746065133.561159:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2554 00002000:00100000:0.0:1746065133.561164:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8801306f2300 x1830881272692480/t4294972054(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.561171:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2300 with x1830881272692480 ext(0->7) 00010000:00010000:0.0:1746065133.561175:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ef5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ecb expref: 66 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065133.561185:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ef5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ecb expref: 66 pid: 9560 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065133.561190:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f2300 00000100:00100000:0.0:1746065133.563061:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.564823:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13804 00000100:00100000:1.0:1746065133.564832:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2004:x1830881272692608:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.564845:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.564862:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ef5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ecb expref: 66 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.564877:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ef5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ecb expref: 66 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.564900:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87ef5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ecb expref: 66 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.564919:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.564921:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.564926:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.564931:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.564957:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.564966:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267552768:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.565039:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.568118:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.568272:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267552768:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.568287:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.568317:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2004:x1830881272692608:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3487us (5259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.568325:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13804 00000100:00100000:0.0:1746065133.569072:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.569383:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272692992 00000100:00100000:1.0:1746065133.569386:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272692992 00002000:00100000:1.0:1746065133.569408:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf8e00 x1830881272692992/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.569415:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8e00 with x1830881272692992 ext(0->4095) 00010000:00010000:1.0:1746065133.569420:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.569430:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.569436:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fbf8e00 00000100:00100000:1.0:1746065133.569449:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2555 00000100:00100000:1.0:1746065133.569454:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272692992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.569554:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272692992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (481us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.569559:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2555 00002000:00100000:1.0:1746065133.569564:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf8e00 x1830881272692992/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.569571:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8e00 with x1830881272692992 ext(0->4095) 00010000:00010000:1.0:1746065133.569575:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.569583:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.569589:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fbf8e00 00000100:00100000:0.0:1746065133.572543:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.573841:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.573905:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272693248 00000100:00100000:1.0:1746065133.573909:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272693248 00010000:00010000:1.0:1746065133.573928:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.574237:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13805 00000100:00100000:1.0:1746065133.574243:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272693248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.574251:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.574265:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.574275:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.574289:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184800/0x392ae0376f87ef61 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed2 expref: 6 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.574310:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.574312:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.574317:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 66 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.574323:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 66 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.574340:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 66 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.574352:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 66 pid: 9560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.574361:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267553152:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.574420:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.576777:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267553152:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.576792:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.576827:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272693248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2582us (2985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.576835:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13805 00000100:00100000:0.0:1746065133.577416:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.577662:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272693504 00000100:00100000:1.0:1746065133.577667:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272693504 00002000:00100000:1.0:1746065133.577695:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc13100 x1830881272693504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.577704:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc13100 with x1830881272693504 ext(0->4095) 00010000:00010000:1.0:1746065133.577710:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 67 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.577722:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 67 pid: 9560 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.577728:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc13100 00000100:00100000:1.0:1746065133.577753:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2556 00000100:00100000:1.0:1746065133.577759:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:2005:x1830881272693504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065133.577857:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:2005:x1830881272693504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (443us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.577862:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2556 00002000:00100000:1.0:1746065133.577867:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc13100 x1830881272693504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.577873:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc13100 with x1830881272693504 ext(0->4095) 00010000:00010000:1.0:1746065133.577877:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 67 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.577885:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 67 pid: 9560 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.577890:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc13100 00000100:00100000:0.0:1746065133.579716:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.579802:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272693632 00000100:00100000:1.0:1746065133.579807:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272693632 00010000:00010000:1.0:1746065133.579830:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 67 pid: 9560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.579901:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13806 00000100:00100000:1.0:1746065133.579908:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:2004:x1830881272693632:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.579918:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.579933:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 67 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.579942:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 67 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.579960:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f87ef68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ed9 expref: 67 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.579972:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.579974:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.579988:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ef6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee0 expref: 66 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.579996:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ef6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee0 expref: 66 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.580020:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ef6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee0 expref: 66 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.580029:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267553280:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.580249:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.584454:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.584551:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267553280:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.584564:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.584595:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:2004:x1830881272693632:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4688us (4883us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.584603:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13806 00000100:00100000:0.0:1746065133.587060:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.587167:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272694016 00000100:00100000:1.0:1746065133.587173:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272694016 00000100:00100000:1.0:1746065133.587217:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29835 00000100:00100000:1.0:1746065133.587223:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272694016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.587237:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.587251:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ef76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4ee7 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.587274:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ef6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee0 expref: 65 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.587280:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.587282:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.587286:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ef76 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee7 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.587309:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ef6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee0 expref: 65 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.587319:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ef6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee0 expref: 65 pid: 9560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.587330:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267553408:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065133.587398:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.589463:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267553408:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.589485:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ef76 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee7 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.589498:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065133.589539:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272694016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2315us (2483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.589550:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29835 00000100:00100000:0.0:1746065133.591729:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.605306:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.605435:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272694272 00000100:00100000:1.0:1746065133.605442:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272694272 00010000:00010000:1.0:1746065133.605471:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ef6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee0 expref: 68 pid: 9560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.605553:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13807 00000100:00100000:1.0:1746065133.605561:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2003:x1830881272694272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.605576:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.605591:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ef6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee0 expref: 68 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.605602:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ef6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee0 expref: 68 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.605620:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ef6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee0 expref: 68 pid: 9560 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.605650:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.605652:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.605659:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ef76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee7 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.605666:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ef76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee7 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.605692:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ef76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee7 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.605702:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267553536:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.608255:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.617280:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272694400 00000100:00100000:1.0:1746065133.617286:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272694400 00000100:00100000:1.0:1746065133.617323:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29836 00000100:00100000:1.0:1746065133.617329:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:1791:x1830881272694400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.617340:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.617354:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ef7d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4eee expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.617374:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ef76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee7 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.617380:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.617382:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.617385:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ef7d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4eee expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.617408:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ef76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee7 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.617418:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87ef76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ee7 expref: 5 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.617428:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267553664:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065133.617780:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.618407:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.619160:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267553664:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.619173:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87ef7d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4eee expref: 69 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.619182:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065133.619315:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:1791:x1830881272694400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1985us (3750us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.619321:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29836 00000100:00100000:0.0:1746065133.621545:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.625202:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.626959:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.631499:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.635187:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.635390:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272695680 00000100:00100000:1.0:1746065133.635396:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272695680 00000100:00100000:1.0:1746065133.635437:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29838 00000100:00100000:1.0:1746065133.635443:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272695680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.635454:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.635469:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ef8b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4efc expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.635491:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ef84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ef5 expref: 67 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.635497:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.635499:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.635501:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ef8b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4efc expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.635525:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ef84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ef5 expref: 67 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.635539:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ef84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ef5 expref: 67 pid: 9560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.635549:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267554176:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065133.635616:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.637046:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267554176:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.637062:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ef8b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4efc expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.637072:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065133.637117:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272695680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1674us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.637123:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29838 00000100:00100000:0.0:1746065133.637765:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.640886:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.640962:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.642019:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272696064 00000100:00100000:1.0:1746065133.642024:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272696064 00002000:00100000:1.0:1746065133.642048:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d510e00 x1830881272696064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.642057:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d510e00 with x1830881272696064 ext(0->4095) 00010000:00010000:1.0:1746065133.642062:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ef8b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4efc expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.642072:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ef8b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4efc expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.642105:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d510e00 00000100:00100000:1.0:1746065133.642128:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2559 00000100:00100000:1.0:1746065133.642133:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272696064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.642232:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272696064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 92us (1340us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.642238:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2559 00002000:00100000:1.0:1746065133.642243:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d510e00 x1830881272696064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.642249:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d510e00 with x1830881272696064 ext(0->4095) 00010000:00010000:1.0:1746065133.642253:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ef8b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4efc expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.642268:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ef8b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4efc expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.642273:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d510e00 00000100:00100000:0.0:1746065133.643617:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.647609:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.651389:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.651514:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272696704 00000100:00100000:1.0:1746065133.651520:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272696704 00002000:00100000:1.0:1746065133.651554:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e9c00 x1830881272696704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.651561:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9c00 with x1830881272696704 ext(0->4095) 00010000:00010000:1.0:1746065133.651568:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ef92 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f03 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.651584:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ef92 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f03 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.651589:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e9c00 00000100:00100000:1.0:1746065133.651978:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2560 00000100:00100000:1.0:1746065133.652012:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:2004:x1830881272696704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.652134:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:2004:x1830881272696704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 123us (752us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.652140:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2560 00002000:00100000:1.0:1746065133.652145:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e9c00 x1830881272696704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.652151:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9c00 with x1830881272696704 ext(0->4095) 00010000:00010000:1.0:1746065133.652156:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ef92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f03 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.652164:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87ef92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f03 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.652168:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e9c00 00000100:00100000:0.0:1746065133.655580:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.659662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.662925:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.665129:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.666886:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.667010:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272697600 00000100:00100000:1.0:1746065133.667014:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272697600 00002000:00100000:1.0:1746065133.667041:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfaa00 x1830881272697600/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.667049:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfaa00 with x1830881272697600 ext(0->4095) 00002000:00010000:1.0:1746065133.667053:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfaa00 00000100:00100000:1.0:1746065133.667066:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13352 00000100:00100000:1.0:1746065133.667071:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272697600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.667192:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272697600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 120us (306us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.667198:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13352 00002000:00100000:1.0:1746065133.667203:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfaa00 x1830881272697600/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.667210:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfaa00 with x1830881272697600 ext(0->4095) 00002000:00010000:1.0:1746065133.667212:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfaa00 00000100:00100000:0.0:1746065133.669340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.669383:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.669428:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272697728 00000100:00100000:1.0:1746065133.669437:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272697728 00000100:00100000:1.0:1746065133.669708:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272697856 00000100:00100000:1.0:1746065133.669712:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272697856 00000100:00100000:1.0:1746065133.669790:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29843 00000100:00100000:1.0:1746065133.669796:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:1795:x1830881272697856:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.669802:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.669816:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efa7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4f1f expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.669837:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87efa0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f11 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.669844:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.669845:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.669848:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efa7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f1f expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.669970:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87efa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f11 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.670301:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87efa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f11 expref: 5 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.670313:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267555328:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065133.670453:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.672785:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267555328:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.672807:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efa7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f1f expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.672820:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065133.672850:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:1795:x1830881272697856:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3054us (3466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.672857:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29843 00000100:00100000:0.0:1746065133.673394:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.677911:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.681563:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.682144:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.682894:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272698368 00000100:00100000:1.0:1746065133.682898:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272698368 00000100:00100000:1.0:1746065133.682933:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29844 00000100:00100000:1.0:1746065133.682938:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272698368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.682948:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.682958:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4f26 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.682973:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87efae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f18 expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.682979:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.682988:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.682991:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efb5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f26 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.683007:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87efae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f18 expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.683016:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87efae lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f18 expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.683023:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267555712:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065133.683056:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.686234:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.687123:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267555712:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065133.687144:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efb5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f26 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.687159:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065133.687193:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272698368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4254us (5637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.687200:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29844 00000100:00100000:1.0:1746065133.687834:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272698752 00000100:00100000:1.0:1746065133.687840:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272698752 00002000:00100000:1.0:1746065133.687866:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b3800 x1830881272698752/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.687881:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b3800 with x1830881272698752 ext(0->4095) 00010000:00010000:1.0:1746065133.687887:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87efae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f18 expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.687899:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87efae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f18 expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.687904:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b3800 00000100:00100000:1.0:1746065133.687931:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2562 00000100:00100000:1.0:1746065133.687937:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2004:x1830881272698752:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.688033:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2004:x1830881272698752:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (1799us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.688038:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2562 00002000:00100000:1.0:1746065133.688043:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b3800 x1830881272698752/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.688050:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b3800 with x1830881272698752 ext(0->4095) 00010000:00010000:1.0:1746065133.688053:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87efae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f18 expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.688061:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87efae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f18 expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.688066:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b3800 00000100:00100000:0.0:1746065133.690387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.690459:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.690516:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272699008 00000100:00100000:1.0:1746065133.690523:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272699008 00000100:00100000:1.0:1746065133.690595:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29845 00000100:00100000:1.0:1746065133.690601:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:1791:x1830881272699008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.690613:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.690627:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87efbc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4f2d expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.690645:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.690649:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f26 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.690654:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065133.690656:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87efbc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f2d expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.690682:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efb5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f26 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.690691:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87efbc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f2d expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.690698:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065133.690726:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:1791:x1830881272699008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 125us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.690731:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29845 00000100:00100000:0.0:1746065133.693790:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.697791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.700702:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.700743:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272699648 00000100:00100000:1.0:1746065133.700750:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272699648 00002000:00100000:1.0:1746065133.700783:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c93b80 x1830881272699648/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.700798:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c93b80 with x1830881272699648 ext(0->4095) 00002000:00010000:1.0:1746065133.700802:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c93b80 00000100:00100000:1.0:1746065133.700828:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13353 00000100:00100000:1.0:1746065133.700835:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2004:x1830881272699648:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.700930:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2004:x1830881272699648:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (234us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.700935:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13353 00002000:00100000:1.0:1746065133.700939:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c93b80 x1830881272699648/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.700946:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c93b80 with x1830881272699648 ext(0->4095) 00002000:00010000:1.0:1746065133.700948:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c93b80 00000100:00100000:0.0:1746065133.703565:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.706469:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.709284:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.711316:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.712621:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.712863:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272700416 00000100:00100000:1.0:1746065133.712867:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272700416 00000100:00100000:1.0:1746065133.712946:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29848 00000100:00100000:1.0:1746065133.712953:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:1795:x1830881272700416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.712961:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.712969:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efd1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4f42 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.712996:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.713000:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87efca lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f3b expref: 70 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.713005:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.713008:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efd1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f42 expref: 70 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.713028:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87efca lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f3b expref: 70 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.713037:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efd1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f42 expref: 70 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.713045:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065133.713104:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:1795:x1830881272700416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 126us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.713109:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29848 00000100:00100000:0.0:1746065133.716174:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.717995:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.720563:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267556864:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065133.720579:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065133.720619:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2005:x1830881272700928:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2212us (2626us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.720627:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13820 00000100:00100000:0.0:1746065133.721014:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.724467:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.728257:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.728358:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272701440 00000100:00100000:1.0:1746065133.728363:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272701440 00010000:00010000:1.0:1746065133.728382:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f42 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.728412:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13821 00000100:00100000:1.0:1746065133.728418:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2005:x1830881272701440:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.728431:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.728446:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f42 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.728455:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f42 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.728470:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87efd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f42 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.728493:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.728495:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.728500:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efd8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f49 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.728508:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f49 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.728528:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f49 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.728537:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267557120:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.728589:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.729841:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267557120:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.729852:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.730018:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:2005:x1830881272701440:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1599us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.730026:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13821 00000100:00100000:0.0:1746065133.730176:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.730329:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272701696 00000100:00100000:1.0:1746065133.730333:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272701696 00002000:00100000:1.0:1746065133.730356:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ce00 x1830881272701696/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.730368:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ce00 with x1830881272701696 ext(0->4095) 00002000:00010000:1.0:1746065133.730372:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ce00 00000100:00100000:1.0:1746065133.730394:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13356 00000100:00100000:1.0:1746065133.730400:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272701696:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065133.730494:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272701696:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 93us (317us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.730502:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13356 00002000:00100000:1.0:1746065133.730507:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ce00 x1830881272701696/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.730514:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ce00 with x1830881272701696 ext(0->4095) 00002000:00010000:1.0:1746065133.730517:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ce00 00000100:00100000:0.0:1746065133.731464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.731977:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.732103:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272701952 00000100:00100000:1.0:1746065133.732106:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272701952 00000100:00100000:1.0:1746065133.732123:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29851 00000100:00100000:1.0:1746065133.732128:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:1795:x1830881272701952:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065133.732134:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.732140:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efe6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4f57 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.732150:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.732153:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87efdf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f50 expref: 70 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.732158:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.732160:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efe6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f57 expref: 70 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.732175:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87efdf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f50 expref: 70 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.732188:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efe6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f57 expref: 70 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.732361:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065133.732383:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:1795:x1830881272701952:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 254us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.732388:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29851 00000100:00100000:0.0:1746065133.733702:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.733780:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272702080 00000100:00100000:1.0:1746065133.733784:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272702080 00010000:00010000:1.0:1746065133.733799:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f49 expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.733816:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13822 00000100:00100000:1.0:1746065133.733821:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272702080:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.733828:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.733902:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f49 expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.733910:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f49 expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.733924:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f49 expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.734000:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.734002:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.734007:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87efdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f50 expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.734014:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87efdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f50 expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.734032:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87efdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f50 expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.734041:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87efdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f50 expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.734050:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267557504:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.734262:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.735305:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267557504:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.735315:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.735349:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272702080:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1527us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.735356:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13822 00000100:00100000:0.0:1746065133.735607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.738408:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.738499:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272702464 00000100:00100000:1.0:1746065133.738504:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272702464 00010000:00010000:1.0:1746065133.738527:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87efdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f50 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.738683:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13823 00000100:00100000:1.0:1746065133.738689:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:2002:x1830881272702464:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.738701:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.738716:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87efdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f50 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.738725:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87efdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f50 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.738741:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87efdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f50 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.738769:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.738770:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.738775:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f57 expref: 68 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.738781:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f57 expref: 68 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.738805:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f57 expref: 68 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.738814:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267557632:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.739144:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.741201:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267557632:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.741236:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.741400:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2002:x1830881272702464:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2709us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.741411:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13823 00000100:00100000:0.0:1746065133.741787:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.741846:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272702720 00000100:00100000:1.0:1746065133.741852:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272702720 00002000:00100000:1.0:1746065133.741878:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1e300 x1830881272702720/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.741996:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1e300 with x1830881272702720 ext(0->4095) 00002000:00010000:1.0:1746065133.742000:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1e300 00000100:00100000:1.0:1746065133.742024:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13357 00000100:00100000:1.0:1746065133.742031:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2005:x1830881272702720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065133.742252:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2005:x1830881272702720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 222us (466us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.742257:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13357 00002000:00100000:1.0:1746065133.742261:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1e300 x1830881272702720/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.742267:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1e300 with x1830881272702720 ext(0->4095) 00002000:00010000:1.0:1746065133.742270:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1e300 00000100:00100000:0.0:1746065133.743774:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.747125:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.747221:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272702976 00000100:00100000:1.0:1746065133.747226:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272702976 00010000:00010000:1.0:1746065133.747249:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f57 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.747345:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13824 00000100:00100000:1.0:1746065133.747351:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b403c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2004:x1830881272702976:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.747361:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.747376:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f57 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.747386:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f57 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.747402:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87efe6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f57 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.747424:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.747426:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.747431:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f5e expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.747438:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f5e expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.747459:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f5e expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.747469:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267557888:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.747748:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.750831:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267557888:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.750844:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.750872:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b403c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:2004:x1830881272702976:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3521us (3749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.750880:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13824 00000100:00100000:0.0:1746065133.751621:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.752236:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.752298:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272703232 00000100:00100000:1.0:1746065133.752304:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272703232 00002000:00100000:1.0:1746065133.752330:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ea00 x1830881272703232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.752338:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ea00 with x1830881272703232 ext(0->4095) 00002000:00010000:1.0:1746065133.752342:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ea00 00000100:00100000:1.0:1746065133.752618:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2566 00000100:00100000:1.0:1746065133.752624:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272703232:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.752705:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272703232:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 81us (1085us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.752710:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2566 00002000:00100000:1.0:1746065133.752715:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ea00 x1830881272703232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.752722:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ea00 with x1830881272703232 ext(0->4095) 00010000:00010000:1.0:1746065133.752726:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efed lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f5e expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.752736:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efed lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f5e expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.752742:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1ea00 00000100:00100000:0.0:1746065133.757259:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.757494:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.757780:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272703616 00000100:00100000:1.0:1746065133.757784:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272703616 00010000:00010000:1.0:1746065133.757800:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f5e expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.757942:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13825 00000100:00100000:1.0:1746065133.757949:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272703616:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.757956:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.757971:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f5e expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.757989:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f5e expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.758004:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87efed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f5e expref: 6 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.758016:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.758017:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.758022:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87eff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f65 expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.758028:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87eff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f65 expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.758046:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87eff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f65 expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.758054:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87eff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f65 expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.758064:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267558272:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.758124:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.760306:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267558272:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.760321:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.760353:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272703616:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2405us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.760361:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13825 00000100:00100000:0.0:1746065133.760529:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.763895:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.763960:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272704000 00000100:00100000:1.0:1746065133.763965:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272704000 00010000:00010000:1.0:1746065133.763996:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87eff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f65 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.764269:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13826 00000100:00100000:1.0:1746065133.764276:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:2004:x1830881272704000:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.764287:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.764301:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87eff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f65 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.764311:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87eff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f65 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.764328:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87eff4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f65 expref: 69 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.764352:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.764354:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.764359:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87effb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f6c expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.764367:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87effb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f6c expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.764390:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87effb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f6c expref: 68 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.764400:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267558400:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.764887:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.767068:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267558400:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.767232:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.767263:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2004:x1830881272704000:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2987us (3372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.767271:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13826 00000100:00100000:0.0:1746065133.768548:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.768622:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272704256 00000100:00100000:1.0:1746065133.768628:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272704256 00002000:00100000:1.0:1746065133.768657:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1c000 x1830881272704256/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.768665:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1c000 with x1830881272704256 ext(0->4095) 00002000:00010000:1.0:1746065133.768669:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1c000 00000100:00100000:1.0:1746065133.768756:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13359 00000100:00100000:1.0:1746065133.768761:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2005:x1830881272704256:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065133.769176:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2005:x1830881272704256:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 413us (628us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.769182:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13359 00002000:00100000:1.0:1746065133.769187:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1c000 x1830881272704256/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.769199:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1c000 with x1830881272704256 ext(0->4095) 00002000:00010000:1.0:1746065133.769202:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1c000 00000100:00100000:0.0:1746065133.770661:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.773804:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.773884:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272704512 00000100:00100000:1.0:1746065133.773890:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272704512 00010000:00010000:1.0:1746065133.773916:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87effb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f6c expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.773945:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13827 00000100:00100000:1.0:1746065133.773951:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2004:x1830881272704512:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.774142:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.774157:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87effb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f6c expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.774166:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87effb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f6c expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.774182:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87effb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f6c expref: 68 pid: 9642 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.774202:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.774204:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.774209:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f002 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f73 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.774217:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f002 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f73 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.774575:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f002 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f73 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.774585:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267558656:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.775037:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.777395:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267558656:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.777410:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.777440:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:2004:x1830881272704512:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3488us (3636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.777449:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13827 00000100:00100000:0.0:1746065133.777601:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.777960:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272704768 00000100:00100000:1.0:1746065133.777966:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272704768 00002000:00100000:1.0:1746065133.778005:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1df80 x1830881272704768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.778014:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1df80 with x1830881272704768 ext(0->4095) 00002000:00010000:1.0:1746065133.778018:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1df80 00000100:00100000:1.0:1746065133.778044:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13360 00000100:00100000:1.0:1746065133.778051:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272704768:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.778166:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272704768:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 115us (565us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.778172:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13360 00002000:00100000:1.0:1746065133.778177:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1df80 x1830881272704768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.778189:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1df80 with x1830881272704768 ext(0->4095) 00002000:00010000:1.0:1746065133.778192:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1df80 00000100:00100000:0.0:1746065133.780923:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.781909:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.786616:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.787714:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272705152 00000100:00100000:1.0:1746065133.787721:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272705152 00010000:00010000:1.0:1746065133.787750:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f002 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f73 expref: 6 pid: 9635 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.787787:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13828 00000100:00100000:1.0:1746065133.787792:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272705152:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.787803:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.787816:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f002 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f73 expref: 6 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.787826:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f002 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f73 expref: 6 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.787842:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f002 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f73 expref: 6 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.787869:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.787871:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.787877:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f7a expref: 68 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.787893:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f7a expref: 68 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.787924:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f7a expref: 68 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.787934:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f7a expref: 68 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.787944:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267559040:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.788024:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.790795:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.790938:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267559040:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.790953:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.790995:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272705152:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3201us (4381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.791004:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13828 00000100:00100000:0.0:1746065133.794645:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.794739:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272705536 00000100:00100000:1.0:1746065133.794746:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272705536 00010000:00010000:1.0:1746065133.794768:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f7a expref: 69 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.795069:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13829 00000100:00100000:1.0:1746065133.795075:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:2005:x1830881272705536:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.795110:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.795124:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f7a expref: 69 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.795134:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f7a expref: 69 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.795151:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f009 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f7a expref: 69 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.795168:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.795169:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.795174:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87f010 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f81 expref: 68 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.795180:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87f010 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f81 expref: 68 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.795205:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87f010 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f81 expref: 68 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.795215:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267559168:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.795278:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.797617:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267559168:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.797632:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.797660:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2005:x1830881272705536:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2585us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.797667:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13829 00000100:00100000:0.0:1746065133.798012:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.800527:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.804077:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.804353:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272706048 00000100:00100000:1.0:1746065133.804358:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272706048 00010000:00010000:1.0:1746065133.804380:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87f010 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f81 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.804602:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13830 00000100:00100000:1.0:1746065133.804609:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2004:x1830881272706048:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.804621:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.804636:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87f010 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f81 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.804646:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87f010 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f81 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.804664:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d185200/0x392ae0376f87f010 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f81 expref: 68 pid: 9635 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.804686:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.804688:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.804694:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f017 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f88 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.804701:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f017 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f88 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.804725:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f017 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f88 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.804734:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267559424:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.805779:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.806971:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267559424:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.806992:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.807021:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:2004:x1830881272706048:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2412us (2944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.807029:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13830 00000100:00100000:0.0:1746065133.808342:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.810207:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.815114:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.815220:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272706560 00000100:00100000:1.0:1746065133.815228:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272706560 00010000:00010000:1.0:1746065133.815253:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f017 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f88 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.815503:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13831 00000100:00100000:1.0:1746065133.815510:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b403dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272706560:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.815521:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.815537:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f017 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f88 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.815546:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f017 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f88 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.815562:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f017 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f88 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.815579:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.815580:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.815585:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 67 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.815591:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 67 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.815616:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 67 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.815627:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267559680:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.816589:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.818580:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267559680:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065133.818594:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.818628:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b403dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881272706560:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3117us (3555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.818637:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13831 00000100:00100000:0.0:1746065133.819208:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.832330:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.853251:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.856525:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.857497:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272707200 00000100:00100000:1.0:1746065133.857505:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272707200 00002000:00100000:1.0:1746065133.857539:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009385aa00 x1830881272707200/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.857548:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385aa00 with x1830881272707200 ext(0->7) 00010000:00010000:1.0:1746065133.857555:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 69 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.857568:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 69 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.857574:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385aa00 00000100:00100000:1.0:1746065133.857600:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2570 00000100:00100000:1.0:1746065133.857606:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:2005:x1830881272707200:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746065133.859639:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:2005:x1830881272707200:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2026us (3113us total) trans 4294972056 rc 0/0 00000100:00100000:1.0:1746065133.859649:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2570 00002000:00100000:1.0:1746065133.859657:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009385aa00 x1830881272707200/t4294972056(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.859666:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385aa00 with x1830881272707200 ext(0->7) 00010000:00010000:1.0:1746065133.859673:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 71 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.859686:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 71 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.859692:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385aa00 00000100:00100000:0.0:1746065133.862122:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.862187:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272707328 00000100:00100000:1.0:1746065133.862194:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272707328 00010000:00010000:1.0:1746065133.862220:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 71 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.862250:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13832 00000100:00100000:1.0:1746065133.862255:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:2005:x1830881272707328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.862265:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065133.862275:0:7200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1746065132 -> 1746065133 00002000:00010000:1.0:1746065133.862278:0:7200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1746065132 -> 1746065133 00010000:00010000:1.0:1746065133.862282:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 71 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.862296:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 71 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.862313:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f01e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f8f expref: 71 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.862327:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.862328:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.862335:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f025 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f96 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.862341:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f025 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f96 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.862363:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f025 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f96 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.862371:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f025 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f96 expref: 5 pid: 21550 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065133.862379:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267560064:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065133.862438:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.865399:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.865422:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272707584 00000100:00100000:1.0:1746065133.865429:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272707584 00002000:00100000:1.0:1746065133.865457:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3a680 x1830881272707584/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.865473:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3a680 with x1830881272707584 ext(0->4095) 00010000:00010000:1.0:1746065133.865479:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f025 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f96 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.865492:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f025 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f96 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.865498:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc3a680 00000100:00100000:1.0:1746065133.865522:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2571 00000100:00100000:1.0:1746065133.865529:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272707584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065133.865637:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272707584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 108us (244us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.865643:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2571 00002000:00100000:1.0:1746065133.865648:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3a680 x1830881272707584/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065133.865654:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3a680 with x1830881272707584 ext(0->4095) 00010000:00010000:1.0:1746065133.865659:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f025 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f96 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065133.865666:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f025 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f96 expref: 6 pid: 21550 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065133.865671:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc3a680 00000100:00100000:0.0:1746065133.869578:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.874519:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.880876:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.944929:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.950010:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.950775:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2004:x1830881272708352:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 568us (769us total) trans 4294972057 rc 0/0 00000100:00100000:0.0:1746065133.950782:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2572 00002000:00100000:0.0:1746065133.950788:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880093858380 x1830881272708352/t4294972057(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.950795:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858380 with x1830881272708352 ext(0->7) 00010000:00010000:0.0:1746065133.950800:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f02c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f9d expref: 73 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065133.950810:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f02c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4f9d expref: 73 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065133.950816:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093858380 00000100:00100000:0.0:1746065133.952268:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.955460:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.958345:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.966797:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.966848:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272709120 00000100:00100000:0.0:1746065133.966853:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272709120 00002000:00100000:0.0:1746065133.966883:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4380 x1830881272709120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.966891:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4380 with x1830881272709120 ext(0->4095) 00002000:00010000:0.0:1746065133.966895:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff4380 00000100:00100000:0.0:1746065133.966923:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13364 00000100:00100000:0.0:1746065133.966930:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2003:x1830881272709120:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:0.0:1746065133.967803:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2003:x1830881272709120:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 872us (1005us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065133.967810:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13364 00002000:00100000:0.0:1746065133.967815:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4380 x1830881272709120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.967822:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4380 with x1830881272709120 ext(0->4095) 00002000:00010000:0.0:1746065133.967824:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff4380 00000100:00100000:0.0:1746065133.973726:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065133.983252:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.983294:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272709376 00000100:00100000:0.0:1746065133.983300:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272709376 00002000:00100000:0.0:1746065133.983338:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009dc39f80 x1830881272709376/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.983347:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39f80 with x1830881272709376 ext(0->7) 00010000:00010000:0.0:1746065133.983354:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f03a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fab expref: 72 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065133.983368:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f03a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fab expref: 72 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065133.983374:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc39f80 00000100:00100000:0.0:1746065133.983403:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2574 00000100:00100000:0.0:1746065133.983409:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2003:x1830881272709376:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065133.994383:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2003:x1830881272709376:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 10965us (11130us total) trans 4294972058 rc 0/0 00000100:00100000:0.0:1746065133.994398:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2574 00002000:00100000:0.0:1746065133.994409:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009dc39f80 x1830881272709376/t4294972058(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:49/0 lens 496/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065133.994418:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39f80 with x1830881272709376 ext(0->7) 00010000:00010000:0.0:1746065133.994425:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f03a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fab expref: 74 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065133.994438:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f03a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fab expref: 74 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065133.994444:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc39f80 00000100:00100000:0.0:1746065133.998369:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065133.999965:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065134.000266:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065134.004765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:0.0:1746065134.005462:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065134.011357:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.021879:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.027619:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272710400 00000100:00100000:0.0:1746065134.027626:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272710400 00000100:00100000:0.0:1746065134.027659:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29866 00000100:00100000:0.0:1746065134.027665:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272710400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065134.027679:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065134.031348:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065134.031365:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267561600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746065134.031412:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746065134.031656:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065134.038525:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272710528:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2010us (4239us total) trans 4294972059 rc 0/0 00000100:00100000:0.0:1746065134.038534:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2576 00002000:00100000:0.0:1746065134.038542:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4eaa00 x1830881272710528/t4294972059(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 496/448 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.038550:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eaa00 with x1830881272710528 ext(0->7) 00010000:00010000:0.0:1746065134.038556:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87f048 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fb9 expref: 76 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.038573:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d185a00/0x392ae0376f87f048 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fb9 expref: 76 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.038578:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4eaa00 00000100:00100000:0.0:1746065134.046946:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.051768:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267561728:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065134.051784:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.051828:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b403e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2003:x1830881272710656:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4555us (4888us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.051837:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13838 00000100:00100000:0.0:1746065134.052453:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272710912 00000100:00100000:0.0:1746065134.052458:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272710912 00002000:00100000:0.0:1746065134.052486:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e889c00 x1830881272710912/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.052494:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889c00 with x1830881272710912 ext(0->4095) 00002000:00010000:0.0:1746065134.052497:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e889c00 00000100:00100000:0.0:1746065134.052518:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13366 00000100:00100000:0.0:1746065134.052523:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272710912:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065134.052618:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272710912:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (646us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065134.052623:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13366 00002000:00100000:0.0:1746065134.052628:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e889c00 x1830881272710912/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.052634:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889c00 with x1830881272710912 ext(0->4095) 00002000:00010000:0.0:1746065134.052636:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e889c00 00000100:00100000:0.0:1746065134.054900:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.065830:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.065867:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.068550:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.068599:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272711552 00000100:00100000:1.0:1746065134.068604:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272711552 00002000:00100000:1.0:1746065134.068631:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385b100 x1830881272711552/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.068639:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b100 with x1830881272711552 ext(0->4095) 00010000:00010000:1.0:1746065134.068645:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fc7 expref: 77 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.068654:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fc7 expref: 77 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.068660:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385b100 00000100:00100000:1.0:1746065134.068685:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2577 00000100:00100000:1.0:1746065134.068691:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2005:x1830881272711552:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.068786:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2005:x1830881272711552:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 95us (236us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.068791:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2577 00002000:00100000:1.0:1746065134.068796:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385b100 x1830881272711552/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.068802:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b100 with x1830881272711552 ext(0->4095) 00010000:00010000:1.0:1746065134.068807:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fc7 expref: 77 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.068816:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fc7 expref: 77 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.068821:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385b100 00000100:00100000:0.0:1746065134.071331:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.072585:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.076682:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.076797:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272712064 00000100:00100000:1.0:1746065134.076802:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272712064 00002000:00100000:1.0:1746065134.076831:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858000 x1830881272712064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.076839:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858000 with x1830881272712064 ext(0->4095) 00010000:00010000:1.0:1746065134.076845:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f05d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fce expref: 76 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.076856:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f05d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fce expref: 76 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.076862:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093858000 00000100:00100000:1.0:1746065134.076875:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2578 00000100:00100000:1.0:1746065134.076880:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272712064:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.076969:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272712064:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 89us (289us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.076974:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2578 00002000:00100000:1.0:1746065134.076990:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858000 x1830881272712064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.077004:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858000 with x1830881272712064 ext(0->4095) 00010000:00010000:1.0:1746065134.077008:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f05d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fce expref: 76 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.077016:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f05d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fce expref: 76 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.077021:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093858000 00000100:00100000:0.0:1746065134.080676:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.081781:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.084516:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.084625:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272712576 00000100:00100000:1.0:1746065134.084630:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272712576 00002000:00100000:1.0:1746065134.084658:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f480 x1830881272712576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.084666:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f480 with x1830881272712576 ext(0->4095) 00010000:00010000:1.0:1746065134.084672:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f064 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fd5 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.084682:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f064 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fd5 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.084688:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1f480 00000100:00100000:1.0:1746065134.084701:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2579 00000100:00100000:1.0:1746065134.084707:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272712576:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.084926:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272712576:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 218us (409us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.084932:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2579 00002000:00100000:1.0:1746065134.084937:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f480 x1830881272712576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.084944:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f480 with x1830881272712576 ext(0->4095) 00010000:00010000:1.0:1746065134.084948:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f064 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fd5 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.084957:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f064 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fd5 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.084962:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1f480 00000100:00100000:0.0:1746065134.086496:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.089030:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.089076:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272712960 00000100:00100000:1.0:1746065134.089101:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272712960 00002000:00100000:1.0:1746065134.089130:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1d880 x1830881272712960/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.089138:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1d880 with x1830881272712960 ext(0->4095) 00002000:00010000:1.0:1746065134.089142:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1d880 00000100:00100000:1.0:1746065134.089157:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13367 00000100:00100000:1.0:1746065134.089163:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272712960:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.089278:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272712960:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 114us (250us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.089284:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13367 00002000:00100000:1.0:1746065134.089289:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1d880 x1830881272712960/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.089296:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1d880 with x1830881272712960 ext(0->4095) 00002000:00010000:1.0:1746065134.089298:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1d880 00000100:00100000:0.0:1746065134.090866:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.091033:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272713088 00000100:00100000:1.0:1746065134.091038:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272713088 00000100:00100000:1.0:1746065134.091070:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29871 00000100:00100000:1.0:1746065134.091076:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272713088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.091106:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.091118:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f072 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4fe3 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.091136:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f06b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fdc expref: 75 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.091142:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.091144:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.091146:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f072 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fe3 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.091167:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f06b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fdc expref: 75 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.091177:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f06b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fdc expref: 75 pid: 9635 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.091186:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267562880:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065134.091241:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.092648:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267562880:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065134.092666:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f072 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fe3 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.092683:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065134.092706:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272713088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1631us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.092712:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29871 00000100:00100000:0.0:1746065134.093557:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.095552:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267563136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065134.095585:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746065134.096201:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065134.096713:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294970735 gen 2 00000004:00080000:0.0:1746065134.096718:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009dc38000, transno 4294970735 00000100:00100000:0.0:1746065134.096905:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267563136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065134.098505:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.100028:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.100908:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272713600 00000100:00100000:1.0:1746065134.100913:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272713600 00000100:00100000:1.0:1746065134.100950:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29872 00000100:00100000:1.0:1746065134.100956:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:1791:x1830881272713600:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.100964:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.100992:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f079 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4fea expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.101012:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f072 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fe3 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.101018:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.101020:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.101023:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f079 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fea expref: 76 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.101045:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fe3 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.101056:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fe3 expref: 5 pid: 21550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.101071:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267563264:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065134.101780:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.101890:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.103675:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267563264:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065134.103691:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f079 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fea expref: 77 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.103700:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065134.103786:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1791:x1830881272713600:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2829us (3757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.103792:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29872 00000100:00100000:0.0:1746065134.104112:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.108131:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.108209:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272714112 00000100:00100000:1.0:1746065134.108215:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272714112 00002000:00100000:1.0:1746065134.108243:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dfffb80 x1830881272714112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.108252:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfffb80 with x1830881272714112 ext(0->4095) 00010000:00010000:1.0:1746065134.108259:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f079 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fea expref: 77 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.108270:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f079 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fea expref: 77 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.108275:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dfffb80 00000100:00100000:1.0:1746065134.108301:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2580 00000100:00100000:1.0:1746065134.108307:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272714112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.108400:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272714112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 93us (269us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.108406:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2580 00002000:00100000:1.0:1746065134.108410:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dfffb80 x1830881272714112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.108417:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfffb80 with x1830881272714112 ext(0->4095) 00010000:00010000:1.0:1746065134.108421:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f079 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fea expref: 77 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.108429:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f079 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fea expref: 77 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.108434:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dfffb80 00000100:00100000:0.0:1746065134.110417:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.114873:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.117996:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.118255:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272714624 00000100:00100000:1.0:1746065134.118260:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272714624 00000100:00100000:1.0:1746065134.118291:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29874 00000100:00100000:1.0:1746065134.118296:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272714624:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.118306:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.118319:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f087 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4ff8 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.118339:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f080 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ff1 expref: 75 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.118345:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.118346:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.118350:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f087 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ff8 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.118371:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f080 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ff1 expref: 75 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.118380:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f080 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ff1 expref: 75 pid: 9635 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.118389:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267563776:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065134.118894:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.120024:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267563776:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065134.120046:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f087 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ff8 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.120058:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065134.120110:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272714624:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1812us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.120116:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29874 00000100:00100000:0.0:1746065134.121405:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.124466:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.124564:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272715008 00000100:00100000:1.0:1746065134.124569:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272715008 00002000:00100000:1.0:1746065134.124596:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eaa00 x1830881272715008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.124605:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eaa00 with x1830881272715008 ext(0->4095) 00002000:00010000:1.0:1746065134.124609:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5eaa00 00000100:00100000:1.0:1746065134.124825:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13370 00000100:00100000:1.0:1746065134.124832:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272715008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.125304:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272715008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 472us (838us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.125309:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13370 00002000:00100000:1.0:1746065134.125314:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eaa00 x1830881272715008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.125321:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eaa00 with x1830881272715008 ext(0->4095) 00002000:00010000:1.0:1746065134.125323:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5eaa00 00000100:00100000:0.0:1746065134.126283:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.126535:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272715136 00000100:00100000:1.0:1746065134.126541:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272715136 00000100:00100000:1.0:1746065134.126578:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29875 00000100:00100000:1.0:1746065134.126584:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:1791:x1830881272715136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.126595:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.126608:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f08e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e4fff expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.126630:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f087 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ff8 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.126637:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.126638:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.126641:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f08e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fff expref: 76 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.126664:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f087 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ff8 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.126678:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4ff8 expref: 5 pid: 21550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.126688:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267564032:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065134.126895:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.127170:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.128064:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267564032:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065134.128078:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f08e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fff expref: 77 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.128127:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065134.128148:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1791:x1830881272715136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1563us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.128153:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29875 00000100:00100000:0.0:1746065134.128575:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.129897:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.129989:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272715648 00000100:00100000:1.0:1746065134.129993:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272715648 00002000:00100000:1.0:1746065134.130014:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e3480 x1830881272715648/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.130023:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3480 with x1830881272715648 ext(0->4095) 00010000:00010000:1.0:1746065134.130028:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fff expref: 77 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.130037:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fff expref: 77 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.130047:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e3480 00000100:00100000:1.0:1746065134.130126:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2581 00000100:00100000:1.0:1746065134.130132:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2005:x1830881272715648:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.130211:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2005:x1830881272715648:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 78us (314us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.130216:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2581 00002000:00100000:1.0:1746065134.130221:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e3480 x1830881272715648/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.130228:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3480 with x1830881272715648 ext(0->4095) 00010000:00010000:1.0:1746065134.130232:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fff expref: 77 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.130240:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e4fff expref: 77 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.130245:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e3480 00000100:00100000:0.0:1746065134.132528:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.134618:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.134698:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272716032 00000100:00100000:1.0:1746065134.134702:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272716032 00002000:00100000:1.0:1746065134.134726:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc10e00 x1830881272716032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.134735:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10e00 with x1830881272716032 ext(0->4095) 00002000:00010000:1.0:1746065134.134739:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc10e00 00000100:00100000:1.0:1746065134.134762:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13371 00000100:00100000:1.0:1746065134.134769:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272716032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.135143:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272716032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 373us (526us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.135150:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13371 00002000:00100000:1.0:1746065134.135155:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc10e00 x1830881272716032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.135162:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10e00 with x1830881272716032 ext(0->4095) 00002000:00010000:1.0:1746065134.135164:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc10e00 00000100:00100000:1.0:1746065134.138776:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.141986:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.144058:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.144147:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272716544 00000100:00100000:1.0:1746065134.144151:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272716544 00002000:00100000:1.0:1746065134.144176:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98000 x1830881272716544/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.144184:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98000 with x1830881272716544 ext(0->4095) 00002000:00010000:1.0:1746065134.144187:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98000 00000100:00100000:1.0:1746065134.144200:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13372 00000100:00100000:1.0:1746065134.144205:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272716544:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.144291:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272716544:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 84us (232us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.144296:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13372 00002000:00100000:1.0:1746065134.144301:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98000 x1830881272716544/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.144307:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98000 with x1830881272716544 ext(0->4095) 00002000:00010000:1.0:1746065134.144310:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98000 00000100:00100000:0.0:1746065134.145694:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.145801:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.147557:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.149887:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.151768:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.153928:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.154004:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272717568 00000100:00100000:1.0:1746065134.154009:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272717568 00002000:00100000:1.0:1746065134.154036:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f99500 x1830881272717568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.154044:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99500 with x1830881272717568 ext(0->4095) 00002000:00010000:1.0:1746065134.154048:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f99500 00000100:00100000:1.0:1746065134.154079:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13373 00000100:00100000:1.0:1746065134.154110:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272717568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.154266:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272717568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 156us (338us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.154272:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13373 00002000:00100000:1.0:1746065134.154277:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f99500 x1830881272717568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.154283:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99500 with x1830881272717568 ext(0->4095) 00002000:00010000:1.0:1746065134.154286:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f99500 00000100:00100000:0.0:1746065134.155738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.163313:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.167232:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.169795:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.169892:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272718208 00000100:00100000:1.0:1746065134.169899:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272718208 00002000:00100000:1.0:1746065134.169925:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f99f80 x1830881272718208/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.169934:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99f80 with x1830881272718208 ext(0->4095) 00010000:00010000:1.0:1746065134.169940:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f0b1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5022 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.169952:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f0b1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5022 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.169959:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f99f80 00000100:00100000:1.0:1746065134.170490:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2583 00000100:00100000:1.0:1746065134.170497:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272718208:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.170593:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272718208:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 97us (801us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.170599:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2583 00002000:00100000:1.0:1746065134.170604:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f99f80 x1830881272718208/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.170611:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99f80 with x1830881272718208 ext(0->4095) 00010000:00010000:1.0:1746065134.170615:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f0b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5022 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.170624:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f0b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5022 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.170629:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f99f80 00000100:00100000:0.0:1746065134.173022:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.175736:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.176139:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272718592 00000100:00100000:1.0:1746065134.176145:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272718592 00002000:00100000:1.0:1746065134.176171:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f9a680 x1830881272718592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.176180:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9a680 with x1830881272718592 ext(0->4095) 00002000:00010000:1.0:1746065134.176183:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f9a680 00000100:00100000:1.0:1746065134.176203:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13374 00000100:00100000:1.0:1746065134.176209:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2002:x1830881272718592:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065134.176304:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2002:x1830881272718592:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 95us (571us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.176310:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13374 00002000:00100000:1.0:1746065134.176315:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f9a680 x1830881272718592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.176321:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9a680 with x1830881272718592 ext(0->4095) 00002000:00010000:1.0:1746065134.176323:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f9a680 00000100:00100000:0.0:1746065134.183925:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.197797:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.201349:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.204653:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.210793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.222031:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.222259:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272719744 00000100:00100000:1.0:1746065134.222266:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272719744 00002000:00100000:1.0:1746065134.222302:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f9bb80 x1830881272719744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.222310:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9bb80 with x1830881272719744 ext(0->4095) 00002000:00010000:1.0:1746065134.222314:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f9bb80 00000100:00100000:1.0:1746065134.222340:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13375 00000100:00100000:1.0:1746065134.222345:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881272719744:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.222439:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881272719744:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 94us (413us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.222444:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13375 00002000:00100000:1.0:1746065134.222448:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f9bb80 x1830881272719744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.222453:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9bb80 with x1830881272719744 ext(0->4095) 00002000:00010000:1.0:1746065134.222456:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f9bb80 00000100:00100000:0.0:1746065134.227451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.230024:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.230103:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.236322:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.240039:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.242760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.243769:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272720768 00000100:00100000:1.0:1746065134.243776:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272720768 00002000:00100000:1.0:1746065134.243806:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ca80 x1830881272720768/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.243815:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ca80 with x1830881272720768 ext(0->4095) 00002000:00010000:1.0:1746065134.243819:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ca80 00000100:00100000:1.0:1746065134.243842:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13376 00000100:00100000:1.0:1746065134.243848:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2002:x1830881272720768:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065134.243951:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2002:x1830881272720768:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 103us (1191us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.243957:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13376 00002000:00100000:1.0:1746065134.243962:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ca80 x1830881272720768/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.243969:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ca80 with x1830881272720768 ext(0->4095) 00002000:00010000:1.0:1746065134.243971:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ca80 00000100:00100000:0.0:1746065134.247882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.250905:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.252543:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272721024:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 903us (1637us total) trans 4294972061 rc 0/0 00000100:00100000:0.0:1746065134.252549:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2587 00002000:00100000:0.0:1746065134.252554:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a091f100 x1830881272721024/t4294972061(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 496/448 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.252561:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f100 with x1830881272721024 ext(0->7) 00010000:00010000:0.0:1746065134.252566:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f0d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5045 expref: 80 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.252574:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f0d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5045 expref: 80 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.252579:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091f100 00000100:00100000:0.0:1746065134.257646:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.259442:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.260706:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29887 00000100:00100000:0.0:1746065134.260715:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272721280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065134.260729:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065134.260741:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb07000/0x392ae0376f87f0e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5053 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.260767:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87f0db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e504c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.260774:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065134.260775:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065134.260778:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07000/0x392ae0376f87f0e2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5053 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.260800:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87f0db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e504c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.260810:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87f0db lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e504c expref: 5 pid: 9635 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065134.261758:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d650a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267567104:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065134.262380:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.262666:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272721536 00000100:00100000:0.0:1746065134.262671:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272721536 00002000:00100000:0.0:1746065134.262696:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8aa00 x1830881272721536/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.262705:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8aa00 with x1830881272721536 ext(0->4095) 00010000:00010000:0.0:1746065134.262712:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87f0db lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e504c expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.262722:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87f0db lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e504c expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.262728:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8aa00 00000100:00100000:0.0:1746065134.262952:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2588 00000100:00100000:0.0:1746065134.262960:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272721536:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065134.264110:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272721536:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1150us (1485us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065134.264116:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2588 00002000:00100000:0.0:1746065134.264122:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8aa00 x1830881272721536/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.264130:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8aa00 with x1830881272721536 ext(0->4095) 00010000:00010000:0.0:1746065134.264135:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87f0db lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e504c expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.264145:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87f0db lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e504c expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.264151:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8aa00 00000100:00100000:1.0:1746065134.264333:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d650a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267567104:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065134.264349:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07000/0x392ae0376f87f0e2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5053 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.264360:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07000, rc 0) 00000100:00100000:1.0:1746065134.264378:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272721280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3666us (4937us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.264384:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29887 00000100:00100000:0.0:1746065134.266290:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.266672:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272721664 00000100:00100000:1.0:1746065134.266678:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272721664 00000100:00100000:0.0:1746065134.266828:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.267295:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29888 00000100:00100000:1.0:1746065134.267303:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881272721664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.267317:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.267330:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f0e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e505a expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.267349:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.267353:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07000/0x392ae0376f87f0e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5053 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.267357:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.267360:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f0e9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e505a expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.267385:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb07000/0x392ae0376f87f0e2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5053 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.267394:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f0e9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e505a expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.267401:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065134.267938:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272721664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 636us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.267943:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29888 00000100:00100000:0.0:1746065134.271266:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272722048 00000100:00100000:0.0:1746065134.271273:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272722048 00002000:00100000:0.0:1746065134.271308:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8ad80 x1830881272722048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.271318:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8ad80 with x1830881272722048 ext(0->4095) 00010000:00010000:0.0:1746065134.271325:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07000/0x392ae0376f87f0e2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5053 expref: 81 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.271337:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07000/0x392ae0376f87f0e2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5053 expref: 81 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.271343:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8ad80 00000100:00100000:0.0:1746065134.271789:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2589 00000100:00100000:0.0:1746065134.271796:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272722048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065134.271878:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272722048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 82us (678us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065134.271883:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2589 00002000:00100000:0.0:1746065134.271888:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8ad80 x1830881272722048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.271895:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8ad80 with x1830881272722048 ext(0->4095) 00010000:00010000:0.0:1746065134.271899:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07000/0x392ae0376f87f0e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5053 expref: 81 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.271908:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07000/0x392ae0376f87f0e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5053 expref: 81 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.271913:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8ad80 00000100:00100000:0.0:1746065134.274307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.277141:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.277280:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272722432 00000100:00100000:1.0:1746065134.277286:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272722432 00002000:00100000:1.0:1746065134.277315:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1500 x1830881272722432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.277324:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1500 with x1830881272722432 ext(0->4095) 00002000:00010000:1.0:1746065134.277328:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a1500 00000100:00100000:1.0:1746065134.277342:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13377 00000100:00100000:1.0:1746065134.277347:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272722432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.277436:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272722432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 89us (299us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.277441:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13377 00002000:00100000:1.0:1746065134.277446:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1500 x1830881272722432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.277453:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1500 with x1830881272722432 ext(0->4095) 00002000:00010000:1.0:1746065134.277455:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a1500 00000100:00100000:0.0:1746065134.279671:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.279754:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272722560 00000100:00100000:1.0:1746065134.279760:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272722560 00000100:00100000:1.0:1746065134.279866:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29889 00000100:00100000:1.0:1746065134.279872:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272722560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.279884:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.279897:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87f0f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5061 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.279919:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f0e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e505a expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.279925:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.279927:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.279930:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87f0f0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5061 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.279950:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f0e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e505a expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.279961:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f0e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e505a expref: 79 pid: 21550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.279970:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267567616:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065134.280563:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.281845:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267567616:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065134.281864:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87f0f0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5061 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.281875:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065134.281906:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272722560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2034us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.281912:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29889 00000100:00100000:0.0:1746065134.282484:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.285733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.285925:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272722944 00000100:00100000:1.0:1746065134.285929:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272722944 00002000:00100000:1.0:1746065134.285957:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72a300 x1830881272722944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.285965:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a300 with x1830881272722944 ext(0->4095) 00002000:00010000:1.0:1746065134.285969:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72a300 00000100:00100000:1.0:1746065134.286004:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13378 00000100:00100000:1.0:1746065134.286011:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272722944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.286128:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272722944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 117us (399us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.286134:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13378 00002000:00100000:1.0:1746065134.286139:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72a300 x1830881272722944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.286147:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a300 with x1830881272722944 ext(0->4095) 00002000:00010000:1.0:1746065134.286149:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72a300 00000100:00100000:0.0:1746065134.287631:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.287714:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272723072 00000100:00100000:1.0:1746065134.287718:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272723072 00000100:00100000:1.0:1746065134.287894:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29890 00000100:00100000:1.0:1746065134.287900:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1791:x1830881272723072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.287910:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.287922:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130640800/0x392ae0376f87f0f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5068 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.287941:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87f0f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5061 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.287947:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.287948:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.287951:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130640800/0x392ae0376f87f0f7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5068 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.288386:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87f0f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5061 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.288400:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87f0f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5061 expref: 5 pid: 21550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.288412:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267567872:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065134.289263:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.289843:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.291318:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267567872:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065134.291331:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130640800/0x392ae0376f87f0f7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5068 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.291339:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130640800, rc 0) 00000100:00100000:1.0:1746065134.291357:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272723072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3458us (3728us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.291362:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29890 00000100:00100000:0.0:1746065134.293279:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.295950:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.298473:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.300910:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.302206:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.302251:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272724096 00000100:00100000:1.0:1746065134.302255:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272724096 00000100:00100000:1.0:1746065134.302286:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29892 00000100:00100000:1.0:1746065134.302290:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272724096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.302300:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.302313:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f105 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5076 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.302333:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87f0fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e506f expref: 79 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.302344:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.302349:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.302352:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f105 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5076 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.302373:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87f0fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e506f expref: 79 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.302383:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d184600/0x392ae0376f87f0fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e506f expref: 79 pid: 9635 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.302392:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267568384:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065134.302452:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.303375:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267568384:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065134.303390:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f105 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5076 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.303399:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130640400, rc 0) 00000100:00100000:1.0:1746065134.303424:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272724096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1133us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.303430:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29892 00000100:00100000:0.0:1746065134.304259:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.306265:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.306310:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272724480 00000100:00100000:1.0:1746065134.306315:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272724480 00002000:00100000:1.0:1746065134.306342:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788a80 x1830881272724480/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.306356:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788a80 with x1830881272724480 ext(0->4095) 00002000:00010000:1.0:1746065134.306359:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788a80 00000100:00100000:1.0:1746065134.306421:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13380 00000100:00100000:1.0:1746065134.306427:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272724480:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.306509:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272724480:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 82us (244us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.306513:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13380 00002000:00100000:1.0:1746065134.306518:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788a80 x1830881272724480/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.306523:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788a80 with x1830881272724480 ext(0->4095) 00002000:00010000:1.0:1746065134.306526:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788a80 00000100:00100000:0.0:1746065134.311630:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.311697:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.311769:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272724608 00000100:00100000:1.0:1746065134.311777:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272724608 00000100:00100000:1.0:1746065134.311909:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29893 00000100:00100000:1.0:1746065134.311916:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881272724608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.311930:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.311943:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f10c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e507d expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.312105:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.312110:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87f113 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5084 expref: 82 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.312116:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.312119:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f10c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e507d expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.312144:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f87f113 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5084 expref: 82 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.312154:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f10c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e507d expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.312162:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065134.312246:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881272724608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 330us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.312252:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29893 00000100:00100000:0.0:1746065134.313737:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.316505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.318732:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.322488:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.322686:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272725504 00000100:00100000:1.0:1746065134.322691:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272725504 00002000:00100000:1.0:1746065134.322723:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789c00 x1830881272725504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.322732:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789c00 with x1830881272725504 ext(0->4095) 00002000:00010000:1.0:1746065134.322736:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789c00 00000100:00100000:1.0:1746065134.322761:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13381 00000100:00100000:1.0:1746065134.322767:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272725504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.322860:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272725504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 93us (373us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.322864:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13381 00002000:00100000:1.0:1746065134.322867:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789c00 x1830881272725504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.322876:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789c00 with x1830881272725504 ext(0->4095) 00002000:00010000:1.0:1746065134.322877:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789c00 00000100:00100000:0.0:1746065134.324280:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.327003:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.329983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.330107:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272726016 00000100:00100000:1.0:1746065134.330113:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272726016 00002000:00100000:1.0:1746065134.330168:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78a680 x1830881272726016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.330177:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a680 with x1830881272726016 ext(0->4095) 00002000:00010000:1.0:1746065134.330181:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78a680 00000100:00100000:1.0:1746065134.330201:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13382 00000100:00100000:1.0:1746065134.330207:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272726016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.330298:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272726016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 91us (328us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.330303:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13382 00002000:00100000:1.0:1746065134.330308:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78a680 x1830881272726016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.330314:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a680 with x1830881272726016 ext(0->4095) 00002000:00010000:1.0:1746065134.330316:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78a680 00000100:00100000:0.0:1746065134.331621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.331818:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.332023:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29896 00000100:00100000:1.0:1746065134.332030:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272726144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.332042:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.332054:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f121 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5092 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.332468:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.332472:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f128 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5099 expref: 82 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.332477:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.332480:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f121 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5092 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.332497:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f128 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5099 expref: 82 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.332507:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f121 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5092 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.332515:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065134.332533:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272726144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 503us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.332538:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29896 00000100:00100000:0.0:1746065134.334792:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.337222:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.337348:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272726656 00000100:00100000:1.0:1746065134.337353:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272726656 00002000:00100000:1.0:1746065134.337383:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78b480 x1830881272726656/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.337391:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b480 with x1830881272726656 ext(0->4095) 00010000:00010000:1.0:1746065134.337396:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f128 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5099 expref: 81 pid: 9642 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.337414:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f128 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5099 expref: 81 pid: 9642 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.337420:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78b480 00000100:00100000:1.0:1746065134.337444:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2592 00000100:00100000:1.0:1746065134.337449:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272726656:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.337545:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272726656:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (326us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.337551:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2592 00002000:00100000:1.0:1746065134.337555:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78b480 x1830881272726656/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.337561:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b480 with x1830881272726656 ext(0->4095) 00010000:00010000:1.0:1746065134.337565:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f128 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5099 expref: 81 pid: 9642 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.337572:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f128 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5099 expref: 81 pid: 9642 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.337577:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78b480 00000100:00100000:0.0:1746065134.339899:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.340282:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.342526:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.342573:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272727168 00000100:00100000:1.0:1746065134.342577:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272727168 00002000:00100000:1.0:1746065134.342602:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78bb80 x1830881272727168/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.342621:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78bb80 with x1830881272727168 ext(0->4095) 00010000:00010000:1.0:1746065134.342627:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f121 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5092 expref: 80 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.342642:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f121 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5092 expref: 80 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.342647:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78bb80 00000100:00100000:1.0:1746065134.342675:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2593 00000100:00100000:1.0:1746065134.342680:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272727168:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.342896:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272727168:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 210us (365us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.342902:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2593 00002000:00100000:1.0:1746065134.342907:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78bb80 x1830881272727168/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.342919:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78bb80 with x1830881272727168 ext(0->4095) 00010000:00010000:1.0:1746065134.342923:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f121 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5092 expref: 80 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.342932:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87f121 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5092 expref: 80 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.342942:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78bb80 00000100:00100000:0.0:1746065134.344994:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.345337:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.350696:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.351231:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272727680 00000100:00100000:1.0:1746065134.351238:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272727680 00002000:00100000:1.0:1746065134.351268:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3c000 x1830881272727680/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.351277:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3c000 with x1830881272727680 ext(0->4095) 00010000:00010000:1.0:1746065134.351284:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f12f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50a0 expref: 6 pid: 9642 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.351295:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f12f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50a0 expref: 6 pid: 9642 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.351301:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3c000 00000100:00100000:1.0:1746065134.351329:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2594 00000100:00100000:1.0:1746065134.351335:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272727680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.351761:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272727680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 422us (1063us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.351768:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2594 00002000:00100000:1.0:1746065134.351773:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3c000 x1830881272727680/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.351780:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3c000 with x1830881272727680 ext(0->4095) 00010000:00010000:1.0:1746065134.351784:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f12f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50a0 expref: 6 pid: 9642 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.351792:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f12f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50a0 expref: 6 pid: 9642 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.351797:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3c000 00000100:00100000:0.0:1746065134.353673:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.356926:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.356948:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.356969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.357108:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.357129:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.357140:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.357150:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272728704 00000100:00100000:0.0:1746065134.357153:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272728704 00000100:00100000:0.0:1746065134.357204:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272728320 00000100:00100000:0.0:1746065134.357206:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272728320 00000100:00100000:0.0:1746065134.357222:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1173 00000100:00100000:0.0:1746065134.357226:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2003:x1830881272728704:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065134.357247:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2003:x1830881272728704:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 21us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.357253:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1173 00000100:00100000:0.0:1746065134.357262:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1175 00000100:00100000:0.0:1746065134.357266:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881272728320:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065134.357282:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881272728320:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 16us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.357287:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1175 00000100:00100000:0.0:1746065134.357308:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.357362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.357374:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272728832 00000100:00100000:0.0:1746065134.357377:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272728832 00000100:00100000:0.0:1746065134.357399:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1176 00000100:00100000:0.0:1746065134.357403:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272728832:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065134.357426:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272728832:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 23us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.357431:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1176 00000100:00080000:1.0:1746065134.357833:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065134.357837:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746065134.357838:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746065134.357851:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272728064 00000100:00100000:1.0:1746065134.357854:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272728064 00002000:00100000:1.0:1746065134.357877:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3c700 x1830881272728064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.357885:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3c700 with x1830881272728064 ext(0->4095) 00002000:00010000:1.0:1746065134.357889:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3c700 00000100:00100000:1.0:1746065134.357901:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13383 00000100:00100000:1.0:1746065134.357905:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272728064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.358005:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272728064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (1082us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.358011:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13383 00002000:00100000:1.0:1746065134.358015:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3c700 x1830881272728064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.358021:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3c700 with x1830881272728064 ext(0->4095) 00002000:00010000:1.0:1746065134.358024:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3c700 00000100:00100000:0.0:1746065134.359959:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.360222:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272729088 00000100:00100000:1.0:1746065134.360227:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272729088 00000100:00100000:1.0:1746065134.360474:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29900 00000100:00100000:1.0:1746065134.360481:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272729088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.360494:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.360507:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f13d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e50ae expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.360533:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f136 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50a7 expref: 79 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.360540:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.360541:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.360544:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f13d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ae expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.360569:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50a7 expref: 79 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.360580:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50a7 expref: 79 pid: 9642 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.360590:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267570432:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065134.360966:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.363616:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.363701:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267570432:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065134.363721:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f13d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ae expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.363734:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065134.363766:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272729088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3286us (3811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.363777:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29900 00000100:00100000:0.0:1746065134.368321:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b89500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267570560:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065134.368336:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.368369:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881272729216:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4210us (4757us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.368378:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13872 00000100:00100000:1.0:1746065134.368583:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272729344 00000100:00100000:1.0:1746065134.368589:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272729344 00000100:00100000:1.0:1746065134.368616:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29901 00000100:00100000:1.0:1746065134.368622:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1791:x1830881272729344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.368636:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.368648:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f144 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e50b5 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.368668:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f13d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ae expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.368674:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.368676:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.368678:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f144 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50b5 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.368697:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f13d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ae expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.368708:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f13d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ae expref: 5 pid: 21550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.368716:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267570688:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065134.368966:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.370402:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.372173:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267570688:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065134.372191:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f144 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50b5 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.372205:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065134.372223:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272729344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3602us (3989us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.372229:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29901 00000100:00100000:0.0:1746065134.375582:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.378423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.386725:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.394484:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.395612:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2002:x1830881272730240:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 916us (1132us total) trans 4294972062 rc 0/0 00000100:00100000:0.0:1746065134.395619:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2596 00002000:00100000:0.0:1746065134.395625:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009de3ea00 x1830881272730240/t4294972062(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 496/448 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.395632:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3ea00 with x1830881272730240 ext(0->7) 00010000:00010000:0.0:1746065134.395636:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f144 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50b5 expref: 82 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.395650:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f144 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50b5 expref: 82 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.395655:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3ea00 00000100:00100000:0.0:1746065134.410754:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.415666:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.417694:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13874 00000100:00100000:1.0:1746065134.417710:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2003:x1830881272730496:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.417724:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.417747:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f144 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50b5 expref: 83 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.417759:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f144 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50b5 expref: 83 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.417778:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f144 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50b5 expref: 83 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.419262:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.419266:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.419275:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f14b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50bc expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.419283:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f14b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50bc expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.419319:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f14b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50bc expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.419331:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f14b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50bc expref: 5 pid: 21550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.419343:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267571200:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065134.419428:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.422524:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267571200:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065134.422967:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.422992:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.423022:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2003:x1830881272730496:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5317us (7362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.423031:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13874 00000100:00100000:1.0:1746065134.426461:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272730880 00000100:00100000:1.0:1746065134.426468:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272730880 00010000:00010000:1.0:1746065134.426493:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f14b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50bc expref: 6 pid: 21550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.426942:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13875 00000100:00100000:1.0:1746065134.426950:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272730880:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.426960:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.426990:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f14b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50bc expref: 6 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.427001:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f14b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50bc expref: 6 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.427019:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d185600/0x392ae0376f87f14b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50bc expref: 6 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.427287:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.427289:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.427295:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50c3 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.427301:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50c3 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.427326:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50c3 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.427336:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267571328:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065134.427638:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.430802:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267571328:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065134.430818:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.431171:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272730880:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4219us (5389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.431180:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13875 00000100:00100000:0.0:1746065134.431495:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.436366:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.441435:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.443137:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2004:x1830881272731392:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1345us (1698us total) trans 4294972063 rc 0/0 00000100:00100000:0.0:1746065134.443144:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2598 00002000:00100000:0.0:1746065134.443150:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009de3fb80 x1830881272731392/t4294972063(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 496/448 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.443157:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3fb80 with x1830881272731392 ext(0->7) 00010000:00010000:0.0:1746065134.443162:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50c3 expref: 84 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.443171:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50c3 expref: 84 pid: 21550 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.443176:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3fb80 00000100:00100000:1.0:1746065134.450022:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272731520 00000100:00100000:1.0:1746065134.450027:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272731520 00010000:00010000:1.0:1746065134.450044:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50c3 expref: 85 pid: 21550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.450078:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13876 00000100:00100000:1.0:1746065134.450097:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2005:x1830881272731520:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.450105:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.450120:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50c3 expref: 86 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.450130:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50c3 expref: 86 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.450144:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184e00/0x392ae0376f87f152 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50c3 expref: 86 pid: 21550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.451908:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.451952:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:2005:x1830881272731520:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1853us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.451961:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13876 00000100:00100000:0.0:1746065134.456567:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.458122:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272731904 00000100:00100000:1.0:1746065134.458132:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272731904 00002000:00100000:1.0:1746065134.458270:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3d180 x1830881272731904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.458278:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3d180 with x1830881272731904 ext(0->4095) 00010000:00010000:1.0:1746065134.458284:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb6d000/0x392ae0376f87f159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ca expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.458295:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb6d000/0x392ae0376f87f159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ca expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.458301:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3d180 00000100:00100000:1.0:1746065134.458313:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2599 00000100:00100000:1.0:1746065134.458318:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272731904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.459152:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272731904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 832us (2590us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.459157:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2599 00002000:00100000:1.0:1746065134.459162:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3d180 x1830881272731904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.459169:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3d180 with x1830881272731904 ext(0->4095) 00010000:00010000:1.0:1746065134.459173:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb6d000/0x392ae0376f87f159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ca expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.459181:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb6d000/0x392ae0376f87f159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ca expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.459186:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3d180 00000100:00100000:0.0:1746065134.462987:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.463073:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272732032 00000100:00100000:1.0:1746065134.463113:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272732032 00010000:00010000:1.0:1746065134.464120:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb6d000/0x392ae0376f87f159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ca expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.464227:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13877 00000100:00100000:1.0:1746065134.464234:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272732032:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.464246:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.464263:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb6d000/0x392ae0376f87f159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ca expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.464274:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb6d000/0x392ae0376f87f159 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ca expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.464291:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb6d000/0x392ae0376f87f159 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50ca expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.465621:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.465624:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.465635:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d1 expref: 83 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.465644:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d1 expref: 83 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.465687:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d1 expref: 83 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.465698:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267571840:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065134.466627:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.469511:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.469589:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267571840:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065134.469605:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.469636:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272732032:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5403us (6666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.469645:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13877 00000100:00100000:0.0:1746065134.474873:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.481682:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.483489:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272732544:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 878us (1807us total) trans 4294972064 rc 0/0 00000100:00100000:0.0:1746065134.483496:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2600 00002000:00100000:0.0:1746065134.483502:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009de3e300 x1830881272732544/t4294972064(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 496/448 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.483508:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3e300 with x1830881272732544 ext(0->7) 00010000:00010000:0.0:1746065134.483513:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d1 expref: 86 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.483523:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d1 expref: 86 pid: 9560 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.483528:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3e300 00000100:00100000:0.0:1746065134.485275:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.485412:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272732672 00000100:00100000:1.0:1746065134.485419:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272732672 00010000:00010000:1.0:1746065134.485443:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d1 expref: 86 pid: 9560 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.485493:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13878 00000100:00100000:1.0:1746065134.485498:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272732672:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.485508:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.485521:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d1 expref: 86 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.485531:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d1 expref: 86 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.485548:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f160 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d1 expref: 86 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.485568:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.485571:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.485577:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.485584:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.485607:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.485616:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267572096:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065134.485671:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.489508:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272733056 00000100:00100000:0.0:1746065134.489512:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272733056 00002000:00100000:0.0:1746065134.489533:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859180 x1830881272733056/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.489541:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859180 with x1830881272733056 ext(0->4095) 00010000:00010000:0.0:1746065134.489547:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.489555:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.489566:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859180 00000100:00100000:0.0:1746065134.489578:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2601 00000100:00100000:0.0:1746065134.489583:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272733056:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065134.489670:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272733056:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 86us (666us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065134.489675:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2601 00002000:00100000:0.0:1746065134.489680:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859180 x1830881272733056/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.489686:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859180 with x1830881272733056 ext(0->4095) 00010000:00010000:0.0:1746065134.489689:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.489696:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.489701:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859180 00000100:00100000:1.0:1746065134.489990:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267572096:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065134.490001:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.490033:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272732672:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4535us (4762us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.490041:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13878 00000100:00100000:0.0:1746065134.495240:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.495322:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.495792:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272733312 00000100:00100000:1.0:1746065134.495798:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272733312 00010000:00010000:1.0:1746065134.495821:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065134.495849:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13879 00000100:00100000:1.0:1746065134.495855:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272733312:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.495865:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.495880:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.495889:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.495907:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f167 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50d8 expref: 6 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.495919:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.495920:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.495925:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f16e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50df expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.495936:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f16e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50df expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.495958:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f16e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50df expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.495967:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267572352:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065134.496021:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.497780:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267572352:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065134.497791:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.497814:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272733312:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1960us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.497821:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13879 00000100:00100000:0.0:1746065134.499362:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.499405:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272733568 00000100:00100000:1.0:1746065134.499410:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272733568 00002000:00100000:1.0:1746065134.499442:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008251e850 x1830881272733568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.499450:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008251e850 with x1830881272733568 ext(0->4095) 00010000:00010000:1.0:1746065134.499456:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f16e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50df expref: 87 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.499467:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f16e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50df expref: 87 pid: 9560 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.499472:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008251e850 00000100:00100000:1.0:1746065134.499491:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2602 00000100:00100000:1.0:1746065134.499497:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008251e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272733568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.499581:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008251e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272733568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 85us (223us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.499587:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2602 00002000:00100000:1.0:1746065134.499591:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008251e850 x1830881272733568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.499598:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008251e850 with x1830881272733568 ext(0->4095) 00010000:00010000:1.0:1746065134.499602:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f16e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50df expref: 87 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.499610:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f16e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e50df expref: 87 pid: 9560 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.499615:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008251e850 00000100:00100000:0.0:1746065134.501299:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.505200:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.505301:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272733952 00000100:00100000:1.0:1746065134.505307:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272733952 00002000:00100000:1.0:1746065134.505335:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789180 x1830881272733952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.505382:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789180 with x1830881272733952 ext(0->4095) 00002000:00010000:1.0:1746065134.505386:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789180 00000100:00100000:1.0:1746065134.505400:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13387 00000100:00100000:1.0:1746065134.505405:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272733952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.505490:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272733952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 85us (291us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.505496:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13387 00002000:00100000:1.0:1746065134.505501:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789180 x1830881272733952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.505511:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789180 with x1830881272733952 ext(0->4095) 00002000:00010000:1.0:1746065134.505514:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789180 00000100:00100000:0.0:1746065134.507059:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.511385:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.515234:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.515931:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.517455:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.519060:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.524410:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.526414:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.530030:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.532470:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.537379:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.540477:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.541307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.545291:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.545318:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.547632:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.550033:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.556027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.558636:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.559885:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29915 00000100:00100000:0.0:1746065134.559894:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272737152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065134.559908:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065134.559922:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b30e00/0x392ae0376f87f1a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5117 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.559946:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f19f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5110 expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.559957:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065134.559959:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065134.559962:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b30e00/0x392ae0376f87f1a6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5117 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.559998:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f19f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5110 expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.560010:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f19f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5110 expref: 85 pid: 9560 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065134.560020:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007253ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267574272:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065134.560108:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.562964:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.564858:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.568020:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.571768:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.573895:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.577897:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.580194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.584491:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.586888:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.589470:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.593357:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.595460:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.595970:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.598640:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.601588:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.605458:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272739840 00000100:00100000:0.0:1746065134.605465:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272739840 00010000:00010000:0.0:1746065134.605492:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5133 expref: 87 pid: 9560 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065134.605551:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13892 00000100:00100000:0.0:1746065134.605558:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2002:x1830881272739840:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065134.605569:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065134.605585:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5133 expref: 87 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.605596:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f1c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5133 expref: 87 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.605613:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f1c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5133 expref: 87 pid: 9560 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.605812:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065134.605814:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065134.605820:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68400/0x392ae0376f87f1c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e513a expref: 86 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.605827:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68400/0x392ae0376f87f1c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e513a expref: 86 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.605852:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb68400/0x392ae0376f87f1c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e513a expref: 86 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065134.605862:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f72bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267575680:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065134.606616:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.609147:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.613291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.616716:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.619802:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.619871:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.625288:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.625324:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.629816:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.633145:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.636362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.639646:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.643495:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.647020:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.647061:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.651446:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.651489:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.657006:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.657179:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272742784 00000100:00100000:0.0:1746065134.657185:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272742784 00002000:00100000:0.0:1746065134.657213:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09ff100 x1830881272742784/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.657222:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09ff100 with x1830881272742784 ext(0->4095) 00010000:00010000:0.0:1746065134.657229:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f1ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e515d expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.657240:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f1ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e515d expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.657246:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09ff100 00000100:00100000:0.0:1746065134.657270:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2611 00000100:00100000:0.0:1746065134.657275:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272742784:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065134.657372:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272742784:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 97us (370us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065134.657377:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2611 00002000:00100000:0.0:1746065134.657381:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09ff100 x1830881272742784/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.657387:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09ff100 with x1830881272742784 ext(0->4095) 00010000:00010000:0.0:1746065134.657391:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f1ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e515d expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.657398:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f1ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e515d expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.657403:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09ff100 00000100:00100000:0.0:1746065134.659610:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.662890:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.665428:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.668432:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.672900:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.672959:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272743680 00000100:00100000:1.0:1746065134.672966:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272743680 00002000:00100000:1.0:1746065134.673006:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf8380 x1830881272743680/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.673015:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8380 with x1830881272743680 ext(0->4095) 00002000:00010000:1.0:1746065134.673019:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbf8380 00000100:00100000:1.0:1746065134.673043:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13397 00000100:00100000:1.0:1746065134.673049:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272743680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.673160:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272743680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 111us (261us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.673166:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13397 00002000:00100000:1.0:1746065134.673170:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf8380 x1830881272743680/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.673182:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8380 with x1830881272743680 ext(0->4095) 00002000:00010000:1.0:1746065134.673184:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbf8380 00000100:00100000:0.0:1746065134.674915:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.676338:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.678302:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.687566:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.690484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.690662:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272744704 00000100:00100000:1.0:1746065134.690668:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272744704 00002000:00100000:1.0:1746065134.690695:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf9180 x1830881272744704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.690703:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf9180 with x1830881272744704 ext(0->4095) 00002000:00010000:1.0:1746065134.690707:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbf9180 00000100:00100000:1.0:1746065134.690734:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13398 00000100:00100000:1.0:1746065134.690740:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2005:x1830881272744704:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.691491:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2005:x1830881272744704:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 748us (1005us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.691497:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13398 00002000:00100000:1.0:1746065134.691503:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf9180 x1830881272744704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.691510:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf9180 with x1830881272744704 ext(0->4095) 00002000:00010000:1.0:1746065134.691514:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbf9180 00000100:00100000:0.0:1746065134.692944:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.695599:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.698706:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.698801:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272745216 00000100:00100000:1.0:1746065134.698810:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272745216 00002000:00100000:1.0:1746065134.698843:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfa300 x1830881272745216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.698852:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfa300 with x1830881272745216 ext(0->4095) 00002000:00010000:1.0:1746065134.698856:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfa300 00000100:00100000:1.0:1746065134.699078:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13399 00000100:00100000:1.0:1746065134.699105:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272745216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.699507:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272745216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 402us (805us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.699512:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13399 00002000:00100000:1.0:1746065134.699517:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfa300 x1830881272745216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.699523:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfa300 with x1830881272745216 ext(0->4095) 00002000:00010000:1.0:1746065134.699525:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfa300 00000100:00100000:0.0:1746065134.701021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.702175:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272745472 00000100:00100000:1.0:1746065134.702179:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272745472 00000100:00100000:1.0:1746065134.702199:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29932 00000100:00100000:1.0:1746065134.702203:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1795:x1830881272745472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.702210:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.702216:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f21d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e518e expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.702227:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.702231:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f216 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5187 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.702236:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.702238:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f21d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e518e expref: 88 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.702257:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f216 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5187 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.702267:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f21d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e518e expref: 88 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.702276:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130640a00, rc 0) 00000100:00100000:1.0:1746065134.702298:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:1795:x1830881272745472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.702303:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29932 00000100:00100000:0.0:1746065134.705410:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.710634:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.710708:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272745856 00000100:00100000:1.0:1746065134.710715:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272745856 00002000:00100000:1.0:1746065134.710745:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939180 x1830881272745856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.710753:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939180 with x1830881272745856 ext(0->4095) 00010000:00010000:1.0:1746065134.710760:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f216 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5187 expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.710772:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f216 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5187 expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.710778:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939180 00000100:00100000:1.0:1746065134.710800:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2613 00000100:00100000:1.0:1746065134.710805:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272745856:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.710903:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272745856:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (275us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.710908:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2613 00002000:00100000:1.0:1746065134.710913:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939180 x1830881272745856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.710919:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939180 with x1830881272745856 ext(0->4095) 00010000:00010000:1.0:1746065134.710922:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f216 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5187 expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065134.710930:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f216 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5187 expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065134.710935:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939180 00000100:00100000:0.0:1746065134.712812:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.715502:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.720056:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.724261:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.727435:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.727504:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.727590:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272746752 00000100:00100000:1.0:1746065134.727595:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272746752 00002000:00100000:1.0:1746065134.727624:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b100 x1830881272746752/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.727633:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b100 with x1830881272746752 ext(0->4095) 00002000:00010000:1.0:1746065134.727637:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93b100 00000100:00100000:1.0:1746065134.727650:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13401 00000100:00100000:1.0:1746065134.727655:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272746752:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.727759:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272746752:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (323us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.727764:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13401 00002000:00100000:1.0:1746065134.727768:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b100 x1830881272746752/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.727774:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b100 with x1830881272746752 ext(0->4095) 00002000:00010000:1.0:1746065134.727777:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93b100 00000100:00100000:0.0:1746065134.730595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.734000:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.737948:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.739991:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.742883:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.742960:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272747776 00000100:00100000:1.0:1746065134.742967:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272747776 00002000:00100000:1.0:1746065134.743006:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939c00 x1830881272747776/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.743016:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881272747776 ext(0->4095) 00002000:00010000:1.0:1746065134.743020:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f939c00 00000100:00100000:1.0:1746065134.743496:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13402 00000100:00100000:1.0:1746065134.743502:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2002:x1830881272747776:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065134.743959:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2002:x1830881272747776:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 455us (1079us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.743964:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13402 00002000:00100000:1.0:1746065134.743977:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939c00 x1830881272747776/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.743984:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881272747776 ext(0->4095) 00002000:00010000:1.0:1746065134.743987:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f939c00 00000100:00100000:0.0:1746065134.746066:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.748838:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.750714:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.750893:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272748288 00000100:00100000:1.0:1746065134.750898:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272748288 00002000:00100000:1.0:1746065134.750920:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938a80 x1830881272748288/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.750929:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938a80 with x1830881272748288 ext(0->4095) 00002000:00010000:1.0:1746065134.750932:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938a80 00000100:00100000:1.0:1746065134.750943:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13403 00000100:00100000:1.0:1746065134.750948:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272748288:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.751031:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272748288:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 83us (318us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.751037:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13403 00002000:00100000:1.0:1746065134.751041:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938a80 x1830881272748288/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.751047:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938a80 with x1830881272748288 ext(0->4095) 00002000:00010000:1.0:1746065134.751050:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938a80 00000100:00100000:0.0:1746065134.756229:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.756320:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.756592:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272748416 00000100:00100000:1.0:1746065134.756601:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272748416 00000100:00100000:1.0:1746065134.757225:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29938 00000100:00100000:1.0:1746065134.757231:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1795:x1830881272748416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.757237:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.757243:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f247 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e51b1 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.757254:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.757257:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f240 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51b8 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.757262:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.757264:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f247 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51b1 expref: 88 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.757484:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f240 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51b8 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.757495:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f247 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51b1 expref: 88 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.757507:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130640400, rc 0) 00000100:00100000:1.0:1746065134.757543:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:1795:x1830881272748416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 313us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.757549:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29938 00000100:00100000:0.0:1746065134.759128:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.762262:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.764859:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.771058:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.773024:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.775214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.779347:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.780958:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.781024:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.781096:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272750080 00000100:00100000:1.0:1746065134.781099:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272750080 00000100:00100000:0.0:1746065134.783260:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.786837:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272750464 00000100:00100000:0.0:1746065134.786846:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272750464 00002000:00100000:0.0:1746065134.786877:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385ad80 x1830881272750464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.786886:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385ad80 with x1830881272750464 ext(0->4095) 00010000:00010000:0.0:1746065134.786893:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51c6 expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.786904:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51c6 expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.786909:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385ad80 00000100:00100000:0.0:1746065134.786935:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2616 00000100:00100000:0.0:1746065134.786941:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272750464:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065134.787061:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272750464:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 120us (244us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065134.787067:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2616 00002000:00100000:0.0:1746065134.787073:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385ad80 x1830881272750464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.787097:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385ad80 with x1830881272750464 ext(0->4095) 00010000:00010000:0.0:1746065134.787103:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51c6 expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.787112:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f255 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51c6 expref: 87 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.787118:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385ad80 00000100:00100000:0.0:1746065134.803359:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.807984:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.811873:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.813996:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.816485:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009385b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267581312:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065134.816500:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.817678:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272751104:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5336us (5810us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.817687:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13914 00000100:00100000:0.0:1746065134.818575:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272751488 00000100:00100000:0.0:1746065134.818582:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272751488 00002000:00100000:0.0:1746065134.818612:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385a300 x1830881272751488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.818621:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385a300 with x1830881272751488 ext(0->4095) 00010000:00010000:0.0:1746065134.818629:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f263 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51d4 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.818642:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f263 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51d4 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.818648:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385a300 00000100:00100000:0.0:1746065134.818670:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2617 00000100:00100000:0.0:1746065134.818676:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272751488:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065134.818772:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272751488:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (998us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065134.818777:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2617 00002000:00100000:0.0:1746065134.818782:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385a300 x1830881272751488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.818788:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385a300 with x1830881272751488 ext(0->4095) 00010000:00010000:0.0:1746065134.818792:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f263 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51d4 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065134.818800:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f263 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51d4 expref: 6 pid: 9635 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065134.818805:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385a300 00000100:00100000:0.0:1746065134.823199:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.825404:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.832451:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.835755:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:0.0:1746065134.836602:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e51e2 expref: 86 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065134.836618:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ea74380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267581824:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065134.836698:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.845132:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.852788:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.857875:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.857980:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.858010:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272753024 00000100:00100000:0.0:1746065134.858017:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272753024 00002000:00100000:0.0:1746065134.858053:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76d80 x1830881272753024/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.858063:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76d80 with x1830881272753024 ext(0->4095) 00002000:00010000:0.0:1746065134.858075:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea76d80 00000100:00100000:0.0:1746065134.858115:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13408 00000100:00100000:0.0:1746065134.858122:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272753024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065134.858230:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272753024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 108us (249us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065134.858236:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13408 00002000:00100000:0.0:1746065134.858242:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76d80 x1830881272753024/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.858248:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76d80 with x1830881272753024 ext(0->4095) 00002000:00010000:0.0:1746065134.858250:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea76d80 00000100:00100000:0.0:1746065134.858279:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267582080:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065134.858292:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.858318:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:2005:x1830881272752640:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5033us (5532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.858325:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13917 00000100:00100000:0.0:1746065134.860795:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.863956:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.869295:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.871419:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.873862:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.875536:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.877812:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.881128:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.884817:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.885258:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.885898:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29950 00000100:00100000:1.0:1746065134.885906:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1791:x1830881272754688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065134.885912:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.885918:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f29b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e520c expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.885929:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.885932:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87f294 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5205 expref: 88 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.885937:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065134.885939:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f29b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e520c expref: 88 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.885957:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87f294 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5205 expref: 88 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.885966:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f29b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e520c expref: 88 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.885987:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130640a00, rc 0) 00000100:00100000:1.0:1746065134.886007:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:1791:x1830881272754688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 103us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.886012:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29950 00000100:00100000:0.0:1746065134.888015:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.892877:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.893751:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272755072 00000100:00100000:1.0:1746065134.893757:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272755072 00002000:00100000:1.0:1746065134.893787:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084380 x1830881272755072/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.893797:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084380 with x1830881272755072 ext(0->4095) 00010000:00010000:1.0:1746065134.893803:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87f294 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5205 expref: 87 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.893813:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87f294 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5205 expref: 87 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.893818:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f084380 00000100:00100000:1.0:1746065134.893885:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2620 00000100:00100000:1.0:1746065134.893892:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272755072:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.894339:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272755072:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 447us (1460us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.894344:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2620 00002000:00100000:1.0:1746065134.894350:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084380 x1830881272755072/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.894362:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084380 with x1830881272755072 ext(0->4095) 00010000:00010000:1.0:1746065134.894366:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87f294 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5205 expref: 87 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.894375:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87f294 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5205 expref: 87 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.894379:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f084380 00000100:00100000:0.0:1746065134.896836:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.896912:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.899466:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.899486:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272755584 00000100:00100000:1.0:1746065134.899491:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272755584 00002000:00100000:1.0:1746065134.899519:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f087b80 x1830881272755584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.899527:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f087b80 with x1830881272755584 ext(0->4095) 00010000:00010000:1.0:1746065134.899534:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f29b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e520c expref: 86 pid: 21550 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.899544:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f29b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e520c expref: 86 pid: 21550 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.899550:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f087b80 00000100:00100000:1.0:1746065134.899569:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2621 00000100:00100000:1.0:1746065134.899574:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272755584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.899664:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272755584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 89us (198us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.899669:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2621 00002000:00100000:1.0:1746065134.899674:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f087b80 x1830881272755584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.899681:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f087b80 with x1830881272755584 ext(0->4095) 00010000:00010000:1.0:1746065134.899685:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f29b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e520c expref: 86 pid: 21550 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.899693:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f29b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e520c expref: 86 pid: 21550 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.899699:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f087b80 00000100:00100000:0.0:1746065134.900827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.901762:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.904719:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.907628:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.912184:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.914287:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.920246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.921264:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.923216:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.923466:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272757120 00000100:00100000:1.0:1746065134.923481:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272757120 00002000:00100000:1.0:1746065134.923506:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79c000 x1830881272757120/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.923514:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79c000 with x1830881272757120 ext(0->4095) 00010000:00010000:1.0:1746065134.923520:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f2b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5221 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.923530:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f2b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5221 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.923535:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79c000 00000100:00100000:1.0:1746065134.923558:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2623 00000100:00100000:1.0:1746065134.923564:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272757120:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.923746:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272757120:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 181us (528us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.923752:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2623 00002000:00100000:1.0:1746065134.923757:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79c000 x1830881272757120/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.923764:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79c000 with x1830881272757120 ext(0->4095) 00010000:00010000:1.0:1746065134.923768:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f2b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5221 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.923777:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f2b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5221 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.923782:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79c000 00000100:00100000:0.0:1746065134.925568:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.929231:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.929280:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272757504 00000100:00100000:1.0:1746065134.929287:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272757504 00002000:00100000:1.0:1746065134.929322:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79d180 x1830881272757504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.929331:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d180 with x1830881272757504 ext(0->4095) 00002000:00010000:1.0:1746065134.929335:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79d180 00000100:00100000:1.0:1746065134.929442:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13412 00000100:00100000:1.0:1746065134.929451:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272757504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.929561:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272757504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (333us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.929567:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13412 00002000:00100000:1.0:1746065134.929572:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79d180 x1830881272757504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.929584:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d180 with x1830881272757504 ext(0->4095) 00002000:00010000:1.0:1746065134.929587:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79d180 00000100:00100000:0.0:1746065134.935133:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.941462:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.942431:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2005:x1830881272757760:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 740us (977us total) trans 4294972065 rc 0/0 00000100:00100000:0.0:1746065134.942437:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2624 00002000:00100000:0.0:1746065134.942442:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d79ca80 x1830881272757760/t4294972065(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 496/448 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065134.942448:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ca80 with x1830881272757760 ext(0->7) 00010000:00010000:0.0:1746065134.942453:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9200/0x392ae0376f87f2b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5228 expref: 88 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065134.942462:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9200/0x392ae0376f87f2b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5228 expref: 88 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065134.942467:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79ca80 00000001:00080000:0.0:1746065134.944617:0:10896:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294972065 is committed 00000100:00100000:0.0:1746065134.945818:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.952040:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.952152:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.952298:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272758144 00000100:00100000:1.0:1746065134.952306:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272758144 00002000:00100000:1.0:1746065134.952342:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79e680 x1830881272758144/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.952351:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79e680 with x1830881272758144 ext(0->4095) 00002000:00010000:1.0:1746065134.952355:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79e680 00000100:00100000:1.0:1746065134.952371:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13413 00000100:00100000:1.0:1746065134.952376:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272758144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.952482:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272758144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 106us (450us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.952488:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13413 00002000:00100000:1.0:1746065134.952492:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79e680 x1830881272758144/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.952499:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79e680 with x1830881272758144 ext(0->4095) 00002000:00010000:1.0:1746065134.952501:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79e680 00000100:00100000:0.0:1746065134.955780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.956783:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.961811:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.962582:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272758784 00000100:00100000:1.0:1746065134.962588:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272758784 00002000:00100000:1.0:1746065134.962620:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb67b80 x1830881272758784/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.962629:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67b80 with x1830881272758784 ext(0->4095) 00010000:00010000:1.0:1746065134.962636:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87f2c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5236 expref: 7 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.962650:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87f2c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5236 expref: 7 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.962656:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb67b80 00000100:00100000:1.0:1746065134.962686:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2625 00000100:00100000:1.0:1746065134.962692:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881272758784:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.962786:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881272758784:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (981us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.962791:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2625 00002000:00100000:1.0:1746065134.962796:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb67b80 x1830881272758784/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.962803:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67b80 with x1830881272758784 ext(0->4095) 00010000:00010000:1.0:1746065134.962807:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87f2c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5236 expref: 7 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.962816:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9e00/0x392ae0376f87f2c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5236 expref: 7 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.962821:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb67b80 00000100:00100000:0.0:1746065134.964854:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.967246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.970214:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.973651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.978070:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.978636:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.978984:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272759680 00000100:00100000:1.0:1746065134.978988:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272759680 00002000:00100000:1.0:1746065134.979010:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64e00 x1830881272759680/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.979018:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64e00 with x1830881272759680 ext(0->4095) 00010000:00010000:1.0:1746065134.979023:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f2d3 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5244 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.979031:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f2d3 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5244 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.979036:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64e00 00000100:00100000:1.0:1746065134.979056:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2626 00000100:00100000:1.0:1746065134.979061:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272759680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065134.979738:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272759680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 675us (1669us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.979745:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2626 00002000:00100000:1.0:1746065134.979750:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64e00 x1830881272759680/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.979757:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64e00 with x1830881272759680 ext(0->4095) 00010000:00010000:1.0:1746065134.979762:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f2d3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5244 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.979770:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f2d3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5244 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.979776:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64e00 00000100:00100000:1.0:1746065134.983569:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.983667:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.986856:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065134.987009:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272760320 00000100:00100000:1.0:1746065134.987016:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272760320 00002000:00100000:1.0:1746065134.987055:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb65f80 x1830881272760320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.987064:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb65f80 with x1830881272760320 ext(0->4095) 00010000:00010000:1.0:1746065134.987071:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f2da lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e524b expref: 8 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.987113:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f2da lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e524b expref: 8 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.987119:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb65f80 00000100:00100000:1.0:1746065134.987138:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2627 00000100:00100000:1.0:1746065134.987144:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881272760320:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065134.987251:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881272760320:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 107us (404us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.987257:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2627 00002000:00100000:1.0:1746065134.987262:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb65f80 x1830881272760320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065134.987268:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb65f80 with x1830881272760320 ext(0->4095) 00010000:00010000:1.0:1746065134.987272:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f2da lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e524b expref: 8 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065134.987279:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f2da lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e524b expref: 8 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065134.987284:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb65f80 00000100:00100000:0.0:1746065134.990630:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.994896:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093858a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267585920:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065134.994913:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.994955:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881272760448:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4190us (4333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.994964:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13932 00000100:00100000:0.0:1746065134.995263:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065134.996897:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.005135:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.005983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.007594:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.007788:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272761344 00000100:00100000:1.0:1746065135.007793:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272761344 00002000:00100000:1.0:1746065135.007819:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18df80 x1830881272761344/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.007827:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18df80 with x1830881272761344 ext(0->4095) 00010000:00010000:1.0:1746065135.007833:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f2e8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5259 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.007843:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f2e8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5259 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.007849:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18df80 00000100:00100000:1.0:1746065135.007862:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2628 00000100:00100000:1.0:1746065135.007867:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272761344:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065135.007956:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272761344:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 89us (364us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.007961:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2628 00002000:00100000:1.0:1746065135.007966:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18df80 x1830881272761344/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.007983:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18df80 with x1830881272761344 ext(0->4095) 00010000:00010000:1.0:1746065135.007987:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f2e8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5259 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.007994:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f2e8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5259 expref: 6 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.008003:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18df80 00000100:00100000:0.0:1746065135.012748:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.018802:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.027535:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.033692:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.034924:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881272761984:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1018us (1234us total) trans 4294972066 rc 0/0 00000100:00100000:0.0:1746065135.034931:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2629 00002000:00100000:0.0:1746065135.034938:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012f18c700 x1830881272761984/t4294972066(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.034945:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18c700 with x1830881272761984 ext(0->7) 00010000:00010000:0.0:1746065135.034951:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f2ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5260 expref: 8 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.034961:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f2ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5260 expref: 8 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.035064:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18c700 00000100:00100000:0.0:1746065135.044163:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.044213:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.050912:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.056328:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.060681:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.061200:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272762880 00000100:00100000:1.0:1746065135.061208:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272762880 00002000:00100000:1.0:1746065135.061241:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5880 x1830881272762880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.061250:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5880 with x1830881272762880 ext(0->4095) 00002000:00010000:1.0:1746065135.061254:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a5880 00000100:00100000:1.0:1746065135.061285:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13417 00000100:00100000:1.0:1746065135.061291:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881272762880:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.061399:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881272762880:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 107us (719us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.061404:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13417 00002000:00100000:1.0:1746065135.061410:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5880 x1830881272762880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.061417:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5880 with x1830881272762880 ext(0->4095) 00002000:00010000:1.0:1746065135.061419:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a5880 00000100:00100000:0.0:1746065135.067881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.071483:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.072808:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881272763136:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 999us (1326us total) trans 4294972067 rc 0/0 00000100:00100000:0.0:1746065135.072814:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2631 00002000:00100000:0.0:1746065135.072820:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800979a4380 x1830881272763136/t4294972067(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.072826:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4380 with x1830881272763136 ext(0->7) 00010000:00010000:0.0:1746065135.072831:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87f2fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e526e expref: 10 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.072841:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87f2fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e526e expref: 10 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.072846:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a4380 00000100:00100000:0.0:1746065135.077551:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.079703:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.082936:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.083019:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272763648 00000100:00100000:1.0:1746065135.083026:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272763648 00002000:00100000:1.0:1746065135.083056:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5c00 x1830881272763648/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.083064:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5c00 with x1830881272763648 ext(0->4095) 00010000:00010000:1.0:1746065135.083071:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5275 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.083117:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5275 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.083123:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a5c00 00000100:00100000:1.0:1746065135.083138:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2632 00000100:00100000:1.0:1746065135.083144:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272763648:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.083564:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272763648:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 419us (628us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.083570:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2632 00002000:00100000:1.0:1746065135.083576:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5c00 x1830881272763648/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.083583:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5c00 with x1830881272763648 ext(0->4095) 00010000:00010000:1.0:1746065135.083588:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5275 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.083597:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5275 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.083602:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a5c00 00000100:00100000:0.0:1746065135.087159:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.096604:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093858700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267587456:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065135.096620:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065135.096664:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272763776:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 9257us (9511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.096674:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13938 00000100:00100000:1.0:1746065135.097018:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272764032 00000100:00100000:1.0:1746065135.097024:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272764032 00002000:00100000:1.0:1746065135.097055:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858e00 x1830881272764032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.097063:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858e00 with x1830881272764032 ext(0->4095) 00002000:00010000:1.0:1746065135.097068:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093858e00 00000100:00100000:1.0:1746065135.097107:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13418 00000100:00100000:1.0:1746065135.097113:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881272764032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065135.098247:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881272764032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1131us (3117us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.098254:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13418 00002000:00100000:1.0:1746065135.098260:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858e00 x1830881272764032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.098267:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858e00 with x1830881272764032 ext(0->4095) 00002000:00010000:1.0:1746065135.098270:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093858e00 00000100:00100000:0.0:1746065135.105232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.105448:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272764160 00000100:00100000:1.0:1746065135.105455:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272764160 00000100:00100000:1.0:1746065135.105508:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29967 00000100:00100000:1.0:1746065135.105514:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272764160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.105532:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.105547:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f87f312 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5283 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.105568:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9200/0x392ae0376f87f30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e527c expref: 9 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.105574:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.105576:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.105579:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f87f312 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5283 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.105607:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9200/0x392ae0376f87f30b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e527c expref: 9 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.105617:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9200/0x392ae0376f87f30b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e527c expref: 9 pid: 9642 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065135.105627:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267587584:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065135.105707:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.107368:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267587584:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.107386:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f87f312 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5283 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.107398:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130641c00, rc 0) 00000100:00100000:1.0:1746065135.107423:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272764160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1909us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.107430:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29967 00000100:00100000:0.0:1746065135.108932:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.111290:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881272764288:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2164us (2355us total) trans 4294972068 rc 0/0 00000100:00100000:0.0:1746065135.111301:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2633 00002000:00100000:0.0:1746065135.111307:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800979a7100 x1830881272764288/t4294972068(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.111315:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7100 with x1830881272764288 ext(0->7) 00010000:00010000:0.0:1746065135.111321:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9200/0x392ae0376f87f30b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e527c expref: 12 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.111332:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9200/0x392ae0376f87f30b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e527c expref: 12 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.111338:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a7100 00000100:00100000:0.0:1746065135.114544:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.119450:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.119503:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272764672 00000100:00100000:1.0:1746065135.119508:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272764672 00002000:00100000:1.0:1746065135.119543:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c8000 x1830881272764672/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.119552:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8000 with x1830881272764672 ext(0->4095) 00002000:00010000:1.0:1746065135.119555:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c8000 00000100:00100000:1.0:1746065135.119583:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13419 00000100:00100000:1.0:1746065135.119589:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272764672:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065135.119712:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272764672:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 122us (269us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.119718:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13419 00002000:00100000:1.0:1746065135.119723:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c8000 x1830881272764672/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.119731:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8000 with x1830881272764672 ext(0->4095) 00002000:00010000:1.0:1746065135.119733:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c8000 00000100:00100000:0.0:1746065135.121057:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.121105:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272764800 00000100:00100000:1.0:1746065135.121109:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272764800 00000100:00100000:1.0:1746065135.121165:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29968 00000100:00100000:1.0:1746065135.121170:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:1795:x1830881272764800:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.121180:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.121192:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f319 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e528a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.121213:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f87f312 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5283 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.121219:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.121220:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.121223:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f319 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e528a expref: 12 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.121244:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f87f312 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5283 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.121257:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f87f312 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5283 expref: 5 pid: 9635 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065135.121266:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267587840:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065135.121316:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.126666:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.128221:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267587840:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.128245:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f319 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e528a expref: 12 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.128259:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130640400, rc 0) 00000100:00100000:1.0:1746065135.128310:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:1795:x1830881272764800:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7139us (7253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.128317:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29968 00000100:00100000:1.0:1746065135.128338:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272764928 00000100:00100000:1.0:1746065135.128342:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272764928 00000100:00100000:1.0:1746065135.128365:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29969 00000100:00100000:1.0:1746065135.128370:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:1791:x1830881272764928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.128380:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.128392:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f320 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5291 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.128417:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.128420:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f319 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e528a expref: 13 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.128428:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.128431:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f320 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5291 expref: 13 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.128453:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f319 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e528a expref: 13 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.128462:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f320 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5291 expref: 13 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.128468:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0200, rc 0) 00000100:00100000:1.0:1746065135.128482:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:1791:x1830881272764928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 112us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.128486:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29969 00000100:00100000:0.0:1746065135.129700:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.135539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.135710:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272765312 00000100:00100000:1.0:1746065135.135715:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272765312 00002000:00100000:1.0:1746065135.135744:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6ca680 x1830881272765312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.135753:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6ca680 with x1830881272765312 ext(0->4095) 00010000:00010000:1.0:1746065135.135760:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e528a expref: 13 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.135771:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e528a expref: 13 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.135777:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6ca680 00000100:00100000:1.0:1746065135.135790:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2634 00000100:00100000:1.0:1746065135.135795:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2005:x1830881272765312:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.135885:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2005:x1830881272765312:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 90us (347us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.135891:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2634 00002000:00100000:1.0:1746065135.135895:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6ca680 x1830881272765312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.135901:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6ca680 with x1830881272765312 ext(0->4095) 00010000:00010000:1.0:1746065135.135905:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e528a expref: 13 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.135913:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130640400/0x392ae0376f87f319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e528a expref: 13 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.135918:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6ca680 00000100:00100000:0.0:1746065135.139307:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.139357:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.142928:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272765824 00000100:00100000:0.0:1746065135.142934:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272765824 00002000:00100000:0.0:1746065135.142963:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88b800 x1830881272765824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.142981:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88b800 with x1830881272765824 ext(0->4095) 00010000:00010000:0.0:1746065135.142987:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f320 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5291 expref: 12 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.143003:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f320 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5291 expref: 12 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.143008:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e88b800 00000100:00100000:0.0:1746065135.143031:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2635 00000100:00100000:0.0:1746065135.143039:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881272765824:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065135.143386:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881272765824:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 349us (645us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065135.143392:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2635 00002000:00100000:0.0:1746065135.143397:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88b800 x1830881272765824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.143403:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88b800 with x1830881272765824 ext(0->4095) 00010000:00010000:0.0:1746065135.143407:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f320 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5291 expref: 12 pid: 9635 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.143415:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f320 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5291 expref: 12 pid: 9635 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.143420:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e88b800 00000100:00100000:0.0:1746065135.144735:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.144788:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.148582:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.148632:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272766336 00000100:00100000:1.0:1746065135.148637:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272766336 00002000:00100000:1.0:1746065135.148678:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9880 x1830881272766336/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.148687:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9880 with x1830881272766336 ext(0->4095) 00010000:00010000:1.0:1746065135.148694:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5298 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.148705:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5298 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.148714:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9880 00000100:00100000:1.0:1746065135.148741:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2636 00000100:00100000:1.0:1746065135.148746:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272766336:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065135.148842:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272766336:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (264us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.148847:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2636 00002000:00100000:1.0:1746065135.148851:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9880 x1830881272766336/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.148857:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9880 with x1830881272766336 ext(0->4095) 00010000:00010000:1.0:1746065135.148862:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5298 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.148869:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5298 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.148873:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9880 00000100:00100000:0.0:1746065135.151035:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.153842:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.153905:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272766720 00000100:00100000:1.0:1746065135.153912:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272766720 00002000:00100000:1.0:1746065135.153943:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c8a80 x1830881272766720/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.153952:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8a80 with x1830881272766720 ext(0->4095) 00002000:00010000:1.0:1746065135.153955:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c8a80 00000100:00100000:1.0:1746065135.153991:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13420 00000100:00100000:1.0:1746065135.153999:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881272766720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.154117:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881272766720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 118us (279us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.154123:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13420 00002000:00100000:1.0:1746065135.154128:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c8a80 x1830881272766720/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.154135:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8a80 with x1830881272766720 ext(0->4095) 00002000:00010000:1.0:1746065135.154137:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c8a80 00000100:00100000:0.0:1746065135.160446:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.164143:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.164178:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.167160:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.167229:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272767360 00000100:00100000:1.0:1746065135.167235:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272767360 00002000:00100000:1.0:1746065135.167264:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cb480 x1830881272767360/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.167273:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb480 with x1830881272767360 ext(0->4095) 00010000:00010000:1.0:1746065135.167280:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f335 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52a6 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.167292:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f335 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52a6 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.167298:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6cb480 00000100:00100000:1.0:1746065135.167326:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2637 00000100:00100000:1.0:1746065135.167331:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272767360:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065135.167415:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272767360:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 84us (258us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.167420:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2637 00002000:00100000:1.0:1746065135.167424:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cb480 x1830881272767360/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.167429:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb480 with x1830881272767360 ext(0->4095) 00010000:00010000:1.0:1746065135.167433:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f335 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52a6 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.167439:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8e00/0x392ae0376f87f335 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52a6 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.167443:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6cb480 00000100:00100000:0.0:1746065135.171061:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.174672:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.180120:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.188453:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.191308:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.193806:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.204326:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.210537:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.214571:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267589760:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065135.214588:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065135.216034:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881272768640:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5245us (5498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.216044:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13947 00000100:00100000:1.0:1746065135.216322:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.216414:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272768896 00000100:00100000:0.0:1746065135.216420:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272768896 00002000:00100000:0.0:1746065135.216452:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fce00 x1830881272768896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.216460:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fce00 with x1830881272768896 ext(0->4095) 00002000:00010000:0.0:1746065135.216464:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fce00 00000100:00100000:0.0:1746065135.216493:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13422 00000100:00100000:0.0:1746065135.216499:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2004:x1830881272768896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065135.223229:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2004:x1830881272768896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 6722us (6899us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065135.223240:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13422 00002000:00100000:0.0:1746065135.223251:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fce00 x1830881272768896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.223259:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fce00 with x1830881272768896 ext(0->4095) 00002000:00010000:0.0:1746065135.223264:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fce00 00000100:00100000:0.0:1746065135.226530:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.230513:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.232136:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881272769152:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1464us (1620us total) trans 4294972070 rc 0/0 00000100:00100000:0.0:1746065135.232143:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2640 00002000:00100000:0.0:1746065135.232149:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800729b1180 x1830881272769152/t4294972070(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.232156:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1180 with x1830881272769152 ext(0->7) 00010000:00010000:0.0:1746065135.232161:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87f34a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52bb expref: 16 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.232172:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87f34a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52bb expref: 16 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.232177:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b1180 00000100:00100000:0.0:1746065135.233750:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.237934:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.242071:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272769664 00000100:00100000:0.0:1746065135.242101:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272769664 00002000:00100000:0.0:1746065135.242139:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385b480 x1830881272769664/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.242148:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b480 with x1830881272769664 ext(0->4095) 00010000:00010000:0.0:1746065135.242156:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8400/0x392ae0376f87f351 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52c2 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.242168:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8400/0x392ae0376f87f351 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52c2 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.242174:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385b480 00000100:00100000:0.0:1746065135.242202:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2641 00000100:00100000:0.0:1746065135.242208:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272769664:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065135.242312:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272769664:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 104us (2351us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065135.242318:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2641 00002000:00100000:0.0:1746065135.242322:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385b480 x1830881272769664/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.242329:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b480 with x1830881272769664 ext(0->4095) 00010000:00010000:0.0:1746065135.242333:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8400/0x392ae0376f87f351 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52c2 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.242340:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8400/0x392ae0376f87f351 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52c2 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.242345:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385b480 00000100:00100000:0.0:1746065135.244538:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.246044:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.248614:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.252424:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.259896:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.259961:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272770560 00000100:00100000:0.0:1746065135.259979:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272770560 00002000:00100000:0.0:1746065135.260010:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fd180 x1830881272770560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.260019:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fd180 with x1830881272770560 ext(0->4095) 00002000:00010000:0.0:1746065135.260023:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fd180 00000100:00100000:0.0:1746065135.260051:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13423 00000100:00100000:0.0:1746065135.260057:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881272770560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065135.260197:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881272770560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 140us (303us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065135.260203:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13423 00002000:00100000:0.0:1746065135.260208:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fd180 x1830881272770560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.260215:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fd180 with x1830881272770560 ext(0->4095) 00002000:00010000:0.0:1746065135.260218:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fd180 00000100:00100000:0.0:1746065135.263685:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.267788:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.269577:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272770944 00000100:00100000:0.0:1746065135.269582:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272770944 00000100:00100000:0.0:1746065135.269613:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29980 00000100:00100000:0.0:1746065135.269618:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:1791:x1830881272770944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065135.269629:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.269639:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e52de expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.269658:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87f366 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52d7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.269664:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.269665:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.269667:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52de expref: 17 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.269684:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87f366 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52d7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.269694:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87f366 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52d7 expref: 5 pid: 9560 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065135.269702:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267590912:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065135.269746:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.271723:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.271811:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267590912:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.271827:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52de expref: 16 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.271836:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f524800, rc 0) 00000100:00100000:1.0:1746065135.271856:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:1791:x1830881272770944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2238us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.271862:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29980 00000100:00100000:0.0:1746065135.274984:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:0.0:1746065135.275272:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87f366 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52d7 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065135.275480:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13952 00000100:00100000:0.0:1746065135.275486:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272771328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065135.275496:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065135.275509:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87f366 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52d7 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.275519:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87f366 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52d7 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.275536:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8800/0x392ae0376f87f366 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52d7 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.275557:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.275558:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.275564:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52de expref: 15 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.275571:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52de expref: 15 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.275591:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52de expref: 15 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.275601:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267591040:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065135.275665:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.278569:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.280605:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272771584 00000100:00100000:1.0:1746065135.280612:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272771584 00002000:00100000:1.0:1746065135.280643:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1f80 x1830881272771584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.280657:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1f80 with x1830881272771584 ext(0->4095) 00002000:00010000:1.0:1746065135.280661:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b1f80 00000100:00100000:1.0:1746065135.280764:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13424 00000100:00100000:1.0:1746065135.280770:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881272771584:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.280878:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881272771584:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 108us (2313us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.281104:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13424 00002000:00100000:1.0:1746065135.281111:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1f80 x1830881272771584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.281118:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1f80 with x1830881272771584 ext(0->4095) 00002000:00010000:1.0:1746065135.281121:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b1f80 00000100:00100000:0.0:1746065135.289378:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.290023:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272771712 00000100:00100000:1.0:1746065135.290031:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272771712 00000100:00100000:1.0:1746065135.290072:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29981 00000100:00100000:1.0:1746065135.290077:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272771712:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.290109:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.290123:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1e00/0x392ae0376f87f374 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e52e5 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.290146:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52de expref: 15 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.290153:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.290154:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.290157:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1e00/0x392ae0376f87f374 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52e5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.290179:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52de expref: 15 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.290188:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52de expref: 15 pid: 9560 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065135.290197:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267591168:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065135.290530:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.295728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.295758:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272771840 00000100:00100000:0.0:1746065135.295763:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272771840 00002000:00100000:0.0:1746065135.295793:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800729b1c00 x1830881272771840/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.295808:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1c00 with x1830881272771840 ext(0->7) 00010000:00010000:0.0:1746065135.295815:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52de expref: 16 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.295826:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f87f36d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52de expref: 16 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.295832:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b1c00 00000100:00100000:0.0:1746065135.295844:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2644 00000100:00100000:0.0:1746065135.295850:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881272771840:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746065135.296298:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267591168:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.296318:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1e00/0x392ae0376f87f374 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52e5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.296330:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1e00, rc 0) 00000100:00100000:1.0:1746065135.296361:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272771712:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6284us (6990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.296367:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29981 00000100:00100000:0.0:1746065135.308494:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.313120:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.313224:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272772096 00000100:00100000:1.0:1746065135.313231:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272772096 00000100:00100000:1.0:1746065135.313465:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29982 00000100:00100000:1.0:1746065135.313473:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:1791:x1830881272772096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.313487:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.313501:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f37b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e52ec expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.313527:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1e00/0x392ae0376f87f374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52e5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.313532:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.313534:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.313537:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f37b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52ec expref: 19 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.313559:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1e00/0x392ae0376f87f374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52e5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.313569:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1e00/0x392ae0376f87f374 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52e5 expref: 5 pid: 9560 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065135.313579:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267591424:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065135.313631:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.315498:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.315987:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267591424:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.316004:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f37b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52ec expref: 18 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.316016:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0800, rc 0) 00000100:00100000:1.0:1746065135.316038:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:1791:x1830881272772096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2567us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.316044:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29982 00000100:00100000:0.0:1746065135.321549:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.324930:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.331241:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.332475:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272772864 00000100:00100000:1.0:1746065135.332483:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272772864 00000100:00100000:1.0:1746065135.332527:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29983 00000100:00100000:1.0:1746065135.332534:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272772864:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.332548:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.332562:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f382 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e52f3 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.332585:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52ec expref: 17 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.332592:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.332593:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.332596:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f382 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52f3 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.332619:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f37b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52ec expref: 17 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.332628:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f37b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52ec expref: 17 pid: 9560 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065135.332639:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267591680:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065135.332705:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.338379:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267591680:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.338405:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f382 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52f3 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.338422:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1600, rc 0) 00000100:00100000:1.0:1746065135.338457:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272772864:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5923us (7224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.338470:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29983 00000100:00100000:0.0:1746065135.339125:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.341745:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881272772992:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2383us (2613us total) trans 4294972072 rc 0/0 00000100:00100000:0.0:1746065135.341756:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2646 00002000:00100000:0.0:1746065135.341763:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a0919500 x1830881272772992/t4294972072(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.341771:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919500 with x1830881272772992 ext(0->7) 00010000:00010000:0.0:1746065135.341779:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f37b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52ec expref: 20 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.341793:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f37b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52ec expref: 20 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.341799:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0919500 00000100:00100000:0.0:1746065135.346505:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.347269:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272773120 00000100:00100000:1.0:1746065135.347284:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272773120 00000100:00100000:1.0:1746065135.347341:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29984 00000100:00100000:1.0:1746065135.347348:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:1791:x1830881272773120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.347368:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.347382:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f389 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e52fa expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.347409:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.347419:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f382 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52f3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.347425:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065135.347428:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f389 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52fa expref: 21 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.347461:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f382 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52f3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.347477:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f389 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52fa expref: 21 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.347485:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1800, rc 0) 00000100:00100000:1.0:1746065135.347542:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1791:x1830881272773120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 194us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.347551:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29984 00000100:00100000:0.0:1746065135.348135:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.351979:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.352052:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272773504 00000100:00100000:1.0:1746065135.352059:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272773504 00002000:00100000:1.0:1746065135.352109:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918000 x1830881272773504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.352118:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918000 with x1830881272773504 ext(0->4095) 00010000:00010000:1.0:1746065135.352125:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f382 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52f3 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.352139:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f382 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52f3 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.352144:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918000 00000100:00100000:1.0:1746065135.352161:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2647 00000100:00100000:1.0:1746065135.352167:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272773504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.352272:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272773504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 105us (306us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.352277:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2647 00002000:00100000:1.0:1746065135.352281:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918000 x1830881272773504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.352288:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918000 with x1830881272773504 ext(0->4095) 00010000:00010000:1.0:1746065135.352293:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f382 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52f3 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.352304:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f382 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e52f3 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.352309:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918000 00000100:00100000:0.0:1746065135.354134:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.355819:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.355836:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272773888 00000100:00100000:0.0:1746065135.355838:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272773888 00002000:00100000:0.0:1746065135.355859:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5c00 x1830881272773888/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.355867:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5c00 with x1830881272773888 ext(0->4095) 00002000:00010000:0.0:1746065135.355870:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff5c00 00000100:00100000:0.0:1746065135.355882:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13426 00000100:00100000:0.0:1746065135.355887:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2002:x1830881272773888:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746065135.355983:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2002:x1830881272773888:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 95us (163us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065135.355988:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13426 00002000:00100000:0.0:1746065135.355993:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5c00 x1830881272773888/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.356000:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5c00 with x1830881272773888 ext(0->4095) 00002000:00010000:0.0:1746065135.356002:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff5c00 00000100:00100000:0.0:1746065135.357507:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.359722:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.361350:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.361410:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272774400 00000100:00100000:1.0:1746065135.361414:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272774400 00002000:00100000:1.0:1746065135.361439:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5880 x1830881272774400/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.361448:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5880 with x1830881272774400 ext(0->4095) 00002000:00010000:1.0:1746065135.361451:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff5880 00000100:00100000:1.0:1746065135.361476:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13427 00000100:00100000:1.0:1746065135.361482:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272774400:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.361576:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272774400:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 94us (226us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.361582:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13427 00002000:00100000:1.0:1746065135.361586:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5880 x1830881272774400/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.361593:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5880 with x1830881272774400 ext(0->4095) 00002000:00010000:1.0:1746065135.361596:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff5880 00000100:00100000:0.0:1746065135.363520:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.365657:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.367812:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.368889:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.372500:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.373475:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.376170:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.379337:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.379380:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.382135:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.382151:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272776064 00000100:00100000:1.0:1746065135.382157:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272776064 00002000:00100000:1.0:1746065135.382185:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4380 x1830881272776064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.382199:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4380 with x1830881272776064 ext(0->4095) 00010000:00010000:1.0:1746065135.382204:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f3a5 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5316 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.382214:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f3a5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5316 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.382219:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff4380 00000100:00100000:1.0:1746065135.382234:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2650 00000100:00100000:1.0:1746065135.382240:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272776064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065135.382323:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272776064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 83us (193us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.382328:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2650 00002000:00100000:1.0:1746065135.382332:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4380 x1830881272776064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.382339:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4380 with x1830881272776064 ext(0->4095) 00010000:00010000:1.0:1746065135.382342:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f3a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5316 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.382350:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f3a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5316 expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.382355:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff4380 00000100:00100000:0.0:1746065135.384432:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.387895:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.388003:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272776448 00000100:00100000:1.0:1746065135.388010:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272776448 00002000:00100000:1.0:1746065135.388040:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffe680 x1830881272776448/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.388048:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffe680 with x1830881272776448 ext(0->4095) 00002000:00010000:1.0:1746065135.388052:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dffe680 00000100:00100000:1.0:1746065135.388078:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13428 00000100:00100000:1.0:1746065135.388111:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881272776448:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.388214:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881272776448:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (321us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.388220:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13428 00002000:00100000:1.0:1746065135.388224:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffe680 x1830881272776448/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.388231:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffe680 with x1830881272776448 ext(0->4095) 00002000:00010000:1.0:1746065135.388234:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dffe680 00000100:00100000:0.0:1746065135.389388:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.391133:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.393588:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.395326:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.396611:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.398297:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.398905:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.400952:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.401024:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.402807:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.405208:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.405269:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.407528:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.411041:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.415687:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.426298:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.426383:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272779136 00000100:00100000:1.0:1746065135.426391:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272779136 00000100:00100000:1.0:1746065135.426437:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29995 00000100:00100000:1.0:1746065135.426444:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272779136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.426458:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.426472:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f3d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5347 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.426497:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f3cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5340 expref: 19 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.426508:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.426509:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.426513:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f3d6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5347 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.426535:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f3cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5340 expref: 19 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.426546:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f3cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5340 expref: 19 pid: 9642 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065135.426557:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267594752:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065135.426629:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.430789:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267594752:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.430811:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f3d6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5347 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.430825:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1600, rc 0) 00000100:00100000:1.0:1746065135.430861:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272779136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4418us (4571us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.430869:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29995 00000100:00100000:0.0:1746065135.432353:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.432391:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.432453:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272779392 00000100:00100000:1.0:1746065135.432459:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272779392 00000100:00100000:1.0:1746065135.432497:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 29996 00000100:00100000:1.0:1746065135.432503:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1791:x1830881272779392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.432515:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.432526:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f3dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e534e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.432542:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.432547:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f3d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5347 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.432551:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065135.432554:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f3dd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e534e expref: 22 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.432578:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f3d6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5347 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.432587:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f3dd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e534e expref: 22 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.432594:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:1.0:1746065135.432617:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:1791:x1830881272779392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 114us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.432622:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 29996 00000100:00100000:0.0:1746065135.433368:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2005:x1830881272779264:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 816us (974us total) trans 4294972073 rc 0/0 00000100:00100000:0.0:1746065135.433374:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2654 00002000:00100000:0.0:1746065135.433379:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009dc10700 x1830881272779264/t4294972073(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.433385:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10700 with x1830881272779264 ext(0->7) 00010000:00010000:0.0:1746065135.433390:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f3cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5340 expref: 23 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.433398:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f3cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5340 expref: 23 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.433403:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc10700 00000100:00100000:0.0:1746065135.437905:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.448607:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.448852:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272779776 00000100:00100000:1.0:1746065135.448857:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272779776 00002000:00100000:1.0:1746065135.448887:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc10380 x1830881272779776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.448895:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10380 with x1830881272779776 ext(0->4095) 00010000:00010000:1.0:1746065135.448903:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f3d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5347 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.448914:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f3d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5347 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.448919:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc10380 00000100:00100000:1.0:1746065135.448944:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2655 00000100:00100000:1.0:1746065135.448950:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272779776:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065135.449787:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272779776:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 837us (1188us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.449793:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2655 00002000:00100000:1.0:1746065135.449798:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc10380 x1830881272779776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.449805:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10380 with x1830881272779776 ext(0->4095) 00010000:00010000:1.0:1746065135.449809:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f3d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5347 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.449817:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f3d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5347 expref: 6 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.449821:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc10380 00000100:00100000:0.0:1746065135.460002:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.460421:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272780160 00000100:00100000:1.0:1746065135.460427:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272780160 00002000:00100000:1.0:1746065135.460454:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc13100 x1830881272780160/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.460469:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc13100 with x1830881272780160 ext(0->4095) 00002000:00010000:1.0:1746065135.460472:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc13100 00000100:00100000:1.0:1746065135.460487:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13431 00000100:00100000:1.0:1746065135.460494:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881272780160:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.460581:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881272780160:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 87us (579us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.460586:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13431 00002000:00100000:1.0:1746065135.460590:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc13100 x1830881272780160/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.460596:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc13100 with x1830881272780160 ext(0->4095) 00002000:00010000:1.0:1746065135.460598:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc13100 00000100:00100000:0.0:1746065135.463115:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.468425:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.470344:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.472714:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.476861:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.479786:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.479833:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272781184 00000100:00100000:1.0:1746065135.479839:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272781184 00002000:00100000:1.0:1746065135.479867:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091e300 x1830881272781184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.479875:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091e300 with x1830881272781184 ext(0->4095) 00002000:00010000:1.0:1746065135.479879:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091e300 00000100:00100000:1.0:1746065135.479905:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13432 00000100:00100000:1.0:1746065135.479911:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2002:x1830881272781184:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065135.480013:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2002:x1830881272781184:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 102us (228us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.480019:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13432 00002000:00100000:1.0:1746065135.480024:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091e300 x1830881272781184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.480030:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091e300 with x1830881272781184 ext(0->4095) 00002000:00010000:1.0:1746065135.480033:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091e300 00000100:00100000:0.0:1746065135.484221:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.491729:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.492951:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881272781440:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 964us (1223us total) trans 4294972074 rc 0/0 00000100:00100000:0.0:1746065135.492957:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2657 00002000:00100000:0.0:1746065135.492972:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a091ed80 x1830881272781440/t4294972074(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.492979:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ed80 with x1830881272781440 ext(0->7) 00010000:00010000:0.0:1746065135.492985:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f3eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e535c expref: 24 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.492995:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f3eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e535c expref: 24 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.493000:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091ed80 00000100:00100000:0.0:1746065135.501034:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.501313:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.505682:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.510293:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.513753:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.518167:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.526237:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.543192:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.552339:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.559546:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.567784:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.572625:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.575574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.575617:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272783616 00000100:00100000:1.0:1746065135.575624:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272783616 00000100:00100000:1.0:1746065135.575666:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30003 00000100:00100000:1.0:1746065135.575672:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272783616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.575685:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.575698:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f40e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e537f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.575719:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87f407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5378 expref: 25 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.575725:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.575726:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.575729:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f40e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e537f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.575750:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87f407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5378 expref: 25 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.575760:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87f407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5378 expref: 25 pid: 9642 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065135.575770:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267596800:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065135.575835:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.579703:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267596800:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.579725:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f40e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e537f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.579739:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0800, rc 0) 00000100:00100000:1.0:1746065135.579780:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272783616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4107us (4211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.579786:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30003 00000100:00100000:0.0:1746065135.586589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.586680:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272783744 00000100:00100000:1.0:1746065135.586688:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272783744 00002000:00100000:1.0:1746065135.586725:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880124b88000 x1830881272783744/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.586734:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88000 with x1830881272783744 ext(0->7) 00010000:00010000:1.0:1746065135.586742:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87f407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5378 expref: 26 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.586755:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87f407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5378 expref: 26 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.586761:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b88000 00000100:00100000:1.0:1746065135.586787:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2661 00000100:00100000:1.0:1746065135.586793:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881272783744:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065135.591163:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2005:x1830881272783744:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 4361us (4572us total) trans 4294972076 rc 0/0 00000100:00100000:0.0:1746065135.591174:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2661 00002000:00100000:0.0:1746065135.591184:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880124b88000 x1830881272783744/t4294972076(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.591192:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88000 with x1830881272783744 ext(0->7) 00010000:00010000:0.0:1746065135.591200:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87f407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5378 expref: 28 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.591213:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8a00/0x392ae0376f87f407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5378 expref: 28 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.591219:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b88000 00000100:00100000:0.0:1746065135.597573:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.597667:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272783872 00000100:00100000:1.0:1746065135.597675:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272783872 00000100:00100000:1.0:1746065135.597765:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30004 00000100:00100000:1.0:1746065135.597772:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:1791:x1830881272783872:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.597787:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.597801:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f415 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5386 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.597820:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.597825:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f40e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e537f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.597830:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065135.597833:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f415 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5386 expref: 29 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.597859:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f40e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e537f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.597867:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f415 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5386 expref: 29 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.597875:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1600, rc 0) 00000100:00100000:1.0:1746065135.597914:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:1791:x1830881272783872:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 142us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.597920:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30004 00000100:00100000:0.0:1746065135.605220:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.609612:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.610934:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.612874:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.614164:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.616613:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.618976:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.620151:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.622644:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.624372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.626027:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.627894:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.629829:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2002:x1830881272785920:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1418us (1934us total) trans 4294972077 rc 0/0 00000100:00100000:0.0:1746065135.629835:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2663 00002000:00100000:0.0:1746065135.629841:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880124b8a680 x1830881272785920/t4294972077(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.629848:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8a680 with x1830881272785920 ext(0->7) 00010000:00010000:0.0:1746065135.629853:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f87f423 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5394 expref: 30 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.629861:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f87f423 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5394 expref: 30 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.629866:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8a680 00000100:00100000:0.0:1746065135.631592:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.634233:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.634438:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272786304 00000100:00100000:1.0:1746065135.634442:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272786304 00002000:00100000:1.0:1746065135.634468:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a2680 x1830881272786304/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.634477:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a2680 with x1830881272786304 ext(0->4095) 00002000:00010000:1.0:1746065135.634481:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a2680 00000100:00100000:1.0:1746065135.634507:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13438 00000100:00100000:1.0:1746065135.634513:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272786304:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065135.634622:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272786304:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 109us (392us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.634628:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13438 00002000:00100000:1.0:1746065135.634633:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a2680 x1830881272786304/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.634640:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a2680 with x1830881272786304 ext(0->4095) 00002000:00010000:1.0:1746065135.634642:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a2680 00000100:00100000:0.0:1746065135.637743:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.637823:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.637985:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272786432 00000100:00100000:1.0:1746065135.637992:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272786432 00000100:00100000:1.0:1746065135.638018:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272786560 00000100:00100000:1.0:1746065135.638020:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272786560 00000100:00100000:1.0:1746065135.638039:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30008 00000100:00100000:1.0:1746065135.638044:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:1795:x1830881272786432:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.638059:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.638072:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f431 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e53a2 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.638115:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f42a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e539b expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.638121:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.638123:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.638125:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f431 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53a2 expref: 31 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.638149:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f42a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e539b expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.638159:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f42a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e539b expref: 5 pid: 9642 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065135.638168:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267598080:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065135.638296:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30009 00000100:00100000:0.0:1746065135.638302:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1791:x1830881272786560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065135.638308:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.638314:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f524000/0x392ae0376f87f438 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e53a9 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.638324:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.638327:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f431 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53a2 expref: 32 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.638334:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065135.638336:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f524000/0x392ae0376f87f438 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53a9 expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.638355:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f431 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53a2 expref: 32 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.638365:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f524000/0x392ae0376f87f438 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53a9 expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.638373:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f524000, rc 0) 00000100:00100000:0.0:1746065135.638390:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:1791:x1830881272786560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 88us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.638394:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30009 00000100:00100000:1.0:1746065135.638572:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.640278:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267598080:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.640295:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f431 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53a2 expref: 31 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.640305:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0200, rc 0) 00000100:00100000:1.0:1746065135.640327:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1795:x1830881272786432:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2283us (2592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.640334:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30008 00000100:00100000:0.0:1746065135.640808:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.642491:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.643881:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.643918:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272787200 00000100:00100000:1.0:1746065135.643922:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272787200 00000100:00100000:0.0:1746065135.643929:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.643953:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30010 00000100:00100000:1.0:1746065135.643958:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272787200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.643977:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.643988:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f43f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e53b0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.644004:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.644008:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f524000/0x392ae0376f87f438 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53a9 expref: 30 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.644013:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065135.644017:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f43f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53b0 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.644037:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f524000/0x392ae0376f87f438 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53a9 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.644046:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f43f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53b0 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.644054:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0800, rc 0) 00000100:00100000:1.0:1746065135.644074:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272787200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 116us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.644096:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30010 00000100:00100000:0.0:1746065135.648358:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.651688:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.651862:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.652008:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272787584 00000100:00100000:1.0:1746065135.652016:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272787584 00000100:00100000:1.0:1746065135.652074:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30011 00000100:00100000:1.0:1746065135.652103:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:1791:x1830881272787584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.652128:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.652157:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f446 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e53b7 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.652190:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.652195:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f43f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53b0 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.652205:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065135.652208:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f446 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53b7 expref: 31 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.652278:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f43f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53b0 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.652303:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f446 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53b7 expref: 31 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.652325:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:1.0:1746065135.652377:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1791:x1830881272787584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 297us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.652383:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30011 00000100:00100000:0.0:1746065135.655260:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.660693:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.663971:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.665957:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.670651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.673654:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.674196:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272788864 00000100:00100000:1.0:1746065135.674203:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272788864 00002000:00100000:1.0:1746065135.674236:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3e680 x1830881272788864/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.674244:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3e680 with x1830881272788864 ext(0->4095) 00002000:00010000:1.0:1746065135.674249:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3e680 00000100:00100000:0.0:1746065135.674678:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.674752:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13440 00000100:00100000:1.0:1746065135.674759:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272788864:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.674848:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272788864:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 90us (1199us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.674856:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13440 00002000:00100000:1.0:1746065135.674861:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3e680 x1830881272788864/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.674868:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3e680 with x1830881272788864 ext(0->4095) 00002000:00010000:1.0:1746065135.674870:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3e680 00000100:00100000:0.0:1746065135.678481:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.682020:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.685530:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.688188:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.690658:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.693557:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.693668:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272790016 00000100:00100000:1.0:1746065135.693673:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272790016 00000100:00100000:1.0:1746065135.693698:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30015 00000100:00100000:1.0:1746065135.693703:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272790016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.693712:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.693725:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f462 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e53d3 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.693744:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f45b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53cc expref: 29 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.693750:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.693751:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.693753:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f462 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53d3 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.693774:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f45b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53cc expref: 29 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.693784:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f45b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53cc expref: 29 pid: 9642 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065135.693798:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267599872:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065135.694154:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.696027:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267599872:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.696045:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f462 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53d3 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.696056:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0800, rc 0) 00000100:00100000:1.0:1746065135.696098:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272790016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2394us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.696104:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30015 00000100:00100000:0.0:1746065135.696541:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.699782:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.699880:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272790400 00000100:00100000:1.0:1746065135.699884:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272790400 00002000:00100000:1.0:1746065135.699908:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3f800 x1830881272790400/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.699917:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3f800 with x1830881272790400 ext(0->4095) 00002000:00010000:1.0:1746065135.699921:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3f800 00000100:00100000:1.0:1746065135.699934:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13442 00000100:00100000:1.0:1746065135.699940:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272790400:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065135.700034:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272790400:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (252us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.700039:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13442 00002000:00100000:1.0:1746065135.700044:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3f800 x1830881272790400/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.700055:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3f800 with x1830881272790400 ext(0->4095) 00002000:00010000:1.0:1746065135.700057:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3f800 00000100:00100000:0.0:1746065135.702279:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.702319:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.702578:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272790528 00000100:00100000:1.0:1746065135.702584:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272790528 00000100:00100000:1.0:1746065135.702734:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272790656 00000100:00100000:1.0:1746065135.702736:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272790656 00000100:00100000:1.0:1746065135.703187:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30017 00000100:00100000:1.0:1746065135.703192:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1795:x1830881272790656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.703198:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.703204:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f470 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e53e1 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.703214:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.703217:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f469 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53da expref: 32 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.703221:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.703223:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f470 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53e1 expref: 32 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.703239:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f469 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53da expref: 32 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.703247:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f470 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53e1 expref: 32 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.703255:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0200, rc 0) 00000100:00100000:1.0:1746065135.703276:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:1795:x1830881272790656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 84us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.703281:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30017 00000100:00100000:0.0:1746065135.706760:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.710950:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.713383:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.716849:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.717330:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272791424 00000100:00100000:1.0:1746065135.717337:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272791424 00002000:00100000:1.0:1746065135.717367:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3b100 x1830881272791424/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.717376:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3b100 with x1830881272791424 ext(0->4095) 00002000:00010000:1.0:1746065135.717380:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc3b100 00000100:00100000:1.0:1746065135.717406:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13443 00000100:00100000:1.0:1746065135.717412:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2005:x1830881272791424:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.717501:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2005:x1830881272791424:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 89us (657us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.717507:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13443 00002000:00100000:1.0:1746065135.717512:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3b100 x1830881272791424/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.717519:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3b100 with x1830881272791424 ext(0->4095) 00002000:00010000:1.0:1746065135.717521:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc3b100 00000100:00100000:0.0:1746065135.720369:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.725567:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.732182:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.732626:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.737682:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.738360:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.741571:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.744650:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.748077:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.749979:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.756423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.760742:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.760827:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267601536:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065135.760842:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065135.763386:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2005:x1830881272793216:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6702us (6964us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.763395:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13993 00000100:00100000:0.0:1746065135.764129:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272793600 00000100:00100000:0.0:1746065135.764132:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272793600 00002000:00100000:0.0:1746065135.764156:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858000 x1830881272793600/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.764164:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858000 with x1830881272793600 ext(0->4095) 00010000:00010000:0.0:1746065135.764170:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f48c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53fd expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.764179:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f48c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53fd expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.764184:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093858000 00000100:00100000:0.0:1746065135.764206:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2671 00000100:00100000:0.0:1746065135.764211:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272793600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065135.764311:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272793600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 100us (251us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065135.764317:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2671 00002000:00100000:0.0:1746065135.764321:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858000 x1830881272793600/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.764328:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858000 with x1830881272793600 ext(0->4095) 00010000:00010000:0.0:1746065135.764332:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f48c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53fd expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.764340:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f48c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e53fd expref: 6 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.764345:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093858000 00000100:00100000:0.0:1746065135.773744:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272793728 00000100:00100000:0.0:1746065135.773752:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272793728 00000100:00100000:0.0:1746065135.774746:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30023 00000100:00100000:0.0:1746065135.774754:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:1795:x1830881272793728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065135.774768:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.774782:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1234600/0x392ae0376f87f49a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e540b expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.774802:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.774806:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f493 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5404 expref: 31 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.774812:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065135.774815:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1234600/0x392ae0376f87f49a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e540b expref: 31 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.774840:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f493 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5404 expref: 31 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.774849:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1234600/0x392ae0376f87f49a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e540b expref: 31 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.774862:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1234600, rc 0) 00000100:00100000:0.0:1746065135.774890:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1795:x1830881272793728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 137us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.774895:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30023 00000100:00100000:0.0:1746065135.779553:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.779582:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272794112 00000100:00100000:0.0:1746065135.779588:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272794112 00002000:00100000:0.0:1746065135.779617:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549dc00 x1830881272794112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.779625:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549dc00 with x1830881272794112 ext(0->4095) 00010000:00010000:0.0:1746065135.779631:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f493 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5404 expref: 31 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.779643:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f493 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5404 expref: 31 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.779648:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549dc00 00000100:00100000:0.0:1746065135.779663:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2672 00000100:00100000:0.0:1746065135.779668:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2005:x1830881272794112:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065135.780654:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2005:x1830881272794112:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 985us (1105us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065135.780661:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2672 00002000:00100000:0.0:1746065135.780667:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549dc00 x1830881272794112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.780679:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549dc00 with x1830881272794112 ext(0->4095) 00010000:00010000:0.0:1746065135.780684:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f493 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5404 expref: 31 pid: 9642 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065135.780693:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f87f493 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5404 expref: 31 pid: 9642 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065135.780698:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549dc00 00000100:00100000:0.0:1746065135.785417:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.789146:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.790999:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.795727:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.798607:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.798680:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272795008 00000100:00100000:1.0:1746065135.798686:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272795008 00002000:00100000:1.0:1746065135.798718:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549e680 x1830881272795008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.798727:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549e680 with x1830881272795008 ext(0->4095) 00002000:00010000:1.0:1746065135.798731:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549e680 00000100:00100000:1.0:1746065135.799457:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13446 00000100:00100000:1.0:1746065135.799464:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272795008:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065135.799566:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272795008:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 103us (965us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.799573:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13446 00002000:00100000:1.0:1746065135.799577:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549e680 x1830881272795008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.799584:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549e680 with x1830881272795008 ext(0->4095) 00002000:00010000:1.0:1746065135.799587:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549e680 00000100:00100000:0.0:1746065135.800476:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.802827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.806132:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.809232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.812063:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.814800:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.815147:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13447 00000100:00100000:1.0:1746065135.815155:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881272796032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065135.815272:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881272796032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 117us (472us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.815278:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13447 00002000:00100000:1.0:1746065135.815283:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017ad80 x1830881272796032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.815289:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017ad80 with x1830881272796032 ext(0->4095) 00002000:00010000:1.0:1746065135.815292:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017ad80 00000100:00100000:0.0:1746065135.816590:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.818301:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.822190:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272796544 00000100:00100000:1.0:1746065135.822196:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272796544 00002000:00100000:1.0:1746065135.822225:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385b100 x1830881272796544/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.822234:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b100 with x1830881272796544 ext(0->4095) 00002000:00010000:1.0:1746065135.822238:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009385b100 00000100:00100000:1.0:1746065135.822252:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13448 00000100:00100000:1.0:1746065135.822257:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272796544:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.822345:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272796544:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 87us (202us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.822350:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13448 00002000:00100000:1.0:1746065135.822355:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385b100 x1830881272796544/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.822361:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b100 with x1830881272796544 ext(0->4095) 00002000:00010000:1.0:1746065135.822364:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009385b100 00000100:00100000:0.0:1746065135.825310:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272796672 00000100:00100000:0.0:1746065135.825316:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272796672 00000100:00100000:0.0:1746065135.825346:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30028 00000100:00100000:0.0:1746065135.825352:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:1795:x1830881272796672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065135.825364:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.825379:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1234600/0x392ae0376f87f4bd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e542e expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.825400:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f4b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5427 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.825406:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.825408:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.825410:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1234600/0x392ae0376f87f4bd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e542e expref: 30 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.825433:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f4b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5427 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.825442:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f4b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5427 expref: 5 pid: 9642 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065135.825452:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130178a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267603200:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065135.825518:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.828196:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.828597:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130178a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267603200:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065135.828612:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1234600/0x392ae0376f87f4bd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e542e expref: 31 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.828619:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1234600, rc 0) 00000100:00100000:1.0:1746065135.828818:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1795:x1830881272796672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3466us (3637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.828824:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30028 00000100:00100000:1.0:1746065135.829809:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.834047:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.837109:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.837710:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.840424:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.840843:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272797696 00000100:00100000:1.0:1746065135.840848:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272797696 00002000:00100000:1.0:1746065135.840876:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130179c00 x1830881272797696/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.840883:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130179c00 with x1830881272797696 ext(0->4095) 00010000:00010000:1.0:1746065135.840890:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f4c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5435 expref: 31 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.840899:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f4c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5435 expref: 31 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.840904:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130179c00 00000100:00100000:1.0:1746065135.841332:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2675 00000100:00100000:1.0:1746065135.841339:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2005:x1830881272797696:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.841441:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2005:x1830881272797696:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 102us (1020us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.841446:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2675 00002000:00100000:1.0:1746065135.841451:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130179c00 x1830881272797696/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.841457:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130179c00 with x1830881272797696 ext(0->4095) 00010000:00010000:1.0:1746065135.841461:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f4c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5435 expref: 30 pid: 9560 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065135.841469:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f4c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5435 expref: 30 pid: 9560 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065135.841474:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130179c00 00000100:00100000:0.0:1746065135.843103:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.844547:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.847918:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.854678:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.857991:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.863383:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.864336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.867633:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.871278:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.876067:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.879487:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.882218:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.883359:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2005:x1830881272799872:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 834us (1139us total) trans 4294972078 rc 0/0 00000100:00100000:0.0:1746065135.883364:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2678 00002000:00100000:0.0:1746065135.883370:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f7c2300 x1830881272799872/t4294972078(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 496/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.883376:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2300 with x1830881272799872 ext(0->7) 00010000:00010000:0.0:1746065135.883380:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87f4e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5451 expref: 32 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065135.883388:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87f4e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5451 expref: 32 pid: 9635 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065135.883393:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c2300 00000100:00100000:0.0:1746065135.888293:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.896633:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.896660:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.897247:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272800256 00000100:00100000:1.0:1746065135.897252:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272800256 00002000:00100000:1.0:1746065135.897281:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c1880 x1830881272800256/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.897295:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1880 with x1830881272800256 ext(0->4095) 00002000:00010000:1.0:1746065135.897298:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c1880 00000100:00100000:1.0:1746065135.897317:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13451 00000100:00100000:1.0:1746065135.897323:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272800256:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.897422:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272800256:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 99us (795us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.897428:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13451 00002000:00100000:1.0:1746065135.897432:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c1880 x1830881272800256/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.897439:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1880 with x1830881272800256 ext(0->4095) 00002000:00010000:1.0:1746065135.897441:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c1880 00000100:00100000:0.0:1746065135.906257:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.913343:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.915163:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.915185:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272800896 00000100:00100000:0.0:1746065135.915190:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272800896 00002000:00100000:0.0:1746065135.915217:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c2680 x1830881272800896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.915226:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2680 with x1830881272800896 ext(0->4095) 00010000:00010000:0.0:1746065135.915232:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f4ee lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e545f expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065135.915241:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f4ee lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e545f expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065135.915247:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c2680 00000100:00100000:0.0:1746065135.915259:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2679 00000100:00100000:0.0:1746065135.915264:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881272800896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065135.915349:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881272800896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 84us (189us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065135.915355:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2679 00002000:00100000:0.0:1746065135.915359:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c2680 x1830881272800896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065135.915365:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2680 with x1830881272800896 ext(0->4095) 00010000:00010000:0.0:1746065135.915370:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f4ee lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e545f expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065135.915377:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f4ee lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e545f expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065135.915383:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c2680 00000100:00100000:0.0:1746065135.916778:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.916794:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272801024 00000100:00100000:0.0:1746065135.916797:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272801024 00010000:00010000:0.0:1746065135.916813:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f4ee lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e545f expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065135.918077:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14008 00000100:00100000:0.0:1746065135.918099:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881272801024:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065135.918112:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065135.918129:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f4ee lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e545f expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065135.918139:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f4ee lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e545f expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065135.918156:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.918158:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.918163:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f4f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5466 expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.918170:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f4f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5466 expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.918196:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f4f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5466 expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.918205:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f7c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267605376:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065135.920947:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.920970:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267605376:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065135.920980:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065135.920998:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881272801024:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2902us (4222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.921003:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14008 00000100:00100000:0.0:1746065135.921644:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.924563:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.927683:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.927734:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272801536 00000100:00100000:1.0:1746065135.927739:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272801536 00010000:00010000:1.0:1746065135.927760:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f4f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5466 expref: 32 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065135.927794:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14009 00000100:00100000:1.0:1746065135.927800:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2005:x1830881272801536:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.927810:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.927827:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f4f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5466 expref: 32 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.927837:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f4f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5466 expref: 32 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.927854:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f4f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5466 expref: 32 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.927985:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.927987:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.927993:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f4fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e546d expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.928000:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f4fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e546d expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.928022:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f4fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e546d expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.928030:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267605632:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065135.928316:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.929999:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267605632:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065135.930012:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.930053:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2005:x1830881272801536:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2252us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.930060:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14009 00000100:00100000:0.0:1746065135.930710:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.932840:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.932895:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.933309:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30039 00000100:00100000:1.0:1746065135.933314:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1795:x1830881272802048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.933320:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.933326:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f50a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e547b expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.933334:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.933338:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f503 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5474 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.933342:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.933345:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f50a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e547b expref: 34 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.933360:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f503 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5474 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.933368:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f50a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e547b expref: 34 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.933376:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0800, rc 0) 00000100:00100000:1.0:1746065135.933391:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1795:x1830881272802048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 77us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.933395:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30039 00000100:00100000:0.0:1746065135.934959:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.935146:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272802176 00000100:00100000:1.0:1746065135.935150:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272802176 00010000:00010000:1.0:1746065135.935167:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f4fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e546d expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065135.935491:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14010 00000100:00100000:1.0:1746065135.935497:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272802176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.935505:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.935518:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f4fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e546d expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.935526:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f4fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e546d expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.935540:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f4fc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e546d expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.935560:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.935561:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.935567:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5474 expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.935574:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f503 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5474 expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.935591:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f503 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5474 expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.935599:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f503 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5474 expref: 32 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065135.935607:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267606016:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065135.935648:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.937698:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.937903:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267606016:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065135.937916:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.937944:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272802176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2447us (2986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.937952:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14010 00000100:00100000:0.0:1746065135.941064:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.941217:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272802560 00000100:00100000:1.0:1746065135.941224:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272802560 00010000:00010000:1.0:1746065135.941245:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f503 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5474 expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065135.941783:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14011 00000100:00100000:1.0:1746065135.941791:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881272802560:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.941803:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.941821:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f503 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5474 expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.941833:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f503 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5474 expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.941852:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f503 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5474 expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.941865:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.941867:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.941872:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f50a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e547b expref: 32 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.941878:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f50a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e547b expref: 32 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.941903:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f50a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e547b expref: 32 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.941913:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267606144:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065135.942001:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.943635:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267606144:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065135.943649:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.943677:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881272802560:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1886us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.943685:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14011 00000100:00100000:0.0:1746065135.944522:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.947287:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.950062:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.950312:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272803072 00000100:00100000:1.0:1746065135.950318:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272803072 00010000:00010000:1.0:1746065135.950340:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f50a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e547b expref: 32 pid: 9642 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065135.950368:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14012 00000100:00100000:1.0:1746065135.950374:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881272803072:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.950383:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.950399:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f50a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e547b expref: 32 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.950409:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f50a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e547b expref: 32 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.950426:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f50a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e547b expref: 32 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.950445:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.950447:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.950453:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f511 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5482 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.950460:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5482 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.950483:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5482 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.950492:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267606400:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065135.951116:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.952491:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.952567:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267606400:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065135.952579:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.952605:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881272803072:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2231us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.952613:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14012 00000100:00100000:0.0:1746065135.954858:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.954893:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.955026:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30041 00000100:00100000:1.0:1746065135.955032:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:1791:x1830881272803456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.955044:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.955058:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5489 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.955169:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.955173:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f51f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5490 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.955181:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.955184:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5489 expref: 34 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.955222:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f51f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5490 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.955230:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5489 expref: 34 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.955237:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:1.0:1746065135.955266:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1791:x1830881272803456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 235us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.955272:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30041 00000100:00100000:0.0:1746065135.956531:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.956579:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272803712 00000100:00100000:1.0:1746065135.956583:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272803712 00010000:00010000:1.0:1746065135.956598:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5482 expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065135.956624:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14013 00000100:00100000:1.0:1746065135.956629:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272803712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.956638:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.956652:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5482 expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.956661:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5482 expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.956676:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f511 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5482 expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.956686:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.956687:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.956693:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f51f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5490 expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.956699:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f51f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5490 expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.956717:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f51f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5490 expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.956726:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f51f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5490 expref: 32 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065135.956733:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267606784:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065135.956773:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.957848:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267606784:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065135.957858:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.957927:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272803712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1296us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.957933:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14013 00000100:00100000:0.0:1746065135.958222:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.959805:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.959852:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.960068:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272804096 00000100:00100000:1.0:1746065135.960071:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272804096 00010000:00010000:1.0:1746065135.960100:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f51f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5490 expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065135.960127:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14014 00000100:00100000:1.0:1746065135.960132:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2003:x1830881272804096:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.960139:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.960195:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f51f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5490 expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.960204:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f51f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5490 expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.960218:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f51f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5490 expref: 33 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.960237:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.960238:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.960243:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5489 expref: 32 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.960249:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5489 expref: 32 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.960268:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5489 expref: 32 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.960277:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5489 expref: 32 pid: 21550 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065135.960390:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267607040:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065135.960448:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.961499:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267607040:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065135.961510:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.961531:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2003:x1830881272804096:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1397us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.961537:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14014 00000100:00100000:0.0:1746065135.961982:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.963815:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.963859:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.963902:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272804736 00000100:00100000:1.0:1746065135.963907:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272804736 00010000:00010000:1.0:1746065135.963925:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5489 expref: 32 pid: 21550 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065135.963955:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14015 00000100:00100000:1.0:1746065135.963971:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881272804736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.963981:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.963995:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5489 expref: 32 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.964004:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5489 expref: 32 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.964021:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f518 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5489 expref: 32 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.964035:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.964037:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.964044:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f526 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5497 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.964050:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f526 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5497 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.964072:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f526 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5497 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.964101:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267607168:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065135.964148:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.966281:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267607168:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065135.966294:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065135.966301:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.966318:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881272804736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2357us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.966326:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14015 00000100:00100000:1.0:1746065135.969285:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.972046:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.974520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.976421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.978238:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.981885:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.983195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.983211:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272806144 00000100:00100000:1.0:1746065135.983215:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272806144 00000100:00100000:1.0:1746065135.983390:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30047 00000100:00100000:1.0:1746065135.983396:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1791:x1830881272806144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065135.983402:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.983408:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f542 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e54b3 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.983419:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.983423:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f87f53b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54ac expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.983428:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.983430:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f542 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54b3 expref: 34 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.983447:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f87f53b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54ac expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.983454:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f542 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54b3 expref: 34 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.983461:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0200, rc 0) 00000100:00100000:1.0:1746065135.983490:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1791:x1830881272806144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 94us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.983495:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30047 00000100:00100000:0.0:1746065135.986459:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.989894:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.992456:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.994124:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065135.996339:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065135.996556:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272807040 00000100:00100000:1.0:1746065135.996561:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272807040 00002000:00100000:1.0:1746065135.996587:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78a680 x1830881272807040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.996595:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a680 with x1830881272807040 ext(0->4095) 00010000:00010000:1.0:1746065135.996600:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54b3 expref: 32 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.996610:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54b3 expref: 32 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065135.996619:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78a680 00000100:00100000:1.0:1746065135.997147:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2685 00000100:00100000:1.0:1746065135.997154:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2005:x1830881272807040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065135.997242:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2005:x1830881272807040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 88us (906us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.997246:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2685 00002000:00100000:1.0:1746065135.997251:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78a680 x1830881272807040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065135.997256:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a680 with x1830881272807040 ext(0->4095) 00010000:00010000:1.0:1746065135.997261:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54b3 expref: 32 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065135.997269:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54b3 expref: 32 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065135.997274:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78a680 00000100:00100000:0.0:1746065135.999266:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.000400:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00080000:1.0:1746065136.000925:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065136.004981:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272807552 00000100:00100000:0.0:1746065136.004987:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272807552 00002000:00100000:0.0:1746065136.005022:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385aa00 x1830881272807552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.005031:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385aa00 with x1830881272807552 ext(0->4095) 00010000:00010000:0.0:1746065136.005038:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f87f549 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54ba expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.005050:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f87f549 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54ba expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.005056:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385aa00 00000100:00100000:0.0:1746065136.005070:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2686 00000100:00100000:0.0:1746065136.005076:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272807552:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746065136.005186:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272807552:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 111us (462us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065136.005192:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2686 00002000:00100000:0.0:1746065136.005196:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385aa00 x1830881272807552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.005203:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385aa00 with x1830881272807552 ext(0->4095) 00010000:00010000:0.0:1746065136.005207:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f87f549 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54ba expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.005216:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f87f549 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54ba expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.005221:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385aa00 00000100:00100000:0.0:1746065136.007813:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.011651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.014445:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.017614:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.020579:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.020649:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.020855:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272808448 00000100:00100000:1.0:1746065136.020860:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272808448 00002000:00100000:1.0:1746065136.020888:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78b480 x1830881272808448/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.020897:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b480 with x1830881272808448 ext(0->4095) 00002000:00010000:1.0:1746065136.020901:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78b480 00000100:00100000:1.0:1746065136.020918:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13459 00000100:00100000:1.0:1746065136.020923:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272808448:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.021024:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272808448:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 101us (449us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.021029:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13459 00002000:00100000:1.0:1746065136.021033:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78b480 x1830881272808448/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.021039:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b480 with x1830881272808448 ext(0->4095) 00002000:00010000:1.0:1746065136.021041:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78b480 00000100:00100000:0.0:1746065136.025167:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.025805:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.029919:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.032948:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.036373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.038340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.041532:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.045135:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.047887:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.048578:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.048897:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272810240 00000100:00100000:0.0:1746065136.048900:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272810240 00000100:00100000:0.0:1746065136.048995:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30055 00000100:00100000:0.0:1746065136.049001:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1795:x1830881272810240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065136.049007:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.049013:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b21a00/0x392ae0376f87f57a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e54eb expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.049024:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.049027:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f573 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54e4 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.049031:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.049033:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b21a00/0x392ae0376f87f57a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54eb expref: 34 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.049051:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f573 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54e4 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.049062:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072b21a00/0x392ae0376f87f57a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54eb expref: 34 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.049070:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b21a00, rc 0) 00000100:00100000:0.0:1746065136.049106:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1795:x1830881272810240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 104us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.049111:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30055 00000100:00100000:0.0:1746065136.051213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.053771:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.057001:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.059431:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.062319:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.065777:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.068590:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.070677:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.070716:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.070885:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30057 00000100:00100000:1.0:1746065136.070893:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1791:x1830881272811648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.070905:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.070919:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f588 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e54f9 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.071103:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f581 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54f2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.071110:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.071112:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.071115:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f588 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54f9 expref: 34 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.071480:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f581 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54f2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.071496:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f581 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54f2 expref: 5 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.071507:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267610752:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.071913:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.073791:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267610752:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.073810:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f588 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e54f9 expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.073821:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0200, rc 0) 00000100:00100000:1.0:1746065136.073848:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1791:x1830881272811648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2956us (3217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.073854:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30057 00000100:00100000:0.0:1746065136.074023:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.077427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.079416:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.082408:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.085641:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.085857:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272812672 00000100:00100000:1.0:1746065136.085864:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272812672 00000100:00100000:1.0:1746065136.085908:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30059 00000100:00100000:1.0:1746065136.085914:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272812672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.085926:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.085939:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f596 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5507 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.085971:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f58f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5500 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.085980:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.085982:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.085985:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f596 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5507 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.086008:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f58f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5500 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.086018:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f58f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5500 expref: 31 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.086028:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267611136:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.086107:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.087497:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267611136:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.087514:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f596 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5507 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.087524:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:1.0:1746065136.087549:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272812672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1635us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.087555:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30059 00000100:00100000:0.0:1746065136.088637:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.091350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.092894:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.092987:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272813184 00000100:00100000:1.0:1746065136.092991:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272813184 00000100:00100000:1.0:1746065136.093018:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30060 00000100:00100000:1.0:1746065136.093022:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1791:x1830881272813184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.093032:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.093043:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f59d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e550e expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.093061:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f596 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5507 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.093067:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.093068:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.093071:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f59d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e550e expref: 32 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.093113:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f596 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5507 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.093123:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f596 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5507 expref: 5 pid: 21550 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.093131:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267611392:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.093179:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.095558:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.096904:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267611392:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.096919:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f59d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e550e expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.096928:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1600, rc 0) 00000100:00100000:1.0:1746065136.096947:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1791:x1830881272813184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3925us (4054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.096956:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30060 00000100:00100000:0.0:1746065136.097434:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.100732:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.105155:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.109130:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.112410:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.112536:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272814208 00000100:00100000:1.0:1746065136.112542:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272814208 00000100:00100000:1.0:1746065136.112737:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30062 00000100:00100000:1.0:1746065136.112744:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272814208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.112757:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.112862:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f5ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e551c expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.112887:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5515 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.112893:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.112895:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.112898:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f5ab lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e551c expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.112922:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f5a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5515 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.112933:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f5a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5515 expref: 31 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.112943:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267611904:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.113427:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.119071:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267611904:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.119122:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f5ab lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e551c expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.119137:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0200, rc 0) 00000100:00100000:1.0:1746065136.119434:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272814208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6689us (7026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.119442:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30062 00000100:00100000:0.0:1746065136.127986:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.128032:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.129067:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272814464 00000100:00100000:1.0:1746065136.129072:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272814464 00000100:00100000:1.0:1746065136.129136:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30063 00000100:00100000:1.0:1746065136.129142:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:1791:x1830881272814464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.129153:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.129163:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1000/0x392ae0376f87f5b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5523 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.129751:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f5ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e551c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.129762:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.129763:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.129766:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1000/0x392ae0376f87f5b2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5523 expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.129784:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f5ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e551c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.129799:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f5ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e551c expref: 5 pid: 21550 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.129809:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267612160:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.130312:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.130921:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.131016:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272814720 00000100:00100000:1.0:1746065136.131021:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272814720 00002000:00100000:1.0:1746065136.131042:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f2300 x1830881272814720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.131050:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2300 with x1830881272814720 ext(0->4095) 00010000:00010000:1.0:1746065136.131056:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f5ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e551c expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.131066:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f5ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e551c expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.131071:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f2300 00000100:00100000:1.0:1746065136.131108:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2691 00000100:00100000:1.0:1746065136.131115:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272814720:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.131240:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272814720:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 125us (318us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.131246:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2691 00002000:00100000:1.0:1746065136.131251:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f2300 x1830881272814720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.131258:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2300 with x1830881272814720 ext(0->4095) 00010000:00010000:1.0:1746065136.131316:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f5ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e551c expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.131325:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f5ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e551c expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.131331:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f2300 00000100:00100000:1.0:1746065136.135237:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267612160:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.135264:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1000/0x392ae0376f87f5b2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5523 expref: 32 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.135278:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1000, rc 0) 00000100:00100000:1.0:1746065136.135568:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:1791:x1830881272814464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6424us (7533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.135576:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30063 00000100:00100000:0.0:1746065136.136862:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.136925:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272814848 00000100:00100000:1.0:1746065136.136931:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272814848 00000100:00100000:0.0:1746065136.138861:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.142064:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.142743:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272815232 00000100:00100000:1.0:1746065136.142749:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272815232 00002000:00100000:1.0:1746065136.142782:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3b80 x1830881272815232/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.142791:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3b80 with x1830881272815232 ext(0->4095) 00010000:00010000:1.0:1746065136.142799:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1000/0x392ae0376f87f5b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5523 expref: 33 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.142811:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1000/0x392ae0376f87f5b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5523 expref: 33 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.142821:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3b80 00000100:00100000:1.0:1746065136.142845:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2692 00000100:00100000:1.0:1746065136.142851:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881272815232:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.142973:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881272815232:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 122us (911us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.142978:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2692 00002000:00100000:1.0:1746065136.142983:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3b80 x1830881272815232/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.142990:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3b80 with x1830881272815232 ext(0->4095) 00010000:00010000:1.0:1746065136.142994:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1000/0x392ae0376f87f5b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5523 expref: 33 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.143003:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1000/0x392ae0376f87f5b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5523 expref: 33 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.143007:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3b80 00000100:00100000:0.0:1746065136.144903:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.147509:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267612544:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065136.147523:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.147550:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2002:x1830881272815360:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2361us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.147557:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14036 00000100:00100000:1.0:1746065136.150807:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272815744 00000100:00100000:1.0:1746065136.150813:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272815744 00000100:00100000:1.0:1746065136.150853:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30065 00000100:00100000:1.0:1746065136.150858:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272815744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.150870:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.150884:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1234800/0x392ae0376f87f5c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5531 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.150909:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e552a expref: 31 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.150915:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.150916:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.150919:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1234800/0x392ae0376f87f5c0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5531 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.150940:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e552a expref: 31 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.150950:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e552a expref: 31 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.150969:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267612672:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.151038:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.153050:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.153125:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267612672:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.153143:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1234800/0x392ae0376f87f5c0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5531 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.153154:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1234800, rc 0) 00000100:00100000:1.0:1746065136.153179:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272815744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2321us (2463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.153184:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30065 00000100:00100000:0.0:1746065136.155973:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.156190:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272816128 00000100:00100000:1.0:1746065136.156196:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272816128 00002000:00100000:1.0:1746065136.156226:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1c380 x1830881272816128/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.156233:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1c380 with x1830881272816128 ext(0->4095) 00002000:00010000:1.0:1746065136.156237:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1c380 00000100:00100000:1.0:1746065136.156253:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13468 00000100:00100000:1.0:1746065136.156259:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272816128:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.156831:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272816128:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 571us (870us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.156837:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13468 00002000:00100000:1.0:1746065136.156842:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1c380 x1830881272816128/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.156848:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1c380 with x1830881272816128 ext(0->4095) 00002000:00010000:1.0:1746065136.156851:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1c380 00000100:00100000:0.0:1746065136.159799:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.160182:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272816256 00000100:00100000:1.0:1746065136.160191:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272816256 00000100:00100000:1.0:1746065136.160456:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30066 00000100:00100000:1.0:1746065136.160463:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1791:x1830881272816256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.160478:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.160493:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5538 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.160515:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1234800/0x392ae0376f87f5c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5531 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.160525:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.160526:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.160529:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5c7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5538 expref: 32 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.160553:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1234800/0x392ae0376f87f5c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5531 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.160563:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1234800/0x392ae0376f87f5c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5531 expref: 5 pid: 21550 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.160573:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267612928:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.161270:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.162648:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.164364:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267612928:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.164378:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5c7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5538 expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.164386:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1800, rc 0) 00000100:00100000:1.0:1746065136.164415:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1791:x1830881272816256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3952us (4622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.164420:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30066 00000100:00100000:0.0:1746065136.165805:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.170585:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272816768 00000100:00100000:1.0:1746065136.170591:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272816768 00002000:00100000:1.0:1746065136.170624:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e889180 x1830881272816768/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.170639:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889180 with x1830881272816768 ext(0->4095) 00010000:00010000:1.0:1746065136.170646:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5538 expref: 33 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.170659:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5538 expref: 33 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.170665:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e889180 00000100:00100000:1.0:1746065136.170691:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2693 00000100:00100000:1.0:1746065136.170697:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881272816768:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.170798:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881272816768:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 101us (281us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.170804:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2693 00002000:00100000:1.0:1746065136.170809:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e889180 x1830881272816768/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.170816:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889180 with x1830881272816768 ext(0->4095) 00010000:00010000:1.0:1746065136.170820:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5538 expref: 33 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.170828:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5538 expref: 33 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.170833:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e889180 00000100:00100000:0.0:1746065136.175474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.181401:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267613312:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065136.181416:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.181461:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881272816896:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5741us (5995us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.181475:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14039 00000100:00100000:0.0:1746065136.186811:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.186870:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272817280 00000100:00100000:1.0:1746065136.186876:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272817280 00000100:00100000:1.0:1746065136.186912:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30068 00000100:00100000:1.0:1746065136.186921:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272817280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.186935:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.186950:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5546 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.186982:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f5ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e553f expref: 31 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.186989:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.186990:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.186993:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5d5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5546 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.187013:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f5ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e553f expref: 31 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.187021:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e553f expref: 31 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.187032:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267613440:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.188366:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.189680:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267613440:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065136.189681:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065136.189702:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5d5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5546 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.189714:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1800, rc 0) 00000100:00100000:1.0:1746065136.189743:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272817280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2826us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.189750:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30068 00000100:00100000:1.0:1746065136.189768:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272817664 00000100:00100000:1.0:1746065136.189772:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272817664 00000100:00100000:0.0:1746065136.189968:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.190017:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272817536 00000100:00100000:0.0:1746065136.190020:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272817536 00002000:00100000:0.0:1746065136.190039:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009eb1df80 x1830881272817536/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.190047:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1df80 with x1830881272817536 ext(0->7) 00010000:00010000:0.0:1746065136.190052:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e553f expref: 33 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.190062:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e553f expref: 33 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.190067:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1df80 00000100:00100000:0.0:1746065136.190078:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2694 00000100:00100000:0.0:1746065136.190098:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881272817536:12345-192.168.202.8@tcp:4:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.191520:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30069 00000100:00100000:1.0:1746065136.191528:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1791:x1830881272817664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.191536:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.191546:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1000/0x392ae0376f87f5dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e554d expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.191561:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.191566:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5546 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.191571:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065136.191573:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1000/0x392ae0376f87f5dc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e554d expref: 36 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.191595:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5d5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5546 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.191605:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1000/0x392ae0376f87f5dc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e554d expref: 36 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.191612:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1000, rc 0) 00000100:00100000:1.0:1746065136.191637:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:1791:x1830881272817664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 111us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.191645:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30069 00000100:00100000:0.0:1746065136.191788:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2005:x1830881272817536:12345-192.168.202.8@tcp:4:ptlrpcd_01_01.0 Request processed in 1689us (1830us total) trans 4294972079 rc 0/0 00000100:00100000:0.0:1746065136.191794:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2694 00002000:00100000:0.0:1746065136.191801:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009eb1df80 x1830881272817536/t4294972079(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.191808:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1df80 with x1830881272817536 ext(0->7) 00010000:00010000:0.0:1746065136.191813:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e553f expref: 35 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.191821:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e553f expref: 35 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.191827:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1df80 00000100:00100000:0.0:1746065136.193262:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.195507:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.195891:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272818048 00000100:00100000:1.0:1746065136.195896:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272818048 00002000:00100000:1.0:1746065136.195923:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1d880 x1830881272818048/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.195932:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1d880 with x1830881272818048 ext(0->4095) 00010000:00010000:1.0:1746065136.195938:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5546 expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.195948:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5546 expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.195952:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1d880 00000100:00100000:1.0:1746065136.195981:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2695 00000100:00100000:1.0:1746065136.195988:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272818048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.196103:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272818048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 116us (598us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.196109:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2695 00002000:00100000:1.0:1746065136.196114:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1d880 x1830881272818048/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.196121:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1d880 with x1830881272818048 ext(0->4095) 00010000:00010000:1.0:1746065136.196125:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5546 expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.196138:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f5d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5546 expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.196143:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1d880 00000100:00100000:0.0:1746065136.201587:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.204759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.206683:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.210183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.213471:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.216247:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.216670:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.216997:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30072 00000100:00100000:0.0:1746065136.217002:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1795:x1830881272819200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065136.217008:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.217020:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b21800/0x392ae0376f87f5f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5562 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.217055:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.217057:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f5ea lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e555b expref: 36 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.217061:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.217064:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b21800/0x392ae0376f87f5f1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5562 expref: 36 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.217390:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f5ea lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e555b expref: 36 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.217407:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072b21800/0x392ae0376f87f5f1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5562 expref: 36 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.217415:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b21800, rc 0) 00000100:00100000:0.0:1746065136.217822:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:1795:x1830881272819200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 817us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.217828:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30072 00000100:00100000:0.0:1746065136.220730:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.224031:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.224268:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272819584 00000100:00100000:1.0:1746065136.224273:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272819584 00002000:00100000:1.0:1746065136.224302:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1e300 x1830881272819584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.224311:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1e300 with x1830881272819584 ext(0->4095) 00010000:00010000:1.0:1746065136.224317:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f5ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e555b expref: 35 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.224329:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f5ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e555b expref: 35 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.224335:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1e300 00000100:00100000:1.0:1746065136.224595:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2696 00000100:00100000:1.0:1746065136.224603:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881272819584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.224791:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881272819584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 188us (759us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.224796:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2696 00002000:00100000:1.0:1746065136.224802:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1e300 x1830881272819584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.224809:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1e300 with x1830881272819584 ext(0->4095) 00010000:00010000:1.0:1746065136.224814:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f5ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e555b expref: 35 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.224823:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f5ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e555b expref: 35 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.224828:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1e300 00000100:00100000:0.0:1746065136.226801:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.230767:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.230889:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272819968 00000100:00100000:1.0:1746065136.230894:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272819968 00002000:00100000:1.0:1746065136.230920:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f480 x1830881272819968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.230929:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f480 with x1830881272819968 ext(0->4095) 00002000:00010000:1.0:1746065136.230932:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1f480 00000100:00100000:1.0:1746065136.230953:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13472 00000100:00100000:1.0:1746065136.230966:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881272819968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.231050:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881272819968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 91us (289us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.231055:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13472 00002000:00100000:1.0:1746065136.231059:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f480 x1830881272819968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.231065:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f480 with x1830881272819968 ext(0->4095) 00002000:00010000:1.0:1746065136.231068:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1f480 00000100:00100000:0.0:1746065136.232924:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.236412:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.240720:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.242469:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.246193:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.249527:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.249717:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272820992 00000100:00100000:1.0:1746065136.249723:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272820992 00002000:00100000:1.0:1746065136.249749:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130778000 x1830881272820992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.249763:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130778000 with x1830881272820992 ext(0->4095) 00002000:00010000:1.0:1746065136.249766:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130778000 00000100:00100000:1.0:1746065136.249931:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13474 00000100:00100000:1.0:1746065136.249937:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881272820992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.250035:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881272820992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (513us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.250040:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13474 00002000:00100000:1.0:1746065136.250044:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130778000 x1830881272820992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.250050:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130778000 with x1830881272820992 ext(0->4095) 00002000:00010000:1.0:1746065136.250053:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130778000 00000100:00100000:0.0:1746065136.261347:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.280949:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.291915:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.294445:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.303756:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.313895:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.319387:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267615616:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065136.319409:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.320325:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272821888:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6200us (6435us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.320332:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14048 00000100:00100000:0.0:1746065136.322817:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272822272 00000100:00100000:0.0:1746065136.322825:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272822272 00000100:00100000:0.0:1746065136.322898:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30077 00000100:00100000:0.0:1746065136.322905:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272822272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065136.322930:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.322955:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b21e00/0x392ae0376f87f614 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5585 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.322990:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e557e expref: 35 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.323006:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.323008:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.323011:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b21e00/0x392ae0376f87f614 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5585 expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.323048:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e557e expref: 35 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.323075:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f60d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e557e expref: 35 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065136.323135:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267615744:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065136.323228:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.332518:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.338163:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881272822400:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1843us (5648us total) trans 4294972081 rc 0/0 00000100:00100000:0.0:1746065136.338172:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2699 00002000:00100000:0.0:1746065136.338178:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880130779c00 x1830881272822400/t4294972081(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.338186:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779c00 with x1830881272822400 ext(0->7) 00010000:00010000:0.0:1746065136.338193:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f60d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e557e expref: 38 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.338205:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f60d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e557e expref: 38 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.338215:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130779c00 00000100:00100000:0.0:1746065136.342261:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.347681:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.358004:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.358104:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272822912 00000100:00100000:1.0:1746065136.358112:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272822912 00002000:00100000:1.0:1746065136.358147:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b800 x1830881272822912/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.358157:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b800 with x1830881272822912 ext(0->4095) 00010000:00010000:1.0:1746065136.358165:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b21e00/0x392ae0376f87f614 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5585 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.358178:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b21e00/0x392ae0376f87f614 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5585 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.358188:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077b800 00000100:00100000:1.0:1746065136.358205:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2700 00000100:00100000:1.0:1746065136.358212:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272822912:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.358321:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272822912:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 109us (324us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.358327:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2700 00002000:00100000:1.0:1746065136.358332:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b800 x1830881272822912/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.358338:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b800 with x1830881272822912 ext(0->4095) 00010000:00010000:1.0:1746065136.358342:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b21e00/0x392ae0376f87f614 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5585 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.358351:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b21e00/0x392ae0376f87f614 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5585 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.358355:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077b800 00000100:00100000:0.0:1746065136.364033:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.367783:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267616128:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065136.367801:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.367844:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272823040:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3674us (3816us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.367853:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14050 00000100:00100000:0.0:1746065136.371874:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.375773:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.381496:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.387225:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.388634:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.393275:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.393364:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.393447:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272824064 00000100:00100000:1.0:1746065136.393453:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272824064 00000100:00100000:1.0:1746065136.393487:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30081 00000100:00100000:1.0:1746065136.393493:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881272824064:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.393505:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.393517:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f630 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e55a1 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.393540:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.393544:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f629 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e559a expref: 39 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.393549:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.393552:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f630 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55a1 expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.393575:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f629 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e559a expref: 39 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.393584:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f630 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55a1 expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.393590:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0800, rc 0) 00000100:00100000:1.0:1746065136.393851:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881272824064:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 358us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.393857:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30081 00000100:00100000:0.0:1746065136.395793:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.397449:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.403189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.403274:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272824832 00000100:00100000:1.0:1746065136.403282:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272824832 00002000:00100000:1.0:1746065136.403315:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e0380 x1830881272824832/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.403325:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0380 with x1830881272824832 ext(0->4095) 00002000:00010000:1.0:1746065136.403328:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e0380 00000100:00100000:1.0:1746065136.403559:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13478 00000100:00100000:1.0:1746065136.403567:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2003:x1830881272824832:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065136.403686:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2003:x1830881272824832:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 118us (503us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.403692:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13478 00002000:00100000:1.0:1746065136.403697:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e0380 x1830881272824832/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.403703:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0380 with x1830881272824832 ext(0->4095) 00002000:00010000:1.0:1746065136.403706:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e0380 00000100:00100000:0.0:1746065136.406529:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.412199:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.414119:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.415098:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.420857:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.426600:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.435148:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.441412:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.442944:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272826112 00000100:00100000:1.0:1746065136.442967:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272826112 00002000:00100000:1.0:1746065136.443037:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d1e2d80 x1830881272826112/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.443062:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2d80 with x1830881272826112 ext(0->7) 00010000:00010000:1.0:1746065136.443109:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55af expref: 38 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.443134:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55af expref: 38 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.443141:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e2d80 00000100:00100000:1.0:1746065136.443937:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2703 00000100:00100000:1.0:1746065136.443946:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881272826112:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065136.445717:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2004:x1830881272826112:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1768us (4306us total) trans 4294972082 rc 0/0 00000100:00100000:0.0:1746065136.445749:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2703 00002000:00100000:0.0:1746065136.445783:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d1e2d80 x1830881272826112/t4294972082(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.445791:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2d80 with x1830881272826112 ext(0->7) 00010000:00010000:0.0:1746065136.445821:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55af expref: 40 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.445884:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55af expref: 40 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.445891:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e2d80 00000100:00100000:0.0:1746065136.452575:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.455437:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.459130:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.459814:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272826624 00000100:00100000:1.0:1746065136.459820:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272826624 00002000:00100000:1.0:1746065136.459851:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f980e00 x1830881272826624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.459867:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980e00 with x1830881272826624 ext(0->4095) 00010000:00010000:1.0:1746065136.459873:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55b6 expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.459885:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55b6 expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.459891:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f980e00 00000100:00100000:1.0:1746065136.459916:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2704 00000100:00100000:1.0:1746065136.459923:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272826624:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.460043:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272826624:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 120us (925us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.460048:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2704 00002000:00100000:1.0:1746065136.460053:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f980e00 x1830881272826624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.460059:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980e00 with x1830881272826624 ext(0->4095) 00010000:00010000:1.0:1746065136.460063:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55b6 expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.460071:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55b6 expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.460076:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f980e00 00000100:00100000:0.0:1746065136.464216:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.467413:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.471643:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.476570:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.478130:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.480467:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.485882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.489049:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.492229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.494502:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.494557:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272828288 00000100:00100000:1.0:1746065136.494563:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272828288 00002000:00100000:1.0:1746065136.494594:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f982300 x1830881272828288/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.494603:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982300 with x1830881272828288 ext(0->7) 00010000:00010000:1.0:1746065136.494610:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87f65a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55cb expref: 40 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.494629:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87f65a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55cb expref: 40 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.494635:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f982300 00000100:00100000:1.0:1746065136.494664:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2706 00000100:00100000:1.0:1746065136.494670:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2002:x1830881272828288:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065136.495995:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2002:x1830881272828288:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1320us (1492us total) trans 4294972083 rc 0/0 00000100:00100000:0.0:1746065136.496002:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2706 00002000:00100000:0.0:1746065136.496008:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f982300 x1830881272828288/t4294972083(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.496016:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982300 with x1830881272828288 ext(0->7) 00010000:00010000:0.0:1746065136.496021:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87f65a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55cb expref: 42 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.496032:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87f65a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55cb expref: 42 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.496038:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f982300 00000100:00100000:0.0:1746065136.497721:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.503167:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.503247:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.511385:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.511867:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.515780:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.516014:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272829312 00000100:00100000:1.0:1746065136.516020:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272829312 00002000:00100000:1.0:1746065136.516053:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4000 x1830881272829312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.516062:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4000 with x1830881272829312 ext(0->4095) 00010000:00010000:1.0:1746065136.516068:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f668 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55d9 expref: 43 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.516099:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f668 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55d9 expref: 43 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.516106:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff4000 00000100:00100000:1.0:1746065136.516130:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2707 00000100:00100000:1.0:1746065136.516137:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2004:x1830881272829312:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.516322:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2004:x1830881272829312:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 185us (542us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.516328:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2707 00002000:00100000:1.0:1746065136.516333:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4000 x1830881272829312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.516340:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4000 with x1830881272829312 ext(0->4095) 00010000:00010000:1.0:1746065136.516344:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f668 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55d9 expref: 43 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.516352:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87f668 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55d9 expref: 43 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.516357:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff4000 00000100:00100000:0.0:1746065136.518559:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.522269:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.522333:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272829696 00000100:00100000:1.0:1746065136.522341:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272829696 00002000:00100000:1.0:1746065136.522373:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4e00 x1830881272829696/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.522382:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4e00 with x1830881272829696 ext(0->4095) 00002000:00010000:1.0:1746065136.522386:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff4e00 00000100:00100000:1.0:1746065136.522607:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13483 00000100:00100000:1.0:1746065136.522614:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881272829696:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.522713:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881272829696:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (450us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.522722:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13483 00002000:00100000:1.0:1746065136.522727:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4e00 x1830881272829696/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.522734:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4e00 with x1830881272829696 ext(0->4095) 00002000:00010000:1.0:1746065136.522736:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff4e00 00000100:00100000:0.0:1746065136.528921:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.529132:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272829824 00000100:00100000:1.0:1746065136.529140:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272829824 00000100:00100000:1.0:1746065136.530536:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30091 00000100:00100000:1.0:1746065136.530545:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272829824:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.530559:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.530573:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f676 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e55e7 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.530599:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f66f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55e0 expref: 41 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.530606:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.530607:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.530610:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f676 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55e7 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.530634:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f66f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55e0 expref: 41 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.530644:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f66f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55e0 expref: 41 pid: 21550 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.530658:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267619328:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.530723:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.532406:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267619328:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.532425:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f676 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55e7 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.532438:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:1.0:1746065136.532465:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272829824:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1921us (3550us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.532472:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30091 00000100:00100000:0.0:1746065136.533130:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.534482:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.534888:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272830080 00000100:00100000:1.0:1746065136.534892:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272830080 00000100:00100000:1.0:1746065136.534912:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30092 00000100:00100000:1.0:1746065136.534916:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1791:x1830881272830080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.534926:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.534935:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e55ee expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.534948:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f676 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55e7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.534953:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.534962:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.534965:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55ee expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.534985:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f676 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55e7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.534994:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f676 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55e7 expref: 5 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.535002:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267619584:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.536465:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.539784:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.539850:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267619584:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.539870:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55ee expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.539884:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1600, rc 0) 00000100:00100000:1.0:1746065136.539914:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1791:x1830881272830080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4996us (5434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.539921:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30092 00000100:00100000:0.0:1746065136.543135:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.547352:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.549794:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.549852:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272830848 00000100:00100000:1.0:1746065136.549858:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272830848 00000100:00100000:1.0:1746065136.549897:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30093 00000100:00100000:1.0:1746065136.549902:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272830848:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.549996:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.550010:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e55f5 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.550032:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55ee expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.550039:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.550041:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.550044:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55f5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.550067:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55ee expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.550076:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55ee expref: 41 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.550167:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267619840:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.550347:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.551308:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267619840:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.551324:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55f5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.551333:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0800, rc 0) 00000100:00100000:1.0:1746065136.551358:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272830848:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1456us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.551628:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30093 00000100:00100000:0.0:1746065136.552185:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.559296:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2003:x1830881272830976:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 6863us (7102us total) trans 4294972084 rc 0/0 00000100:00100000:0.0:1746065136.559308:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2709 00002000:00100000:0.0:1746065136.559319:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012f085c00 x1830881272830976/t4294972084(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.559328:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f085c00 with x1830881272830976 ext(0->7) 00010000:00010000:0.0:1746065136.559336:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55ee expref: 44 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.559352:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55ee expref: 44 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.559359:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f085c00 00000100:00100000:0.0:1746065136.561143:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.562799:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14065 00000100:00100000:0.0:1746065136.562809:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2002:x1830881272831104:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.562819:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.562835:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55ee expref: 44 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.562846:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55ee expref: 44 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.562868:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f67d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55ee expref: 44 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.562884:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.562886:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.562892:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55f5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.562899:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55f5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.562925:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55f5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.562936:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f084a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267619968:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065136.563568:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.569755:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.571302:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.571328:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272831488 00000100:00100000:0.0:1746065136.571334:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272831488 00002000:00100000:0.0:1746065136.571369:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79ce00 x1830881272831488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.571378:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ce00 with x1830881272831488 ext(0->4095) 00002000:00010000:0.0:1746065136.571383:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79ce00 00000100:00100000:1.0:1746065136.571755:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272831232 00000100:00100000:1.0:1746065136.571760:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272831232 00000100:00100000:1.0:1746065136.571781:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30094 00000100:00100000:1.0:1746065136.571787:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1791:x1830881272831232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.571800:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.571813:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f68b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e55fc expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.571835:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55f5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.571841:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.571843:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.571845:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f68b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55fc expref: 44 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.571870:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55f5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.571880:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55f5 expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.571889:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267620096:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.571942:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.572177:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2710 00000100:00100000:0.0:1746065136.572183:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272831488:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746065136.572299:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272831488:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 115us (999us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065136.572304:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2710 00002000:00100000:0.0:1746065136.572310:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79ce00 x1830881272831488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.572317:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ce00 with x1830881272831488 ext(0->4095) 00010000:00010000:0.0:1746065136.572321:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55f5 expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.572330:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f684 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55f5 expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.572335:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79ce00 00000100:00100000:1.0:1746065136.573978:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267620096:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.573996:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f68b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55fc expref: 44 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.574009:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:1.0:1746065136.574041:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1791:x1830881272831232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2254us (4293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.574051:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30094 00000100:00100000:0.0:1746065136.574673:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.574990:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272831616 00000100:00100000:1.0:1746065136.574995:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272831616 00000100:00100000:1.0:1746065136.575026:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30095 00000100:00100000:1.0:1746065136.575031:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1795:x1830881272831616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.575040:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.575051:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f692 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5603 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.575066:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.575070:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f68b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55fc expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.575075:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.575078:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f692 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5603 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.575122:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f68b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55fc expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.575130:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f692 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5603 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.575137:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0200, rc 0) 00000100:00100000:1.0:1746065136.575158:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1795:x1830881272831616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 127us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.575163:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30095 00000100:00100000:0.0:1746065136.575833:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.578914:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.579011:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272832000 00000100:00100000:1.0:1746065136.579016:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272832000 00002000:00100000:1.0:1746065136.579041:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79d880 x1830881272832000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.579050:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d880 with x1830881272832000 ext(0->4095) 00010000:00010000:1.0:1746065136.579056:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55fc expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.579065:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55fc expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.579071:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79d880 00000100:00100000:1.0:1746065136.579109:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2711 00000100:00100000:1.0:1746065136.579115:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2004:x1830881272832000:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.579223:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2004:x1830881272832000:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 107us (310us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.579229:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2711 00002000:00100000:1.0:1746065136.579233:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79d880 x1830881272832000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.579241:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d880 with x1830881272832000 ext(0->4095) 00010000:00010000:1.0:1746065136.579245:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55fc expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.579254:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e55fc expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.579263:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79d880 00000100:00100000:1.0:1746065136.581363:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.585275:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.585347:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272832384 00000100:00100000:1.0:1746065136.585353:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272832384 00002000:00100000:1.0:1746065136.585381:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79f800 x1830881272832384/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.585390:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79f800 with x1830881272832384 ext(0->4095) 00002000:00010000:1.0:1746065136.585393:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79f800 00000100:00100000:1.0:1746065136.585406:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13486 00000100:00100000:1.0:1746065136.585412:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2004:x1830881272832384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.586280:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2004:x1830881272832384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 866us (1010us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.586286:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13486 00002000:00100000:1.0:1746065136.586291:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79f800 x1830881272832384/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.586298:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79f800 with x1830881272832384 ext(0->4095) 00002000:00010000:1.0:1746065136.586300:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79f800 00000100:00100000:0.0:1746065136.588458:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.592011:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.596534:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.596637:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272833024 00000100:00100000:1.0:1746065136.596641:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272833024 00002000:00100000:1.0:1746065136.596663:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75180 x1830881272833024/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.596671:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75180 with x1830881272833024 ext(0->4095) 00010000:00010000:1.0:1746065136.596677:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f699 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e560a expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.596687:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f699 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e560a expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.596692:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea75180 00000100:00100000:1.0:1746065136.596704:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2712 00000100:00100000:1.0:1746065136.596710:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272833024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.596804:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272833024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (270us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.596810:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2712 00002000:00100000:1.0:1746065136.596815:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75180 x1830881272833024/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.596822:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75180 with x1830881272833024 ext(0->4095) 00010000:00010000:1.0:1746065136.596826:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f699 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e560a expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.596834:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f699 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e560a expref: 6 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.596839:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea75180 00000100:00100000:0.0:1746065136.600918:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272833152 00000100:00100000:0.0:1746065136.600924:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272833152 00000100:00100000:0.0:1746065136.601715:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30098 00000100:00100000:0.0:1746065136.601722:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1795:x1830881272833152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065136.601736:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.601749:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013138c200/0x392ae0376f87f6a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5618 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.601768:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.601773:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f6a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5611 expref: 45 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.601778:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.601781:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013138c200/0x392ae0376f87f6a7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5618 expref: 45 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.601808:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f6a0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5611 expref: 45 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.601818:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013138c200/0x392ae0376f87f6a7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5618 expref: 45 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.601826:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013138c200, rc 0) 00000100:00100000:0.0:1746065136.601855:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1795:x1830881272833152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 134us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.601860:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30098 00000100:00100000:0.0:1746065136.605242:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.605394:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272833536 00000100:00100000:1.0:1746065136.605399:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272833536 00002000:00100000:1.0:1746065136.605427:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75f80 x1830881272833536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.605435:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881272833536 ext(0->4095) 00010000:00010000:1.0:1746065136.605441:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f6a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5611 expref: 45 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.605451:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f6a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5611 expref: 45 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.605456:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea75f80 00000100:00100000:1.0:1746065136.605475:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2713 00000100:00100000:1.0:1746065136.605480:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2002:x1830881272833536:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065136.606295:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2002:x1830881272833536:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 811us (1322us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.606302:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2713 00002000:00100000:1.0:1746065136.606308:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75f80 x1830881272833536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.606315:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881272833536 ext(0->4095) 00010000:00010000:1.0:1746065136.606320:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f6a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5611 expref: 45 pid: 21550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.606329:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f6a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5611 expref: 45 pid: 21550 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.606334:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea75f80 00000100:00100000:0.0:1746065136.608390:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.612305:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.612787:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272833920 00000100:00100000:1.0:1746065136.612793:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272833920 00002000:00100000:1.0:1746065136.612822:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75880 x1830881272833920/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.612835:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75880 with x1830881272833920 ext(0->4095) 00002000:00010000:1.0:1746065136.612839:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea75880 00000100:00100000:1.0:1746065136.612860:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13487 00000100:00100000:1.0:1746065136.612867:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2005:x1830881272833920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.612993:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2005:x1830881272833920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 127us (689us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.612999:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13487 00002000:00100000:1.0:1746065136.613003:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75880 x1830881272833920/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.613009:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75880 with x1830881272833920 ext(0->4095) 00002000:00010000:1.0:1746065136.613012:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea75880 00000100:00100000:0.0:1746065136.615270:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.616459:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272834048 00000100:00100000:1.0:1746065136.616467:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272834048 00000100:00100000:1.0:1746065136.616890:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30099 00000100:00100000:1.0:1746065136.616898:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272834048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.616913:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.616926:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e561f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.616947:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013138c200/0x392ae0376f87f6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5618 expref: 43 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.616962:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.616964:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.616968:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6ae lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e561f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.616992:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013138c200/0x392ae0376f87f6a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5618 expref: 43 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.617002:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013138c200/0x392ae0376f87f6a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5618 expref: 43 pid: 21550 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.617013:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267621376:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.617102:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.620224:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267621376:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.620246:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6ae lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e561f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.620398:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1600, rc 0) 00000100:00100000:1.0:1746065136.620439:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272834048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3541us (5173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.620446:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30099 00000100:00100000:0.0:1746065136.621834:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.621898:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.623032:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272834304 00000100:00100000:1.0:1746065136.623037:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272834304 00000100:00100000:1.0:1746065136.623068:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30100 00000100:00100000:1.0:1746065136.623073:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1791:x1830881272834304:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.623100:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.623112:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5626 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.623130:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e561f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.623136:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.623137:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.623140:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6b5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5626 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.623155:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e561f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.623164:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6ae lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e561f expref: 5 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.623172:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267621632:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.623215:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.625709:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267621632:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.625724:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6b5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5626 expref: 44 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.625736:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1800, rc 0) 00000100:00100000:1.0:1746065136.625754:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1791:x1830881272834304:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2681us (3855us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.625760:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30100 00000100:00100000:0.0:1746065136.625820:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272834560 00000100:00100000:0.0:1746065136.625824:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272834560 00002000:00100000:0.0:1746065136.625853:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859500 x1830881272834560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.625860:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859500 with x1830881272834560 ext(0->4095) 00010000:00010000:0.0:1746065136.625866:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e561f expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.625876:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e561f expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.625882:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859500 00000100:00100000:0.0:1746065136.625894:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2714 00000100:00100000:0.0:1746065136.625900:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272834560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065136.626001:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272834560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 101us (369us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065136.626006:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2714 00002000:00100000:0.0:1746065136.626010:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859500 x1830881272834560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.626017:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859500 with x1830881272834560 ext(0->4095) 00010000:00010000:0.0:1746065136.626021:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e561f expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.626030:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e561f expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.626035:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859500 00000100:00100000:0.0:1746065136.627888:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.628661:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272834688 00000100:00100000:1.0:1746065136.628669:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272834688 00000100:00100000:1.0:1746065136.628721:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30101 00000100:00100000:1.0:1746065136.628727:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1795:x1830881272834688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.628741:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.628754:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f6bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e562d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.628774:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.628778:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5626 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.628783:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.628786:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f6bc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e562d expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.628813:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6b5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5626 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.628822:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f6bc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e562d expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.628829:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0800, rc 0) 00000100:00100000:1.0:1746065136.629965:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1795:x1830881272834688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1227us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.629972:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30101 00000100:00100000:0.0:1746065136.631165:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.635039:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272835072 00000100:00100000:1.0:1746065136.635045:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272835072 00002000:00100000:1.0:1746065136.635076:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859180 x1830881272835072/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.635118:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859180 with x1830881272835072 ext(0->4095) 00010000:00010000:1.0:1746065136.635125:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5626 expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.635165:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5626 expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.635173:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859180 00000100:00100000:1.0:1746065136.635193:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2715 00000100:00100000:1.0:1746065136.635199:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2004:x1830881272835072:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.635296:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2004:x1830881272835072:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 97us (661us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.635301:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2715 00002000:00100000:1.0:1746065136.635306:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859180 x1830881272835072/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.635313:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859180 with x1830881272835072 ext(0->4095) 00010000:00010000:1.0:1746065136.635317:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5626 expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.635404:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5626 expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.635410:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859180 00000100:00100000:0.0:1746065136.637131:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.640169:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.640371:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272835456 00000100:00100000:1.0:1746065136.640376:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272835456 00002000:00100000:1.0:1746065136.640403:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938380 x1830881272835456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.640411:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938380 with x1830881272835456 ext(0->4095) 00002000:00010000:1.0:1746065136.640415:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938380 00000100:00100000:1.0:1746065136.640541:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13488 00000100:00100000:1.0:1746065136.640547:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2003:x1830881272835456:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065136.640635:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2003:x1830881272835456:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 88us (471us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.640641:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13488 00002000:00100000:1.0:1746065136.640646:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938380 x1830881272835456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.640653:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938380 with x1830881272835456 ext(0->4095) 00002000:00010000:1.0:1746065136.640656:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938380 00000100:00100000:0.0:1746065136.642385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.642428:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272835584 00000100:00100000:1.0:1746065136.642432:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272835584 00000100:00100000:1.0:1746065136.642464:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30102 00000100:00100000:1.0:1746065136.642468:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272835584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.642476:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.642486:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5634 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.642503:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f6bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e562d expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.642511:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.642512:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.642514:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6c3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5634 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.642531:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f6bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e562d expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.642537:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f6bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e562d expref: 43 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.642543:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267622144:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.642773:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.644890:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267622144:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.644908:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6c3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5634 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.644920:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1600, rc 0) 00000100:00100000:1.0:1746065136.645329:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272835584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2856us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.645335:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30102 00000100:00100000:0.0:1746065136.649588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.650975:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.651118:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272836096 00000100:00100000:1.0:1746065136.651125:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272836096 00000100:00100000:1.0:1746065136.651170:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30103 00000100:00100000:1.0:1746065136.651177:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1791:x1830881272836096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.651193:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.651206:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e563b expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.651228:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5634 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.651234:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.651235:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.651238:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6ca lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e563b expref: 44 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.651261:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5634 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.651270:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5634 expref: 5 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.651279:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267622400:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.651339:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.654167:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.654330:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267622400:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.654350:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6ca lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e563b expref: 44 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.654364:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1800, rc 0) 00000100:00100000:1.0:1746065136.654392:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1791:x1830881272836096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3215us (3420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.654401:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30103 00000100:00100000:1.0:1746065136.654420:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272836224 00000100:00100000:1.0:1746065136.654424:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272836224 00000100:00100000:1.0:1746065136.654462:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30104 00000100:00100000:1.0:1746065136.654468:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1795:x1830881272836224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.654477:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.654488:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5642 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.655149:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.655154:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e563b expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.655159:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.655162:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6d1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5642 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.655182:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6ca lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e563b expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.655189:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6d1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5642 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.655196:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0200, rc 0) 00000100:00100000:1.0:1746065136.655213:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1795:x1830881272836224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 745us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.655218:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30104 00000100:00100000:0.0:1746065136.655983:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.660552:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.663172:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.665019:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.665459:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272836992 00000100:00100000:1.0:1746065136.665463:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272836992 00002000:00100000:1.0:1746065136.665487:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf9180 x1830881272836992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.665495:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9180 with x1830881272836992 ext(0->4095) 00002000:00010000:1.0:1746065136.665498:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf9180 00000100:00100000:1.0:1746065136.665521:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13489 00000100:00100000:1.0:1746065136.665525:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2004:x1830881272836992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.665728:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2004:x1830881272836992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 201us (711us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.665734:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13489 00002000:00100000:1.0:1746065136.665739:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf9180 x1830881272836992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.665746:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9180 with x1830881272836992 ext(0->4095) 00002000:00010000:1.0:1746065136.665748:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf9180 00000100:00100000:0.0:1746065136.667038:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.667098:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272837120 00000100:00100000:1.0:1746065136.667102:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272837120 00000100:00100000:1.0:1746065136.667132:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30105 00000100:00100000:1.0:1746065136.667137:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272837120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.667192:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.667205:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5649 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.667225:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5642 expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.667236:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.667237:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.667240:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6d8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5649 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.667259:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5642 expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.667269:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5642 expref: 43 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.667280:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267622912:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.667335:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.669360:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.669566:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267622912:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.669640:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6d8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5649 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.669652:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1600, rc 0) 00000100:00100000:1.0:1746065136.669696:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272837120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2557us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.669702:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30105 00000100:00100000:0.0:1746065136.672130:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.672190:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272837504 00000100:00100000:1.0:1746065136.672195:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272837504 00002000:00100000:1.0:1746065136.672221:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fafa680 x1830881272837504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.672235:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafa680 with x1830881272837504 ext(0->4095) 00002000:00010000:1.0:1746065136.672238:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fafa680 00000100:00100000:1.0:1746065136.672259:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13490 00000100:00100000:1.0:1746065136.672264:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272837504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.672364:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272837504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (235us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.672370:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13490 00002000:00100000:1.0:1746065136.672374:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fafa680 x1830881272837504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.672381:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafa680 with x1830881272837504 ext(0->4095) 00002000:00010000:1.0:1746065136.672383:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fafa680 00000100:00100000:0.0:1746065136.675001:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.675324:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272837632 00000100:00100000:1.0:1746065136.675332:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272837632 00000100:00100000:1.0:1746065136.675378:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30106 00000100:00100000:1.0:1746065136.675384:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1795:x1830881272837632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.675398:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.675411:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f6df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5650 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.675433:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5649 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.675438:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.675440:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.675443:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f6df lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5650 expref: 44 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.675493:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5649 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.675504:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f6d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5649 expref: 5 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.675515:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267623168:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.675709:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.675936:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.677835:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267623168:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.677850:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f6df lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5650 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.677859:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0800, rc 0) 00000100:00100000:0.0:1746065136.677882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.677893:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1795:x1830881272837632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2509us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.677902:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30106 00000100:00100000:0.0:1746065136.681075:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.682729:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.682788:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.682850:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272838400 00000100:00100000:1.0:1746065136.682853:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272838400 00000100:00100000:1.0:1746065136.682893:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30108 00000100:00100000:1.0:1746065136.682897:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272838400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.682906:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.682916:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e565e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.683250:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.683256:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f6e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5657 expref: 44 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.683262:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.683264:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6ed lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e565e expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.683399:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f6e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5657 expref: 44 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.683408:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f6e6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5657 expref: 44 pid: 21550 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.683418:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267623680:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.683569:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.684808:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267623680:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.684824:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6ed lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e565e expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.684833:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0200, rc 0) 00000100:00100000:1.0:1746065136.684858:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272838400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1960us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.684864:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30108 00000100:00100000:0.0:1746065136.685509:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.687722:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.687794:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272838784 00000100:00100000:0.0:1746065136.687796:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.687802:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272838784 00000100:00100000:1.0:1746065136.687840:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30109 00000100:00100000:1.0:1746065136.687846:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1791:x1830881272838784:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.687857:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.687869:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f6f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5665 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.687887:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.687891:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e565e expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.687896:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065136.687899:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f6f4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5665 expref: 46 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.687924:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f6ed lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e565e expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.688186:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f6f4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5665 expref: 46 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.688195:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:1.0:1746065136.688415:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1791:x1830881272838784:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 379us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.688422:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30109 00000100:00100000:0.0:1746065136.690426:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.692614:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.695022:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.696319:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.696478:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272839680 00000100:00100000:1.0:1746065136.696484:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272839680 00000100:00100000:1.0:1746065136.696523:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30110 00000100:00100000:1.0:1746065136.696530:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272839680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.696540:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.696553:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e566c expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.696576:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f6f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5665 expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.696582:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.696584:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.696587:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6fb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e566c expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.696611:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f6f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5665 expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.696620:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f6f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5665 expref: 43 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.696631:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267624192:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.696690:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.698214:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267624192:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.698234:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6fb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e566c expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.698246:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1800, rc 0) 00000100:00100000:1.0:1746065136.698273:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272839680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1744us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.698283:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30110 00000100:00100000:0.0:1746065136.699412:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.701552:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.702267:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13492 00000100:00100000:1.0:1746065136.702275:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272840064:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.702383:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272840064:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 109us (831us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.702389:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13492 00002000:00100000:1.0:1746065136.702394:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253c700 x1830881272840064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.702400:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253c700 with x1830881272840064 ext(0->4095) 00002000:00010000:1.0:1746065136.702403:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007253c700 00000100:00100000:0.0:1746065136.703702:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.704371:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272840192 00000100:00100000:1.0:1746065136.704377:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272840192 00000100:00100000:1.0:1746065136.704419:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30111 00000100:00100000:1.0:1746065136.704424:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1795:x1830881272840192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.704434:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.704449:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f702 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5673 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.704469:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e566c expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.704475:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.704476:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.704479:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f702 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5673 expref: 44 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.704504:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e566c expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.704514:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f6fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e566c expref: 5 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.704523:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267624448:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.704584:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.704727:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.707648:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.707755:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267624448:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.707773:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f702 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5673 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.707783:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1600, rc 0) 00000100:00100000:1.0:1746065136.707812:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1795:x1830881272840192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3388us (4112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.707818:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30111 00000100:00100000:0.0:1746065136.711326:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.711416:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272840704 00000100:00100000:1.0:1746065136.711422:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272840704 00002000:00100000:1.0:1746065136.711452:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a2680 x1830881272840704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.711460:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2680 with x1830881272840704 ext(0->4095) 00010000:00010000:1.0:1746065136.711467:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f702 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5673 expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.711483:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f702 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5673 expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.711489:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a2680 00000100:00100000:1.0:1746065136.711515:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2721 00000100:00100000:1.0:1746065136.711521:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2005:x1830881272840704:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.711623:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2005:x1830881272840704:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 102us (297us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.711629:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2721 00002000:00100000:1.0:1746065136.711634:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a2680 x1830881272840704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.711640:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2680 with x1830881272840704 ext(0->4095) 00010000:00010000:1.0:1746065136.711644:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f702 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5673 expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.711652:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f702 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5673 expref: 45 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.711657:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a2680 00000100:00100000:0.0:1746065136.713797:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.713829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.713899:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272840832 00000100:00100000:1.0:1746065136.713902:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272840832 00000100:00100000:1.0:1746065136.713931:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30113 00000100:00100000:1.0:1746065136.713936:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272840832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.713945:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.713965:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5681 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.714040:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.714045:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f709 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e567a expref: 45 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.714050:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065136.714053:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.714153:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f709 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e567a expref: 44 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.714162:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.714168:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0200, rc 0) 00000100:00100000:1.0:1746065136.714256:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272840832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 319us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.714261:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30113 00000100:00100000:0.0:1746065136.715758:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.718028:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.718111:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.718135:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272841344 00000100:00100000:1.0:1746065136.718140:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272841344 00000100:00100000:1.0:1746065136.718176:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30114 00000100:00100000:1.0:1746065136.718183:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1791:x1830881272841344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.718193:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.718206:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f717 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5688 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.718229:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.718234:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.718240:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065136.718243:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f717 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5688 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.718480:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.718490:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f717 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5688 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.718497:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.718499:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.718503:0:9560:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.718509:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.718523:0:9560:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.718532:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 5 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.718545:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267625216:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065136.718686:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.719827:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267625216:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065136.719837:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:1.0:1746065136.719860:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1791:x1830881272841344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1678us (1836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.719866:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30114 00000100:00100000:0.0:1746065136.720521:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.720670:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272841728 00000100:00100000:1.0:1746065136.720675:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272841728 00002000:00100000:1.0:1746065136.720704:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a1f80 x1830881272841728/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.720714:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1f80 with x1830881272841728 ext(0->4095) 00010000:00010000:1.0:1746065136.720721:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.720732:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.720737:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a1f80 00000100:00100000:1.0:1746065136.720764:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2723 00000100:00100000:1.0:1746065136.720770:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272841728:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.720876:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272841728:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 106us (356us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.720884:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2723 00002000:00100000:1.0:1746065136.720889:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a1f80 x1830881272841728/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.720895:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1f80 with x1830881272841728 ext(0->4095) 00010000:00010000:1.0:1746065136.720899:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.720907:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0200/0x392ae0376f87f710 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5681 expref: 6 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.720912:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a1f80 00000100:00100000:0.0:1746065136.723665:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.728841:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.730948:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.731563:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272842240 00000100:00100000:1.0:1746065136.731570:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272842240 00000100:00100000:1.0:1746065136.731616:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30115 00000100:00100000:1.0:1746065136.731623:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272842240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.731636:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.731653:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f71e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e568f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.731675:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f717 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5688 expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.731680:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.731682:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.731685:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f71e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e568f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.731714:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f717 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5688 expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.731723:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f87f717 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5688 expref: 43 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.731733:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267625472:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.731807:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.734535:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267625472:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.734561:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f71e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e568f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.734576:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1800, rc 0) 00000100:00100000:1.0:1746065136.734621:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272842240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2998us (3678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.734628:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30115 00000100:00100000:0.0:1746065136.735068:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.736439:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.736456:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272842496 00000100:00100000:1.0:1746065136.736459:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272842496 00000100:00100000:1.0:1746065136.736599:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30116 00000100:00100000:1.0:1746065136.736606:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1791:x1830881272842496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.736616:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.736624:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f725 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5696 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.737251:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f71e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e568f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.737260:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.737262:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.737266:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f725 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5696 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.737284:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f71e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e568f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.737294:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1800/0x392ae0376f87f71e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e568f expref: 5 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.737304:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267625728:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.737454:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.738976:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267625728:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.738992:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f725 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5696 expref: 45 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.739002:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1600, rc 0) 00000100:00100000:1.0:1746065136.739017:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1791:x1830881272842496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2412us (2580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.739025:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30116 00000100:00100000:0.0:1746065136.740184:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.743181:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.746777:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.746865:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272843136 00000100:00100000:1.0:1746065136.746872:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272843136 00002000:00100000:1.0:1746065136.746906:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a3b80 x1830881272843136/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.746915:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3b80 with x1830881272843136 ext(0->4095) 00002000:00010000:1.0:1746065136.746920:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a3b80 00000100:00100000:1.0:1746065136.746950:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13494 00000100:00100000:1.0:1746065136.746967:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2002:x1830881272843136:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065136.747100:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2002:x1830881272843136:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 112us (307us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.747106:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13494 00002000:00100000:1.0:1746065136.747112:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a3b80 x1830881272843136/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.747119:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3b80 with x1830881272843136 ext(0->4095) 00002000:00010000:1.0:1746065136.747122:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a3b80 00000100:00100000:0.0:1746065136.751487:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.751532:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272843264 00000100:00100000:0.0:1746065136.751540:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272843264 00000100:00100000:0.0:1746065136.751975:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30117 00000100:00100000:0.0:1746065136.751982:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272843264:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065136.751996:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.752009:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727b7e00/0x392ae0376f87f72c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e569d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.752036:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f725 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5696 expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.752042:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.752043:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.752046:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727b7e00/0x392ae0376f87f72c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e569d expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.752066:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f725 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5696 expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.752075:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f725 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5696 expref: 43 pid: 9560 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065136.752198:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267625984:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065136.752264:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.753879:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.754755:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272843392:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 724us (876us total) trans 4294972085 rc 0/0 00000100:00100000:0.0:1746065136.754761:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2725 00002000:00100000:0.0:1746065136.754767:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880094c91c00 x1830881272843392/t4294972085(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.754773:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91c00 with x1830881272843392 ext(0->7) 00010000:00010000:0.0:1746065136.754777:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f725 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5696 expref: 46 pid: 9560 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.754789:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f1600/0x392ae0376f87f725 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5696 expref: 46 pid: 9560 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065136.754794:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91c00 00000100:00100000:0.0:1746065136.756373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.759591:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.760234:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272843776 00000100:00100000:1.0:1746065136.760239:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272843776 00002000:00100000:1.0:1746065136.760274:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90380 x1830881272843776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.760284:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90380 with x1830881272843776 ext(0->4095) 00002000:00010000:1.0:1746065136.760288:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90380 00000100:00100000:1.0:1746065136.760312:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13495 00000100:00100000:1.0:1746065136.760318:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272843776:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065136.760702:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272843776:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 383us (1114us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.760711:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13495 00002000:00100000:1.0:1746065136.760717:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90380 x1830881272843776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.760724:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90380 with x1830881272843776 ext(0->4095) 00002000:00010000:1.0:1746065136.760727:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90380 00000100:00100000:0.0:1746065136.764149:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.764230:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.767182:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.771747:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.771794:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272844416 00000100:00100000:1.0:1746065136.771800:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272844416 00002000:00100000:1.0:1746065136.771833:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c93800 x1830881272844416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.771843:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c93800 with x1830881272844416 ext(0->4095) 00010000:00010000:1.0:1746065136.771850:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f733 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56a4 expref: 47 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.771862:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f733 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56a4 expref: 47 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.771868:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c93800 00000100:00100000:1.0:1746065136.771895:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2726 00000100:00100000:1.0:1746065136.771902:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:2004:x1830881272844416:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.772017:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:2004:x1830881272844416:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 115us (272us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.772023:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2726 00002000:00100000:1.0:1746065136.772029:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c93800 x1830881272844416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.773539:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c93800 with x1830881272844416 ext(0->4095) 00010000:00010000:1.0:1746065136.773553:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f733 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56a4 expref: 47 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.773564:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f87f733 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56a4 expref: 47 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.773570:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c93800 00000100:00100000:0.0:1746065136.774399:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.777783:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.777866:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272844800 00000100:00100000:1.0:1746065136.777873:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272844800 00002000:00100000:1.0:1746065136.777902:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92680 x1830881272844800/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.777910:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92680 with x1830881272844800 ext(0->4095) 00002000:00010000:1.0:1746065136.777914:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c92680 00000100:00100000:1.0:1746065136.777929:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13496 00000100:00100000:1.0:1746065136.777934:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272844800:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.778285:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272844800:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 348us (502us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.778291:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13496 00002000:00100000:1.0:1746065136.778296:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92680 x1830881272844800/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.778303:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92680 with x1830881272844800 ext(0->4095) 00002000:00010000:1.0:1746065136.778306:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c92680 00000100:00100000:0.0:1746065136.781397:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.784665:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.789657:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.789762:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.790460:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272845440 00000100:00100000:1.0:1746065136.790464:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272845440 00002000:00100000:1.0:1746065136.790484:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91180 x1830881272845440/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.790492:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91180 with x1830881272845440 ext(0->4095) 00010000:00010000:1.0:1746065136.790497:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f741 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b2 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.790506:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f741 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b2 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.790511:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91180 00000100:00100000:1.0:1746065136.790529:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2727 00000100:00100000:1.0:1746065136.790534:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272845440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.790650:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272845440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 115us (887us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.790655:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2727 00002000:00100000:1.0:1746065136.790660:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91180 x1830881272845440/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.790665:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91180 with x1830881272845440 ext(0->4095) 00010000:00010000:1.0:1746065136.790669:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f741 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b2 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.790677:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f741 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b2 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.790686:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91180 00000100:00100000:0.0:1746065136.793498:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272845696 00000100:00100000:0.0:1746065136.793501:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272845696 00010000:00010000:0.0:1746065136.793515:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f741 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b2 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065136.793545:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14093 00000100:00100000:0.0:1746065136.793550:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272845696:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.793557:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.793574:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f741 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b2 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.793587:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f741 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b2 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.793602:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f741 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b2 expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065136.793612:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.793614:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.793618:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b9 expref: 46 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.793624:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b9 expref: 46 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.793642:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b9 expref: 46 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.793650:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f748 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56b9 expref: 46 pid: 9642 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065136.793659:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c93100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267627264:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065136.793706:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.795921:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.798829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.802806:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.805179:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.807265:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.809035:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.809102:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272846848 00000100:00100000:1.0:1746065136.809107:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272846848 00002000:00100000:1.0:1746065136.809133:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e8a80 x1830881272846848/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.809145:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e8a80 with x1830881272846848 ext(0->4095) 00002000:00010000:1.0:1746065136.809149:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5e8a80 00000100:00100000:1.0:1746065136.809212:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13498 00000100:00100000:1.0:1746065136.809218:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272846848:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.809309:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272846848:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 91us (274us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.809314:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13498 00002000:00100000:1.0:1746065136.809318:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e8a80 x1830881272846848/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.809325:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e8a80 with x1830881272846848 ext(0->4095) 00002000:00010000:1.0:1746065136.809328:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5e8a80 00000100:00100000:0.0:1746065136.810507:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272846976 00000100:00100000:0.0:1746065136.810511:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272846976 00000100:00100000:0.0:1746065136.810545:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30124 00000100:00100000:0.0:1746065136.810551:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1795:x1830881272846976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065136.810560:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.810570:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f75d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e56ce expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.810589:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87f756 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56c7 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.810595:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.810596:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.810598:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f75d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ce expref: 46 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.810617:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87f756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56c7 expref: 5 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.810626:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87f756 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56c7 expref: 5 pid: 9642 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065136.810634:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267627776:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065136.810687:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.812411:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.812461:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.813797:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.813816:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272847488 00000100:00100000:1.0:1746065136.813820:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272847488 00002000:00100000:1.0:1746065136.813841:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e9880 x1830881272847488/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.813849:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9880 with x1830881272847488 ext(0->4095) 00010000:00010000:1.0:1746065136.813853:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f75d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ce expref: 47 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.813867:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f75d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ce expref: 47 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.813873:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e9880 00000100:00100000:1.0:1746065136.813896:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2729 00000100:00100000:1.0:1746065136.813901:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:2002:x1830881272847488:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065136.814004:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:2002:x1830881272847488:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 102us (205us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.814009:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2729 00002000:00100000:1.0:1746065136.814014:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e9880 x1830881272847488/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.814021:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9880 with x1830881272847488 ext(0->4095) 00010000:00010000:1.0:1746065136.814026:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f75d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ce expref: 47 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.814034:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0800/0x392ae0376f87f75d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ce expref: 47 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.814039:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e9880 00000100:00100000:1.0:1746065136.815513:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.815651:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.818403:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.818462:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272848000 00000100:00100000:1.0:1746065136.818467:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272848000 00002000:00100000:1.0:1746065136.818493:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eaa00 x1830881272848000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.818502:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eaa00 with x1830881272848000 ext(0->4095) 00010000:00010000:1.0:1746065136.818509:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56d5 expref: 46 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.818519:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56d5 expref: 46 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.818525:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5eaa00 00000100:00100000:1.0:1746065136.818645:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2730 00000100:00100000:1.0:1746065136.818651:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272848000:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.818907:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272848000:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 256us (504us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.818913:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2730 00002000:00100000:1.0:1746065136.818919:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eaa00 x1830881272848000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.818925:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eaa00 with x1830881272848000 ext(0->4095) 00010000:00010000:1.0:1746065136.818930:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56d5 expref: 46 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.818938:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56d5 expref: 46 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.818943:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5eaa00 00000100:00100000:0.0:1746065136.820604:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.820710:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.824203:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.824302:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272848512 00000100:00100000:1.0:1746065136.824307:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272848512 00002000:00100000:1.0:1746065136.824334:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eb480 x1830881272848512/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.824343:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eb480 with x1830881272848512 ext(0->4095) 00010000:00010000:1.0:1746065136.824348:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f76b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56dc expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.824358:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f76b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56dc expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.824364:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5eb480 00000100:00100000:1.0:1746065136.824392:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2731 00000100:00100000:1.0:1746065136.824398:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272848512:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.824492:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272848512:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 93us (289us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.824498:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2731 00002000:00100000:1.0:1746065136.824503:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eb480 x1830881272848512/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.824510:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eb480 with x1830881272848512 ext(0->4095) 00010000:00010000:1.0:1746065136.824514:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f76b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56dc expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.824522:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f76b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56dc expref: 6 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.824528:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5eb480 00000100:00100000:0.0:1746065136.826712:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.828827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.833220:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.833776:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272849024 00000100:00100000:1.0:1746065136.833784:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272849024 00000100:00100000:1.0:1746065136.833851:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30128 00000100:00100000:1.0:1746065136.833858:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272849024:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.833872:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.833887:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f779 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e56ea expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.833909:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f772 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56e3 expref: 45 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.833915:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.833916:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.833919:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f779 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ea expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.833943:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f772 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56e3 expref: 45 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.833967:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f772 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56e3 expref: 45 pid: 9642 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.833978:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267628800:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.834051:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.835525:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267628800:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.835541:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f779 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ea expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.835557:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130640a00, rc 0) 00000100:00100000:1.0:1746065136.835580:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272849024:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1723us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.835586:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30128 00000100:00100000:0.0:1746065136.838548:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.839698:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.839735:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272849280 00000100:00100000:1.0:1746065136.839739:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272849280 00000100:00100000:1.0:1746065136.839766:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30129 00000100:00100000:1.0:1746065136.839771:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:1791:x1830881272849280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.839780:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.839788:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130640800/0x392ae0376f87f780 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e56f1 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.839806:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f779 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ea expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.839811:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.839812:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.839815:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130640800/0x392ae0376f87f780 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56f1 expref: 47 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.839828:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f779 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ea expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.839836:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f779 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ea expref: 5 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.839847:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267629056:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.839875:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.841178:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.841218:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272849536 00000100:00100000:1.0:1746065136.841221:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272849536 00002000:00100000:1.0:1746065136.841300:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f9500 x1830881272849536/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.841309:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9500 with x1830881272849536 ext(0->4095) 00010000:00010000:1.0:1746065136.841314:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f779 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ea expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.841324:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f779 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ea expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.841330:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9f9500 00000100:00100000:1.0:1746065136.841351:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2732 00000100:00100000:1.0:1746065136.841357:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272849536:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.841443:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272849536:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 86us (266us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.841448:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2732 00002000:00100000:1.0:1746065136.841453:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f9500 x1830881272849536/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.841460:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9500 with x1830881272849536 ext(0->4095) 00010000:00010000:1.0:1746065136.841464:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f779 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ea expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.841473:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130640a00/0x392ae0376f87f779 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ea expref: 6 pid: 9635 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.841478:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9f9500 00000100:00100000:1.0:1746065136.841836:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267629056:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.841851:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130640800/0x392ae0376f87f780 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56f1 expref: 46 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.841862:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130640800, rc 0) 00000100:00100000:1.0:1746065136.841892:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:1791:x1830881272849280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2120us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.841898:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30129 00000100:00100000:0.0:1746065136.842914:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.842965:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.843244:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272849792 00000100:00100000:1.0:1746065136.843247:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272849792 00000100:00100000:1.0:1746065136.843275:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30130 00000100:00100000:1.0:1746065136.843280:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272849792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.843286:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.843295:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f787 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e56f8 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.843417:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130640800/0x392ae0376f87f780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56f1 expref: 45 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.843423:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.843424:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.843427:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f787 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56f8 expref: 7 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.843445:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130640800/0x392ae0376f87f780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56f1 expref: 45 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.843455:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130640800/0x392ae0376f87f780 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56f1 expref: 45 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.843463:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267629312:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.843495:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.844458:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267629312:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.844472:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f787 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56f8 expref: 7 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.844480:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e400, rc 0) 00000100:00100000:1.0:1746065136.844496:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1795:x1830881272849792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1215us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.844501:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30130 00000100:00100000:0.0:1746065136.846487:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.848288:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.848439:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272850176 00000100:00100000:1.0:1746065136.848444:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272850176 00000100:00100000:1.0:1746065136.848484:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30131 00000100:00100000:1.0:1746065136.848489:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:1791:x1830881272850176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.848499:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.848512:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f78e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e56ff expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.848538:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065136.848793:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.848799:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f787 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56f8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.848804:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065136.848807:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f78e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ff expref: 48 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.848833:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f787 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56f8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.848842:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f78e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ff expref: 48 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.848849:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065136.849130:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:1791:x1830881272850176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 640us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.849136:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30131 00000100:00100000:0.0:1746065136.851719:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.854979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.856662:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.856824:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272850944 00000100:00100000:1.0:1746065136.856828:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272850944 00002000:00100000:1.0:1746065136.856853:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d652680 x1830881272850944/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.856861:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652680 with x1830881272850944 ext(0->4095) 00002000:00010000:1.0:1746065136.856864:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d652680 00000100:00100000:1.0:1746065136.856885:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13500 00000100:00100000:1.0:1746065136.856890:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272850944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.856983:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272850944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 92us (322us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.856988:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13500 00002000:00100000:1.0:1746065136.856993:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d652680 x1830881272850944/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.857000:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652680 with x1830881272850944 ext(0->4095) 00002000:00010000:1.0:1746065136.857002:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d652680 00000100:00100000:0.0:1746065136.858578:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.858736:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272851072 00000100:00100000:1.0:1746065136.858740:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272851072 00000100:00100000:1.0:1746065136.858765:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30132 00000100:00100000:1.0:1746065136.858770:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272851072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.858779:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.858791:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f795 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5706 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.858810:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f78e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ff expref: 45 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.858816:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.858818:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.858820:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f795 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5706 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.858840:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f78e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ff expref: 45 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.858853:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f78e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e56ff expref: 45 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.858863:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267629824:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.858918:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.860275:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267629824:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.860293:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f795 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5706 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.860304:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065136.860333:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272851072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1562us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.860339:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30132 00000100:00100000:0.0:1746065136.861023:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.863219:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.865255:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.865437:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272851584 00000100:00100000:1.0:1746065136.865442:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272851584 00000100:00100000:1.0:1746065136.865652:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30133 00000100:00100000:1.0:1746065136.865659:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1795:x1830881272851584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.865670:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.865682:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f79c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e570d expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.865703:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f795 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5706 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.865712:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.865714:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.865717:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f79c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e570d expref: 46 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.865740:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f795 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5706 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.865750:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f795 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5706 expref: 5 pid: 9635 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065136.865759:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267630080:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.865827:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.867961:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.868162:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267630080:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.868180:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f79c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e570d expref: 47 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.868193:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065136.868218:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:1795:x1830881272851584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2561us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.868224:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30133 00000100:00100000:0.0:1746065136.868668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.871849:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.874229:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.875133:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.877195:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.877599:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272852608 00000100:00100000:1.0:1746065136.877604:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272852608 00002000:00100000:1.0:1746065136.877628:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d653480 x1830881272852608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.877641:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d653480 with x1830881272852608 ext(0->4095) 00010000:00010000:1.0:1746065136.877647:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f7a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5714 expref: 46 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.877657:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f7a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5714 expref: 46 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.877662:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d653480 00000100:00100000:1.0:1746065136.877675:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2736 00000100:00100000:1.0:1746065136.877681:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2004:x1830881272852608:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.877775:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2004:x1830881272852608:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 93us (581us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.877780:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2736 00002000:00100000:1.0:1746065136.877784:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d653480 x1830881272852608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.877791:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d653480 with x1830881272852608 ext(0->4095) 00010000:00010000:1.0:1746065136.877794:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f7a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5714 expref: 46 pid: 9642 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065136.877802:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f7a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5714 expref: 46 pid: 9642 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065136.877808:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d653480 00000100:00100000:0.0:1746065136.881067:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272852736 00000100:00100000:0.0:1746065136.881074:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272852736 00000100:00100000:0.0:1746065136.885474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.887871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.895629:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.900507:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.914029:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.914302:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272853760 00000100:00100000:0.0:1746065136.914308:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272853760 00002000:00100000:0.0:1746065136.914336:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d4a1500 x1830881272853760/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.914344:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1500 with x1830881272853760 ext(0->7) 00010000:00010000:0.0:1746065136.914350:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f7b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5722 expref: 46 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065136.914360:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f7b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5722 expref: 46 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065136.914365:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1500 00000100:00100000:0.0:1746065136.914394:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2738 00000100:00100000:0.0:1746065136.914399:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881272853760:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065136.915095:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2005:x1830881272853760:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 694us (1066us total) trans 4294972086 rc 0/0 00000100:00100000:0.0:1746065136.915101:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2738 00002000:00100000:0.0:1746065136.915106:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d4a1500 x1830881272853760/t4294972086(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 496/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065136.915119:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1500 with x1830881272853760 ext(0->7) 00010000:00010000:0.0:1746065136.915124:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f7b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5722 expref: 48 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065136.915133:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f7b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5722 expref: 48 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065136.915138:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1500 00000100:00100000:0.0:1746065136.917671:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.923429:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.924057:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272854144 00000100:00100000:1.0:1746065136.924064:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272854144 00002000:00100000:1.0:1746065136.924128:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1f80 x1830881272854144/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.924137:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1f80 with x1830881272854144 ext(0->4095) 00002000:00010000:1.0:1746065136.924140:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a1f80 00000100:00100000:1.0:1746065136.924168:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13503 00000100:00100000:1.0:1746065136.924175:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272854144:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065136.924274:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272854144:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 100us (852us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.924280:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13503 00002000:00100000:1.0:1746065136.924285:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1f80 x1830881272854144/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.924292:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1f80 with x1830881272854144 ext(0->4095) 00002000:00010000:1.0:1746065136.924295:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a1f80 00000100:00100000:0.0:1746065136.924723:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.929735:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.929851:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.929865:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272854400 00000100:00100000:1.0:1746065136.929872:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272854400 00000100:00100000:1.0:1746065136.929921:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30139 00000100:00100000:1.0:1746065136.929927:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:1795:x1830881272854400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.929939:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.929949:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5737 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.929983:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.929988:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f7bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5730 expref: 49 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.929999:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.930002:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7c6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5737 expref: 49 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.930171:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f7bf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5730 expref: 49 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.930182:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7c6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5737 expref: 49 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.930190:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.930192:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.930196:0:9642:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f7bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5730 expref: 49 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.930203:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f7bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5730 expref: 49 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.930241:0:9642:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f7bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5730 expref: 49 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.930250:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f7bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5730 expref: 49 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065136.930260:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267631616:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065136.930304:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.932020:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.932111:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267631616:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065136.932122:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065136.932159:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:1795:x1830881272854400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2232us (2430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.932163:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30139 00000100:00100000:0.0:1746065136.934803:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272854912 00000100:00100000:0.0:1746065136.934809:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272854912 00010000:00010000:0.0:1746065136.934826:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f7bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5730 expref: 49 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065136.934854:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14111 00000100:00100000:0.0:1746065136.934860:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881272854912:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.934869:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.934881:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f7bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5730 expref: 49 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065136.934890:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f7bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5730 expref: 49 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065136.934907:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f7bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5730 expref: 49 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065136.934926:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.934927:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.934933:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5737 expref: 48 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.934939:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5737 expref: 48 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.934969:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5737 expref: 48 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.934978:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267631744:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065136.935034:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.937699:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.937796:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272855168 00000100:00100000:1.0:1746065136.937800:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272855168 00002000:00100000:1.0:1746065136.937832:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2d80 x1830881272855168/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.937841:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2d80 with x1830881272855168 ext(0->4095) 00002000:00010000:1.0:1746065136.937845:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a2d80 00000100:00100000:1.0:1746065136.937859:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13504 00000100:00100000:1.0:1746065136.937865:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2002:x1830881272855168:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065136.937970:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2002:x1830881272855168:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 105us (270us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.937976:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13504 00002000:00100000:1.0:1746065136.937981:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2d80 x1830881272855168/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.937988:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2d80 with x1830881272855168 ext(0->4095) 00002000:00010000:1.0:1746065136.937991:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a2d80 00000100:00100000:0.0:1746065136.939281:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.939344:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272855296 00000100:00100000:1.0:1746065136.939348:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272855296 00000100:00100000:1.0:1746065136.939369:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30140 00000100:00100000:1.0:1746065136.939374:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272855296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.939386:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.939399:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f7cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e573e expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.939419:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5737 expref: 47 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.939426:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.939427:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.939430:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f7cd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e573e expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.939451:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5737 expref: 47 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.939461:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5737 expref: 47 pid: 9642 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065136.939471:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267631872:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.940133:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.941694:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267631872:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.941716:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f7cd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e573e expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.941729:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e400, rc 0) 00000100:00100000:1.0:1746065136.941759:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272855296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2385us (2479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.941768:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30140 00000100:00100000:0.0:1746065136.943207:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.948181:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.948251:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.948317:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272855808 00000100:00100000:1.0:1746065136.948321:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272855808 00000100:00100000:1.0:1746065136.948341:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30141 00000100:00100000:1.0:1746065136.948346:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:1791:x1830881272855808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.948354:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.948368:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f7d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5745 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.948386:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f7cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e573e expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.948392:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.948393:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.948396:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f7d4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5745 expref: 49 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.948417:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f7cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e573e expref: 6 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.948426:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e400/0x392ae0376f87f7cd lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e573e expref: 6 pid: 9642 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065136.948436:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267632128:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065136.948481:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.950646:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267632128:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065136.950666:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f7d4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5745 expref: 48 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.950678:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065136.950942:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:1791:x1830881272855808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2594us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.950948:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30141 00000100:00100000:0.0:1746065136.951995:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.952046:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272855936 00000100:00100000:1.0:1746065136.952051:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272855936 00000100:00100000:1.0:1746065136.952072:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30142 00000100:00100000:1.0:1746065136.952077:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:1795:x1830881272855936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.952102:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.952112:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f7db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e574c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.952128:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.952132:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f7d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5745 expref: 49 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.952137:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.952140:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f7db lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e574c expref: 49 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.952162:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f7d4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5745 expref: 49 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.952170:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f7db lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e574c expref: 49 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.952181:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00000100:00100000:1.0:1746065136.952208:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:1795:x1830881272855936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 131us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.952216:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30142 00000100:00100000:0.0:1746065136.955176:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.958290:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.958482:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272856320 00000100:00100000:1.0:1746065136.958487:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272856320 00002000:00100000:1.0:1746065136.958513:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a3800 x1830881272856320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.958521:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a3800 with x1830881272856320 ext(0->4095) 00010000:00010000:1.0:1746065136.958527:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f7d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5745 expref: 49 pid: 9642 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065136.958538:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f7d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5745 expref: 49 pid: 9642 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065136.958544:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a3800 00000100:00100000:1.0:1746065136.958563:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2740 00000100:00100000:1.0:1746065136.958568:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881272856320:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.958758:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881272856320:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 189us (473us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.958764:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2740 00002000:00100000:1.0:1746065136.958768:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a3800 x1830881272856320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.958780:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a3800 with x1830881272856320 ext(0->4095) 00010000:00010000:1.0:1746065136.958784:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f7d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5745 expref: 49 pid: 9642 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065136.958792:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f7d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5745 expref: 49 pid: 9642 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065136.958797:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a3800 00000100:00100000:0.0:1746065136.964856:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.964948:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272856704 00000100:00100000:1.0:1746065136.964962:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272856704 00002000:00100000:1.0:1746065136.964990:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789f80 x1830881272856704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.964998:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789f80 with x1830881272856704 ext(0->4095) 00002000:00010000:1.0:1746065136.965002:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789f80 00000100:00100000:1.0:1746065136.965058:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13506 00000100:00100000:1.0:1746065136.965064:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2004:x1830881272856704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065136.965265:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2004:x1830881272856704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 200us (410us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.965271:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13506 00002000:00100000:1.0:1746065136.965276:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789f80 x1830881272856704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.965283:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789f80 with x1830881272856704 ext(0->4095) 00002000:00010000:1.0:1746065136.965285:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789f80 00000100:00100000:0.0:1746065136.966918:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.969691:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.973184:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.973252:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272857216 00000100:00100000:1.0:1746065136.973258:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272857216 00002000:00100000:1.0:1746065136.973290:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78aa00 x1830881272857216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.973299:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78aa00 with x1830881272857216 ext(0->4095) 00002000:00010000:1.0:1746065136.973303:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78aa00 00000100:00100000:1.0:1746065136.973644:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13507 00000100:00100000:1.0:1746065136.973651:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272857216:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065136.973753:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272857216:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 102us (575us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.973758:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13507 00002000:00100000:1.0:1746065136.973763:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78aa00 x1830881272857216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065136.973769:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78aa00 with x1830881272857216 ext(0->4095) 00002000:00010000:1.0:1746065136.973772:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78aa00 00000100:00100000:0.0:1746065136.974551:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.975197:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.975338:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272857472 00000100:00100000:1.0:1746065136.975342:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272857472 00000100:00100000:1.0:1746065136.975371:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30145 00000100:00100000:1.0:1746065136.975377:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:1795:x1830881272857472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065136.975383:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.975390:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5761 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.975403:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.975407:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f87f7e9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e575a expref: 50 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.975412:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.975415:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7f0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5761 expref: 50 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.975430:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f87f7e9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e575a expref: 50 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.975438:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87f7f0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5761 expref: 50 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.975446:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065136.975474:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:1795:x1830881272857472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 98us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.975479:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30145 00000100:00100000:0.0:1746065136.976539:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009385b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267632896:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065136.976553:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f87f7e9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e575a expref: 49 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.976561:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:0.0:1746065136.976580:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:1791:x1830881272857344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1838us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.976585:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30144 00000100:00100000:0.0:1746065136.977303:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.980139:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.982861:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.985229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.986870:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.988734:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.992359:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.994582:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065136.997889:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065136.999561:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.005548:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.009925:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.011064:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.015809:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.016185:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2743 00000100:00100000:1.0:1746065137.016193:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2004:x1830881272859904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.016288:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2004:x1830881272859904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (480us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.016293:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2743 00002000:00100000:1.0:1746065137.016298:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130178a80 x1830881272859904/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.016305:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130178a80 with x1830881272859904 ext(0->4095) 00010000:00010000:1.0:1746065137.016313:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f805 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5776 expref: 48 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.016321:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f805 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5776 expref: 48 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.016326:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130178a80 00000100:00100000:0.0:1746065137.018342:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.018537:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.022115:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.022250:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272860416 00000100:00100000:1.0:1746065137.022255:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272860416 00002000:00100000:1.0:1746065137.022280:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549fb80 x1830881272860416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.022289:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549fb80 with x1830881272860416 ext(0->4095) 00010000:00010000:1.0:1746065137.022295:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f80c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e577d expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.022305:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f80c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e577d expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.022310:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549fb80 00000100:00100000:1.0:1746065137.022501:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2744 00000100:00100000:1.0:1746065137.022508:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272860416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.022592:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272860416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 84us (478us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.022597:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2744 00002000:00100000:1.0:1746065137.022601:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549fb80 x1830881272860416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.022607:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549fb80 with x1830881272860416 ext(0->4095) 00010000:00010000:1.0:1746065137.022612:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f80c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e577d expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.022620:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f80c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e577d expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.022625:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549fb80 00000100:00100000:0.0:1746065137.024432:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.029156:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.032717:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.037694:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.039099:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.046653:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.050463:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.055742:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.063758:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.068393:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.069615:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2005:x1830881272862080:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 969us (1225us total) trans 4294972087 rc 0/0 00000100:00100000:0.0:1746065137.069622:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2746 00002000:00100000:0.0:1746065137.069628:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009de3f100 x1830881272862080/t4294972087(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.069635:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3f100 with x1830881272862080 ext(0->7) 00010000:00010000:0.0:1746065137.069640:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5792 expref: 50 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.069650:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5792 expref: 50 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.069655:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3f100 00000100:00100000:0.0:1746065137.071673:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.075880:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272862592 00000100:00100000:0.0:1746065137.075885:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272862592 00002000:00100000:0.0:1746065137.075911:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385b800 x1830881272862592/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.075920:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b800 with x1830881272862592 ext(0->4095) 00010000:00010000:0.0:1746065137.075926:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f828 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5799 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.075937:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f828 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5799 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.075943:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385b800 00000100:00100000:0.0:1746065137.075976:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2747 00000100:00100000:0.0:1746065137.075982:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272862592:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065137.076191:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272862592:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 208us (351us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065137.076196:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2747 00002000:00100000:0.0:1746065137.076201:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385b800 x1830881272862592/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.076209:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b800 with x1830881272862592 ext(0->4095) 00010000:00010000:0.0:1746065137.076213:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f828 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5799 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.076222:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f828 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5799 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.076228:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385b800 00000100:00100000:0.0:1746065137.077490:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.080964:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.084640:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272863104 00000100:00100000:0.0:1746065137.084648:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272863104 00000100:00100000:0.0:1746065137.084696:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30155 00000100:00100000:0.0:1746065137.084708:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272863104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065137.084721:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065137.089199:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.090862:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2004:x1830881272863232:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 725us (1663us total) trans 4294972088 rc 0/0 00000100:00100000:0.0:1746065137.090869:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2748 00002000:00100000:0.0:1746065137.090875:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009de3ed80 x1830881272863232/t4294972088(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.090882:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3ed80 with x1830881272863232 ext(0->7) 00010000:00010000:0.0:1746065137.090887:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f82f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a0 expref: 52 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.090896:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f82f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a0 expref: 52 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.090902:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3ed80 00000100:00100000:0.0:1746065137.097918:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.100149:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272863360 00000100:00100000:0.0:1746065137.100158:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272863360 00010000:00010000:0.0:1746065137.100193:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f82f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a0 expref: 52 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.103224:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14127 00000100:00100000:1.0:1746065137.103238:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2003:x1830881272863360:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.103252:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.103271:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f82f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a0 expref: 52 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.103284:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f82f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a0 expref: 52 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.103302:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f82f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a0 expref: 52 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.103324:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.103327:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.103333:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f836 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.103340:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f836 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.103369:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f836 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.103381:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267635840:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.103447:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.104957:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272863488 00000100:00100000:0.0:1746065137.104962:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272863488 00000100:00100000:0.0:1746065137.104992:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30156 00000100:00100000:0.0:1746065137.104996:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:1791:x1830881272863488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065137.105008:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.105021:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f87f83d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e57ae expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.105038:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f836 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.105045:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.105046:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.105049:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f87f83d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57ae expref: 53 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.105067:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f836 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.105076:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f836 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a7 expref: 5 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065137.105099:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009de3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267635968:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065137.105148:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.108571:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.108588:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272863744 00000100:00100000:0.0:1746065137.108593:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272863744 00002000:00100000:0.0:1746065137.108620:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3e300 x1830881272863744/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.108629:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3e300 with x1830881272863744 ext(0->4095) 00010000:00010000:0.0:1746065137.108634:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f836 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a7 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.108645:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f836 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a7 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.108650:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3e300 00000100:00100000:0.0:1746065137.108664:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2749 00000100:00100000:0.0:1746065137.108670:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272863744:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065137.108764:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272863744:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 94us (193us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065137.108770:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2749 00002000:00100000:0.0:1746065137.108774:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3e300 x1830881272863744/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.108782:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3e300 with x1830881272863744 ext(0->4095) 00010000:00010000:0.0:1746065137.108786:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f836 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a7 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.108795:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87f836 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57a7 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.108800:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3e300 00000100:00100000:0.0:1746065137.112430:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.115366:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.119300:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.122677:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.123875:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881272864384:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 834us (1197us total) trans 4294972089 rc 0/0 00000100:00100000:0.0:1746065137.123882:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2750 00002000:00100000:0.0:1746065137.123887:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009dc3b480 x1830881272864384/t4294972089(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.123895:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3b480 with x1830881272864384 ext(0->7) 00010000:00010000:0.0:1746065137.123900:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f87f83d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57ae expref: 54 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.123909:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f87f83d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57ae expref: 54 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.123914:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc3b480 00000100:00100000:0.0:1746065137.126247:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.131128:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.133202:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.133817:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267636480:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065137.133831:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87f84b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57bc expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.133841:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:0.0:1746065137.133859:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:1791:x1830881272864640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2627us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.133866:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30158 00000100:00100000:0.0:1746065137.136783:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.142145:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.142254:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272865280 00000100:00100000:1.0:1746065137.142259:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272865280 00002000:00100000:1.0:1746065137.142295:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8bb80 x1830881272865280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.142304:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8bb80 with x1830881272865280 ext(0->4095) 00002000:00010000:1.0:1746065137.142308:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8bb80 00000100:00100000:1.0:1746065137.142337:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13514 00000100:00100000:1.0:1746065137.142344:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881272865280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.142655:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881272865280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 311us (516us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.142660:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13514 00002000:00100000:1.0:1746065137.142665:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8bb80 x1830881272865280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.142672:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8bb80 with x1830881272865280 ext(0->4095) 00002000:00010000:1.0:1746065137.142675:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8bb80 00000100:00100000:0.0:1746065137.145889:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.152513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.152638:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272865536 00000100:00100000:1.0:1746065137.152645:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272865536 00002000:00100000:1.0:1746065137.152683:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8801306a0000 x1830881272865536/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.152693:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0000 with x1830881272865536 ext(0->7) 00010000:00010000:1.0:1746065137.152700:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87f84b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57bc expref: 54 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.152714:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87f84b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57bc expref: 54 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.152719:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a0000 00000100:00100000:1.0:1746065137.152751:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2752 00000100:00100000:1.0:1746065137.152758:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881272865536:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065137.154332:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881272865536:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1571us (1823us total) trans 4294972090 rc 0/0 00000100:00100000:0.0:1746065137.154339:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2752 00002000:00100000:0.0:1746065137.154346:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8801306a0000 x1830881272865536/t4294972090(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.154353:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0000 with x1830881272865536 ext(0->7) 00010000:00010000:0.0:1746065137.154359:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87f84b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57bc expref: 56 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.154370:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87f84b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57bc expref: 56 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.154375:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a0000 00000100:00100000:0.0:1746065137.156872:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.160347:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.160827:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272865920 00000100:00100000:1.0:1746065137.160833:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272865920 00002000:00100000:1.0:1746065137.160862:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1c00 x1830881272865920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.160870:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1c00 with x1830881272865920 ext(0->4095) 00002000:00010000:1.0:1746065137.160875:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a1c00 00000100:00100000:1.0:1746065137.160889:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13515 00000100:00100000:1.0:1746065137.160894:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272865920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.161009:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272865920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 114us (663us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.161015:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13515 00002000:00100000:1.0:1746065137.161020:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1c00 x1830881272865920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.161026:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1c00 with x1830881272865920 ext(0->4095) 00002000:00010000:1.0:1746065137.161028:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a1c00 00000100:00100000:0.0:1746065137.165298:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.166522:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.166965:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30161 00000100:00100000:1.0:1746065137.166972:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1791:x1830881272866176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.166979:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.166985:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f860 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e57d1 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.166995:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.166999:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f859 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57ca expref: 58 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.167003:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.167006:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f860 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57d1 expref: 58 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.167024:0:9642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f859 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57ca expref: 58 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.167034:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f860 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57d1 expref: 58 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.167043:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00000100:00100000:1.0:1746065137.167067:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1791:x1830881272866176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 95us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.167072:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30161 00000100:00100000:0.0:1746065137.169900:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.172650:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.174760:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.175587:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.177230:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.178585:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.178917:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.180844:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.182620:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.184435:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.186045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.196126:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.196981:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2002:x1830881272868224:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 612us (861us total) trans 4294972091 rc 0/0 00000100:00100000:0.0:1746065137.196987:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2756 00002000:00100000:0.0:1746065137.196992:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a091f480 x1830881272868224/t4294972091(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.196998:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f480 with x1830881272868224 ext(0->7) 00010000:00010000:0.0:1746065137.197002:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87f86e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57df expref: 58 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.197010:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87f86e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57df expref: 58 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.197015:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091f480 00000100:00100000:0.0:1746065137.202556:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.207407:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.207485:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272868608 00000100:00100000:1.0:1746065137.207492:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272868608 00002000:00100000:1.0:1746065137.207528:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc11880 x1830881272868608/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.207537:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc11880 with x1830881272868608 ext(0->4095) 00002000:00010000:1.0:1746065137.207542:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc11880 00000100:00100000:1.0:1746065137.207560:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13517 00000100:00100000:1.0:1746065137.207568:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272868608:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065137.207673:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272868608:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 105us (273us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.207678:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13517 00002000:00100000:1.0:1746065137.207683:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc11880 x1830881272868608/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.207690:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc11880 with x1830881272868608 ext(0->4095) 00002000:00010000:1.0:1746065137.207693:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc11880 00000100:00100000:0.0:1746065137.209193:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.211429:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.214942:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.219602:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.219817:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272869248 00000100:00100000:1.0:1746065137.219823:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272869248 00002000:00100000:1.0:1746065137.219853:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dfff480 x1830881272869248/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.219862:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfff480 with x1830881272869248 ext(0->4095) 00010000:00010000:1.0:1746065137.219869:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f87c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57ed expref: 59 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.219891:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f87c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57ed expref: 59 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.219898:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dfff480 00000100:00100000:1.0:1746065137.219921:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2757 00000100:00100000:1.0:1746065137.219928:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2004:x1830881272869248:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.220039:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2004:x1830881272869248:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 112us (438us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.220045:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2757 00002000:00100000:1.0:1746065137.220049:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dfff480 x1830881272869248/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.220057:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfff480 with x1830881272869248 ext(0->4095) 00010000:00010000:1.0:1746065137.220061:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f87c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57ed expref: 59 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.220070:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f87c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57ed expref: 59 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.220075:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dfff480 00000100:00100000:0.0:1746065137.225034:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.225162:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.238387:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.245418:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272869888 00000100:00100000:0.0:1746065137.245426:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272869888 00000100:00100000:0.0:1746065137.245904:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30168 00000100:00100000:0.0:1746065137.245913:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1791:x1830881272869888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065137.245932:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.245946:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8f8000/0x392ae0376f87f891 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5802 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.245977:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065137.245983:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f88a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57fb expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.245988:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065137.245991:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8f8000/0x392ae0376f87f891 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5802 expref: 59 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.246018:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f88a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e57fb expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.246029:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8f8000/0x392ae0376f87f891 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5802 expref: 59 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.246037:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8f8000, rc 0) 00000100:00100000:0.0:1746065137.246860:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1791:x1830881272869888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 947us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.246866:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30168 00000100:00100000:0.0:1746065137.250852:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.254358:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.256769:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.259663:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.262624:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.264220:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.264258:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272871168 00000100:00100000:1.0:1746065137.264263:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272871168 00002000:00100000:1.0:1746065137.264288:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0a80 x1830881272871168/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.264296:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0a80 with x1830881272871168 ext(0->4095) 00002000:00010000:1.0:1746065137.264299:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b0a80 00000100:00100000:1.0:1746065137.264325:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13519 00000100:00100000:1.0:1746065137.264331:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272871168:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065137.264427:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272871168:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 96us (209us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.264433:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13519 00002000:00100000:1.0:1746065137.264438:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0a80 x1830881272871168/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.264444:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0a80 with x1830881272871168 ext(0->4095) 00002000:00010000:1.0:1746065137.264447:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b0a80 00000100:00100000:0.0:1746065137.265453:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.267234:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.270311:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.270373:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272871808 00000100:00100000:1.0:1746065137.270379:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272871808 00002000:00100000:1.0:1746065137.270506:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0700 x1830881272871808/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.270515:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0700 with x1830881272871808 ext(0->4095) 00010000:00010000:1.0:1746065137.270521:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f89f lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5810 expref: 60 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.270532:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f89f lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5810 expref: 60 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.270538:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b0700 00000100:00100000:1.0:1746065137.270556:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2760 00000100:00100000:1.0:1746065137.270561:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881272871808:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.270786:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881272871808:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 224us (477us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.270792:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2760 00002000:00100000:1.0:1746065137.270797:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0700 x1830881272871808/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.270804:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0700 with x1830881272871808 ext(0->4095) 00010000:00010000:1.0:1746065137.270808:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f89f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5810 expref: 59 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.270817:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f89f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5810 expref: 59 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.270823:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b0700 00000100:00100000:0.0:1746065137.272942:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.273828:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.277025:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.277155:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272872320 00000100:00100000:1.0:1746065137.277160:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272872320 00002000:00100000:1.0:1746065137.277187:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091a300 x1830881272872320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.277196:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091a300 with x1830881272872320 ext(0->4095) 00010000:00010000:1.0:1746065137.277201:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f8a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5817 expref: 58 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.277209:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f8a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5817 expref: 58 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.277237:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091a300 00000100:00100000:1.0:1746065137.277253:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2761 00000100:00100000:1.0:1746065137.277259:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881272872320:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.277343:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881272872320:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 84us (320us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.277347:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2761 00002000:00100000:1.0:1746065137.277350:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091a300 x1830881272872320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.277355:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091a300 with x1830881272872320 ext(0->4095) 00010000:00010000:1.0:1746065137.277358:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f8a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5817 expref: 58 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.277363:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f8a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5817 expref: 58 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.277367:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091a300 00000100:00100000:0.0:1746065137.278859:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.278901:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272872448 00000100:00100000:1.0:1746065137.278906:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272872448 00000100:00100000:0.0:1746065137.278909:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.278936:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30173 00000100:00100000:1.0:1746065137.278942:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1791:x1830881272872448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.278962:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.278975:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f8b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5825 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.278992:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.278997:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f8ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e581e expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.279002:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065137.279005:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f8b4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5825 expref: 59 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.279030:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87f8ad lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e581e expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.279039:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f8b4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5825 expref: 59 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.279051:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065137.279101:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1791:x1830881272872448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 139us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.279107:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30173 00000100:00100000:0.0:1746065137.280697:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.283780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.290270:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.295513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.298824:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.299616:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.301838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.303795:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.305715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.307163:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.309040:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.309605:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272874496 00000100:00100000:1.0:1746065137.309611:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272874496 00002000:00100000:1.0:1746065137.309635:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d6c9c00 x1830881272874496/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.309642:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9c00 with x1830881272874496 ext(0->7) 00010000:00010000:1.0:1746065137.309647:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87f8c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5833 expref: 58 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.309657:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87f8c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5833 expref: 58 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.309663:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9c00 00000100:00100000:1.0:1746065137.309675:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2764 00000100:00100000:1.0:1746065137.309680:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2002:x1830881272874496:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065137.310659:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2002:x1830881272874496:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 976us (1617us total) trans 4294972092 rc 0/0 00000100:00100000:0.0:1746065137.310665:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2764 00002000:00100000:0.0:1746065137.310670:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d6c9c00 x1830881272874496/t4294972092(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.310677:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9c00 with x1830881272874496 ext(0->7) 00010000:00010000:0.0:1746065137.310682:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87f8c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5833 expref: 60 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.310690:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87f8c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5833 expref: 60 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.310695:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9c00 00000100:00100000:0.0:1746065137.312754:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.315535:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.315734:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272874880 00000100:00100000:1.0:1746065137.315739:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272874880 00002000:00100000:1.0:1746065137.315769:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cbb80 x1830881272874880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.315777:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cbb80 with x1830881272874880 ext(0->4095) 00002000:00010000:1.0:1746065137.315781:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cbb80 00000100:00100000:1.0:1746065137.315810:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13522 00000100:00100000:1.0:1746065137.315815:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272874880:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065137.316243:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272874880:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 427us (711us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.316249:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13522 00002000:00100000:1.0:1746065137.316254:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cbb80 x1830881272874880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.316260:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cbb80 with x1830881272874880 ext(0->4095) 00002000:00010000:1.0:1746065137.316262:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cbb80 00000100:00100000:0.0:1746065137.318061:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.323345:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.328890:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.329025:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272875392 00000100:00100000:1.0:1746065137.329032:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272875392 00002000:00100000:1.0:1746065137.329066:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c2d80 x1830881272875392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.329076:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2d80 with x1830881272875392 ext(0->4095) 00002000:00010000:1.0:1746065137.329108:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c2d80 00000100:00100000:0.0:1746065137.329787:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13523 00000100:00100000:0.0:1746065137.329795:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881272875392:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065137.329910:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881272875392:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 116us (1024us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065137.329916:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13523 00002000:00100000:0.0:1746065137.329922:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c2d80 x1830881272875392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.329929:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2d80 with x1830881272875392 ext(0->4095) 00002000:00010000:0.0:1746065137.329932:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c2d80 00000100:00100000:0.0:1746065137.332855:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.336433:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.338240:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2005:x1830881272875648:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1568us (1804us total) trans 4294972093 rc 0/0 00000100:00100000:0.0:1746065137.338248:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2765 00002000:00100000:0.0:1746065137.338253:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f7c3480 x1830881272875648/t4294972093(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.338260:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3480 with x1830881272875648 ext(0->7) 00010000:00010000:0.0:1746065137.338266:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f8d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5841 expref: 62 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.338276:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f8d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5841 expref: 62 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.338282:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c3480 00000100:00100000:0.0:1746065137.343921:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.343999:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.346290:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.346368:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272876160 00000100:00100000:1.0:1746065137.346372:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272876160 00002000:00100000:1.0:1746065137.346395:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0700 x1830881272876160/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.346404:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0700 with x1830881272876160 ext(0->4095) 00010000:00010000:1.0:1746065137.346409:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f8d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5848 expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.346419:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f8d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5848 expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.346430:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0700 00000100:00100000:1.0:1746065137.346454:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2766 00000100:00100000:1.0:1746065137.346460:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272876160:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.346785:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272876160:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 325us (495us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.346870:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2766 00002000:00100000:1.0:1746065137.346876:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0700 x1830881272876160/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.346883:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0700 with x1830881272876160 ext(0->4095) 00010000:00010000:1.0:1746065137.346888:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f8d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5848 expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.346897:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f8d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5848 expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.346903:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0700 00000100:00100000:0.0:1746065137.348156:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.350630:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.350698:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272876544 00000100:00100000:1.0:1746065137.350702:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272876544 00002000:00100000:1.0:1746065137.350724:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a4700 x1830881272876544/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.350729:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4700 with x1830881272876544 ext(0->4095) 00002000:00010000:1.0:1746065137.350732:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a4700 00000100:00100000:1.0:1746065137.350752:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13524 00000100:00100000:1.0:1746065137.350757:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2005:x1830881272876544:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.350854:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2005:x1830881272876544:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 96us (224us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.350860:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13524 00002000:00100000:1.0:1746065137.350865:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a4700 x1830881272876544/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.350871:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4700 with x1830881272876544 ext(0->4095) 00002000:00010000:1.0:1746065137.350873:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a4700 00000100:00100000:0.0:1746065137.352784:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.354808:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.354942:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272876800 00000100:00100000:1.0:1746065137.354946:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272876800 00002000:00100000:1.0:1746065137.354980:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800979a5f80 x1830881272876800/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.354988:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5f80 with x1830881272876800 ext(0->7) 00010000:00010000:1.0:1746065137.354992:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87f8de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e584f expref: 62 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.355002:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87f8de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e584f expref: 62 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.355006:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a5f80 00000100:00100000:1.0:1746065137.355019:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2767 00000100:00100000:1.0:1746065137.355024:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2002:x1830881272876800:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065137.356607:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2002:x1830881272876800:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1580us (1797us total) trans 4294972094 rc 0/0 00000100:00100000:0.0:1746065137.356614:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2767 00002000:00100000:0.0:1746065137.356620:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800979a5f80 x1830881272876800/t4294972094(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.356627:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5f80 with x1830881272876800 ext(0->7) 00010000:00010000:0.0:1746065137.356632:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87f8de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e584f expref: 64 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.356641:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87f8de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e584f expref: 64 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.356646:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a5f80 00000100:00100000:0.0:1746065137.358344:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.360981:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.361115:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272877184 00000100:00100000:1.0:1746065137.361120:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272877184 00002000:00100000:1.0:1746065137.361147:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb67480 x1830881272877184/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.361502:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67480 with x1830881272877184 ext(0->4095) 00002000:00010000:1.0:1746065137.361505:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb67480 00000100:00100000:1.0:1746065137.361529:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13525 00000100:00100000:1.0:1746065137.361536:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272877184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.361634:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272877184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (655us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.361639:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13525 00002000:00100000:1.0:1746065137.361644:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb67480 x1830881272877184/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.361650:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67480 with x1830881272877184 ext(0->4095) 00002000:00010000:1.0:1746065137.361653:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb67480 00000100:00100000:0.0:1746065137.363754:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.364861:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272877440 00000100:00100000:0.0:1746065137.364870:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272877440 00000100:00100000:0.0:1746065137.364896:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30182 00000100:00100000:0.0:1746065137.364901:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:1791:x1830881272877440:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065137.364907:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.364913:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f87f8f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5864 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.364924:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.364927:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f8ec lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e585d expref: 66 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.364931:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065137.364934:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f87f8f3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5864 expref: 66 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.364960:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f8ec lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e585d expref: 66 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.364977:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f87f8f3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5864 expref: 66 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.364985:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727dec00, rc 0) 00000100:00100000:0.0:1746065137.365006:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:1791:x1830881272877440:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.365010:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30182 00000100:00100000:0.0:1746065137.367544:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.370133:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.370243:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272877824 00000100:00100000:1.0:1746065137.370248:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272877824 00002000:00100000:1.0:1746065137.370274:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64a80 x1830881272877824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.370518:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64a80 with x1830881272877824 ext(0->4095) 00010000:00010000:1.0:1746065137.370527:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e585d expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.370537:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e585d expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.370543:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64a80 00000100:00100000:1.0:1746065137.370567:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2768 00000100:00100000:1.0:1746065137.370573:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2004:x1830881272877824:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.370838:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2004:x1830881272877824:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 265us (704us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.370844:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2768 00002000:00100000:1.0:1746065137.370850:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64a80 x1830881272877824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.370856:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64a80 with x1830881272877824 ext(0->4095) 00010000:00010000:1.0:1746065137.370860:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e585d expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.370869:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e585d expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.370873:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64a80 00000100:00100000:0.0:1746065137.372715:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.374379:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.377321:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.377387:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272878336 00000100:00100000:1.0:1746065137.377392:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272878336 00002000:00100000:1.0:1746065137.377415:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54aa00 x1830881272878336/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.377421:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54aa00 with x1830881272878336 ext(0->4095) 00010000:00010000:1.0:1746065137.377426:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f87f8f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5864 expref: 64 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.377434:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f87f8f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5864 expref: 64 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.377438:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54aa00 00000100:00100000:1.0:1746065137.377458:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2769 00000100:00100000:1.0:1746065137.377461:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881272878336:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.377534:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881272878336:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 73us (216us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.377538:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2769 00002000:00100000:1.0:1746065137.377541:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54aa00 x1830881272878336/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.377545:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54aa00 with x1830881272878336 ext(0->4095) 00010000:00010000:1.0:1746065137.377548:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f87f8f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5864 expref: 64 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.377553:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f87f8f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5864 expref: 64 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.377557:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54aa00 00000100:00100000:0.0:1746065137.379793:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.380560:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.383575:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.383641:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272878848 00000100:00100000:1.0:1746065137.383646:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272878848 00002000:00100000:1.0:1746065137.383672:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54bb80 x1830881272878848/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.383680:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54bb80 with x1830881272878848 ext(0->4095) 00010000:00010000:1.0:1746065137.383686:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f8fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e586b expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.383698:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f8fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e586b expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.383709:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54bb80 00000100:00100000:1.0:1746065137.383735:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2770 00000100:00100000:1.0:1746065137.383741:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272878848:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.384131:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272878848:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 389us (555us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.384138:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2770 00002000:00100000:1.0:1746065137.384143:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54bb80 x1830881272878848/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.384151:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54bb80 with x1830881272878848 ext(0->4095) 00010000:00010000:1.0:1746065137.384155:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f8fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e586b expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.384164:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f8fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e586b expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.384170:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54bb80 00000100:00100000:0.0:1746065137.386697:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.391277:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.391444:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272879232 00000100:00100000:1.0:1746065137.391450:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272879232 00002000:00100000:1.0:1746065137.391477:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548000 x1830881272879232/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.391486:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548000 with x1830881272879232 ext(0->4095) 00002000:00010000:1.0:1746065137.391490:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548000 00000100:00100000:1.0:1746065137.391516:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13526 00000100:00100000:1.0:1746065137.391523:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881272879232:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.391620:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881272879232:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (363us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.391625:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13526 00002000:00100000:1.0:1746065137.391630:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548000 x1830881272879232/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.391637:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548000 with x1830881272879232 ext(0->4095) 00002000:00010000:1.0:1746065137.391639:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548000 00000100:00100000:0.0:1746065137.395078:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.397356:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.400250:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.401708:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.403879:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.404506:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.406388:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.409428:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.409742:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.410370:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272880512 00000100:00100000:1.0:1746065137.410373:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272880512 00000100:00100000:1.0:1746065137.410399:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30188 00000100:00100000:1.0:1746065137.410404:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:1791:x1830881272880512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.410413:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.410421:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f91d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e588e expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.410434:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f87f916 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5887 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.410439:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.410440:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.410443:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f91d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e588e expref: 65 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.410458:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f87f916 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5887 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.410471:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f87f916 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5887 expref: 5 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.410479:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267644160:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065137.410518:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.412589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.412623:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272880896 00000100:00100000:1.0:1746065137.412627:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272880896 00002000:00100000:1.0:1746065137.412654:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549f80 x1830881272880896/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.412662:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549f80 with x1830881272880896 ext(0->4095) 00010000:00010000:1.0:1746065137.412668:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f87f916 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5887 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.412678:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f87f916 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5887 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.412684:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549f80 00000100:00100000:1.0:1746065137.413038:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2772 00000100:00100000:1.0:1746065137.413044:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272880896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.413324:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272880896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 279us (737us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.413329:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2772 00002000:00100000:1.0:1746065137.413334:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549f80 x1830881272880896/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.413345:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549f80 with x1830881272880896 ext(0->4095) 00010000:00010000:1.0:1746065137.413349:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f87f916 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5887 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.413358:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f87f916 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5887 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.413364:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549f80 00000100:00100000:1.0:1746065137.413387:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267644160:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065137.413399:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f91d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e588e expref: 64 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.413409:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065137.413425:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:1791:x1830881272880512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3021us (4002us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.413430:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30188 00000100:00100000:0.0:1746065137.415813:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.419758:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.420006:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272881280 00000100:00100000:1.0:1746065137.420012:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272881280 00002000:00100000:1.0:1746065137.420042:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b100 x1830881272881280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.420051:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b100 with x1830881272881280 ext(0->4095) 00002000:00010000:1.0:1746065137.420055:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54b100 00000100:00100000:1.0:1746065137.420196:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13528 00000100:00100000:1.0:1746065137.420202:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881272881280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.420299:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881272881280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 97us (542us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.420305:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13528 00002000:00100000:1.0:1746065137.420311:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b100 x1830881272881280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.420318:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b100 with x1830881272881280 ext(0->4095) 00002000:00010000:1.0:1746065137.420320:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54b100 00000100:00100000:0.0:1746065137.422685:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.422750:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272881408 00000100:00100000:1.0:1746065137.422757:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272881408 00000100:00100000:1.0:1746065137.422823:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30189 00000100:00100000:1.0:1746065137.422829:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272881408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.422841:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.422855:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f924 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5895 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.422877:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f91d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e588e expref: 63 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.422884:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.422885:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.422888:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f924 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5895 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.422910:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f91d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e588e expref: 63 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.422923:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f91d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e588e expref: 63 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.422933:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267644416:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065137.423001:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.424877:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267644416:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065137.424898:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f924 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5895 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.424911:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065137.424961:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272881408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2131us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.424967:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30189 00000100:00100000:0.0:1746065137.425860:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.429726:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.431530:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.431586:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272881920 00000100:00100000:1.0:1746065137.431590:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272881920 00000100:00100000:1.0:1746065137.431616:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30190 00000100:00100000:1.0:1746065137.431620:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:1791:x1830881272881920:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.431628:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.431640:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f92b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e589c expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.431661:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f924 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5895 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.431671:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.431672:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.431675:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f92b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e589c expref: 64 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.431694:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5895 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.431702:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87f924 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5895 expref: 5 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.431711:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267644672:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065137.431767:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.432537:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.433980:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267644672:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065137.433996:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f92b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e589c expref: 65 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.434005:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00000100:00100000:1.0:1746065137.434310:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:1791:x1830881272881920:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2687us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.434315:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30190 00000100:00100000:0.0:1746065137.434482:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.436347:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.436608:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272882432 00000100:00100000:1.0:1746065137.436613:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272882432 00002000:00100000:1.0:1746065137.436640:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b800 x1830881272882432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.436654:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b800 with x1830881272882432 ext(0->4095) 00010000:00010000:1.0:1746065137.436660:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f92b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e589c expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.436671:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f92b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e589c expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.436676:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54b800 00000100:00100000:1.0:1746065137.436696:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2773 00000100:00100000:1.0:1746065137.436701:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2004:x1830881272882432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.436784:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2004:x1830881272882432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 83us (440us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.436789:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2773 00002000:00100000:1.0:1746065137.436793:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b800 x1830881272882432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.436799:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b800 with x1830881272882432 ext(0->4095) 00010000:00010000:1.0:1746065137.436802:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f92b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e589c expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.436810:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f92b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e589c expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.436815:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54b800 00000100:00100000:0.0:1746065137.438400:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.441801:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.445213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.445368:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272882944 00000100:00100000:1.0:1746065137.445374:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272882944 00000100:00100000:1.0:1746065137.445515:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30192 00000100:00100000:1.0:1746065137.445521:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272882944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.445533:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.445547:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f939 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e58aa expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.445567:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58a3 expref: 63 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.445573:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.445574:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.445577:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f939 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58aa expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.445599:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58a3 expref: 63 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.445609:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87f932 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58a3 expref: 63 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.445618:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267645184:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065137.445932:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.447116:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267645184:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065137.447131:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f939 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58aa expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.447140:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00000100:00100000:1.0:1746065137.447162:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272882944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1642us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.447168:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30192 00000100:00100000:0.0:1746065137.447909:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.452590:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.453037:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.453305:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272883456 00000100:00100000:1.0:1746065137.453309:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272883456 00000100:00100000:1.0:1746065137.453339:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30193 00000100:00100000:1.0:1746065137.453345:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:1791:x1830881272883456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.453354:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.453365:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87f940 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e58b1 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.453386:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f939 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58aa expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.453392:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.453393:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.453396:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87f940 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58b1 expref: 64 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.453421:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f939 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58aa expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.453432:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f939 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58aa expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.453442:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267645440:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065137.453485:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746065137.453840:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1fb80 x1830881272883328/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.453852:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1fb80 with x1830881272883328 ext(0->4095) 00010000:00010000:2.0:1746065137.453858:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f939 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58aa expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.453868:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87f939 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58aa expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.453873:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1fb80 00000100:00100000:0.0:1746065137.455387:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.455621:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267645440:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065137.456131:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87f940 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58b1 expref: 66 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.456141:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:1.0:1746065137.456180:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:1791:x1830881272883456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2835us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.456186:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30193 00000100:00100000:0.0:1746065137.457614:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.460064:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.460333:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272883968 00000100:00100000:1.0:1746065137.460338:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272883968 00002000:00100000:1.0:1746065137.460364:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1c380 x1830881272883968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.460373:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1c380 with x1830881272883968 ext(0->4095) 00010000:00010000:1.0:1746065137.460378:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87f940 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58b1 expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.460389:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87f940 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58b1 expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.460395:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1c380 00000100:00100000:1.0:1746065137.460420:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2775 00000100:00100000:1.0:1746065137.460426:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2004:x1830881272883968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.460509:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2004:x1830881272883968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 83us (446us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.460514:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2775 00002000:00100000:1.0:1746065137.460518:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1c380 x1830881272883968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.460525:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1c380 with x1830881272883968 ext(0->4095) 00010000:00010000:1.0:1746065137.460529:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87f940 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58b1 expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.460536:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87f940 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58b1 expref: 65 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.460542:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1c380 00000100:00100000:0.0:1746065137.462321:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.467124:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.467599:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272884352 00000100:00100000:2.0:1746065137.467604:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272884352 00002000:00100000:2.0:1746065137.467633:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1e300 x1830881272884352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.467641:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1e300 with x1830881272884352 ext(0->4095) 00002000:00010000:2.0:1746065137.467645:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1e300 00000100:00100000:2.0:1746065137.467670:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13532 00000100:00100000:2.0:1746065137.467675:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881272884352:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.467778:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881272884352:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (659us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.467783:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13532 00002000:00100000:2.0:1746065137.467788:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1e300 x1830881272884352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.467796:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1e300 with x1830881272884352 ext(0->4095) 00002000:00010000:2.0:1746065137.467798:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1e300 00000100:00100000:0.0:1746065137.470938:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.472932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.475624:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.475674:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272884864 00000100:00100000:1.0:1746065137.475679:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272884864 00002000:00100000:1.0:1746065137.475713:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c322a00 x1830881272884864/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.475722:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322a00 with x1830881272884864 ext(0->4095) 00002000:00010000:1.0:1746065137.475726:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c322a00 00000100:00100000:1.0:1746065137.475794:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13533 00000100:00100000:1.0:1746065137.475801:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272884864:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.476007:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272884864:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 205us (382us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.476014:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13533 00002000:00100000:1.0:1746065137.476019:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c322a00 x1830881272884864/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.476026:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322a00 with x1830881272884864 ext(0->4095) 00002000:00010000:1.0:1746065137.476028:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c322a00 00000100:00100000:0.0:1746065137.476595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.477506:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.477538:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272885120 00000100:00100000:1.0:1746065137.477541:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272885120 00000100:00100000:1.0:1746065137.477606:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30197 00000100:00100000:1.0:1746065137.477611:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:1795:x1830881272885120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.477618:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.477624:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f95c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e58cd expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.477633:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.477637:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 66 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.477641:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.477644:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f95c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58cd expref: 66 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.477661:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 66 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.477670:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f95c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58cd expref: 66 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.477677:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065137.477705:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:1795:x1830881272885120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.477711:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30197 00000100:00100000:0.0:1746065137.478549:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.478611:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272885248 00000100:00100000:2.0:1746065137.478614:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272885248 00010000:00010000:2.0:1746065137.478626:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f94e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58bf expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.478652:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14168 00000100:00100000:2.0:1746065137.478657:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272885248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.478664:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.478679:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f94e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58bf expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.478687:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f94e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58bf expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.478703:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87f94e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58bf expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.478714:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.478716:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.478721:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 64 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.478727:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 64 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.478746:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 64 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.478758:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 64 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.478766:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267646464:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.478805:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.480730:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267646464:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.480742:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065137.480766:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.480807:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272885248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2148us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.480815:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14168 00000100:00100000:1.0:1746065137.481130:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272885504 00000100:00100000:1.0:1746065137.481136:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272885504 00002000:00100000:1.0:1746065137.481165:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c320700 x1830881272885504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.481173:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320700 with x1830881272885504 ext(0->4095) 00010000:00010000:1.0:1746065137.481179:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 65 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.481190:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 65 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.481196:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c320700 00000100:00100000:1.0:1746065137.481224:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2776 00000100:00100000:1.0:1746065137.481231:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2005:x1830881272885504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.481334:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2005:x1830881272885504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (567us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.481339:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2776 00002000:00100000:1.0:1746065137.481344:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c320700 x1830881272885504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.481352:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320700 with x1830881272885504 ext(0->4095) 00010000:00010000:1.0:1746065137.481356:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 65 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.481365:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 65 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.481370:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c320700 00000100:00100000:0.0:1746065137.483155:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.483339:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272885632 00000100:00100000:2.0:1746065137.483344:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272885632 00010000:00010000:2.0:1746065137.483361:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 65 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.483375:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14169 00000100:00100000:2.0:1746065137.483379:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2002:x1830881272885632:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.483386:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.483397:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 65 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.483404:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 65 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.483418:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87f955 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58c6 expref: 65 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.483433:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.483436:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.483441:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f95c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58cd expref: 64 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.483446:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f95c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58cd expref: 64 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.483464:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f95c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58cd expref: 64 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.483471:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267646592:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.483716:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.484876:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267646592:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.484888:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.484922:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2002:x1830881272885632:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1541us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.484928:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14169 00000100:00100000:0.0:1746065137.485178:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.486506:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.487914:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.488014:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272886144 00000100:00100000:2.0:1746065137.488019:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272886144 00010000:00010000:2.0:1746065137.488033:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f95c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58cd expref: 64 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.488049:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14170 00000100:00100000:2.0:1746065137.488169:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881272886144:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.488181:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.488193:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f95c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58cd expref: 64 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.488202:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f95c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58cd expref: 64 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.488222:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87f95c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58cd expref: 64 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.488244:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.488246:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.488251:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f963 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58d4 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.488259:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f963 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58d4 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.488279:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f963 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58d4 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.488288:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267646848:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.488330:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.489767:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.489837:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267646848:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.489853:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.489886:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:2005:x1830881272886144:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1831us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.489897:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14170 00000100:00100000:0.0:1746065137.491474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.493657:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.493769:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272886656 00000100:00100000:2.0:1746065137.493773:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272886656 00010000:00010000:2.0:1746065137.493790:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f963 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58d4 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.493819:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14171 00000100:00100000:2.0:1746065137.493825:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272886656:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.493832:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.493846:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f963 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58d4 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.493855:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f963 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58d4 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.493870:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87f963 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58d4 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.493891:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.493893:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.493899:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 63 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.493905:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 63 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.493925:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 63 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.493935:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267647104:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.494130:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.495527:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267647104:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065137.495527:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065137.495538:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.495566:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272886656:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1741us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.495573:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14171 00000100:00100000:1.0:1746065137.495634:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272886912 00000100:00100000:1.0:1746065137.495638:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272886912 00002000:00100000:1.0:1746065137.495660:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a093a300 x1830881272886912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.495669:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a093a300 with x1830881272886912 ext(0->4095) 00002000:00010000:1.0:1746065137.495673:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a093a300 00000100:00100000:1.0:1746065137.495694:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13536 00000100:00100000:1.0:1746065137.495699:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a093a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881272886912:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.495794:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a093a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881272886912:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 95us (270us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.495800:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13536 00002000:00100000:1.0:1746065137.495804:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a093a300 x1830881272886912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.495811:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a093a300 with x1830881272886912 ext(0->4095) 00002000:00010000:1.0:1746065137.495814:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a093a300 00000100:00100000:0.0:1746065137.497012:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.499350:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.499578:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272887168 00000100:00100000:1.0:1746065137.499584:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272887168 00002000:00100000:1.0:1746065137.499610:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072a06300 x1830881272887168/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.499619:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a06300 with x1830881272887168 ext(0->7) 00010000:00010000:1.0:1746065137.499625:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 64 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.499637:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 64 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.499647:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a06300 00000100:00100000:1.0:1746065137.499671:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2777 00000100:00100000:1.0:1746065137.499676:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881272887168:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065137.502142:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2005:x1830881272887168:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2459us (2788us total) trans 4294972095 rc 0/0 00000100:00100000:0.0:1746065137.502151:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2777 00002000:00100000:0.0:1746065137.502159:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072a06300 x1830881272887168/t4294972095(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.502167:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a06300 with x1830881272887168 ext(0->7) 00010000:00010000:0.0:1746065137.502174:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 66 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.502187:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 66 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.502258:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a06300 00000100:00100000:0.0:1746065137.504351:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.504433:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272887296 00000100:00100000:2.0:1746065137.504439:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272887296 00010000:00010000:2.0:1746065137.504463:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 66 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.504483:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14172 00000100:00100000:2.0:1746065137.504488:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2003:x1830881272887296:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.504499:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.504513:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 66 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.504523:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 66 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.504541:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f96a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58db expref: 66 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.504568:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.504571:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.504577:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f971 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.504584:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.504609:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.504620:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267647360:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.504673:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.505906:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.505968:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272887552 00000100:00100000:1.0:1746065137.505973:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272887552 00002000:00100000:1.0:1746065137.506000:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a05180 x1830881272887552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.506007:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a05180 with x1830881272887552 ext(0->4095) 00000100:00100000:2.0:1746065137.506010:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267647360:192.168.202.8@tcp:105: 00002000:00010000:1.0:1746065137.506011:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a05180 00010000:00010000:2.0:1746065137.506021:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.506033:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13537 00000100:00100000:1.0:1746065137.506039:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272887552:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746065137.506232:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2003:x1830881272887296:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1743us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.506235:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272887552:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 195us (329us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.506240:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14172 00000100:00100000:1.0:1746065137.506241:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13537 00002000:00100000:1.0:1746065137.506246:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a05180 x1830881272887552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.506253:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a05180 with x1830881272887552 ext(0->4095) 00002000:00010000:1.0:1746065137.506255:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a05180 00000100:00100000:0.0:1746065137.507900:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.510289:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.510366:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272887808 00000100:00100000:2.0:1746065137.510371:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272887808 00010000:00010000:2.0:1746065137.510391:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f971 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e2 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.510411:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14173 00000100:00100000:2.0:1746065137.510416:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272887808:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.510426:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.510440:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f971 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e2 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.510455:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e2 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.510473:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f971 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e2 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.510500:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.510502:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.510507:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 65 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.510513:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 65 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.510535:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 65 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.510554:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267647616:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.510608:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.513345:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267647616:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.513361:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.513409:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272887808:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2991us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.513418:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14173 00000100:00100000:0.0:1746065137.513516:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.513999:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272888064 00000100:00100000:2.0:1746065137.514005:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272888064 00002000:00100000:2.0:1746065137.514045:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04a80 x1830881272888064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.514054:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04a80 with x1830881272888064 ext(0->4095) 00002000:00010000:2.0:1746065137.514058:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04a80 00000100:00100000:2.0:1746065137.514105:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13538 00000100:00100000:2.0:1746065137.514112:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2002:x1830881272888064:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746065137.515273:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2002:x1830881272888064:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 1158us (1754us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.515280:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13538 00002000:00100000:2.0:1746065137.515286:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04a80 x1830881272888064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.515293:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04a80 with x1830881272888064 ext(0->4095) 00002000:00010000:2.0:1746065137.515297:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04a80 00000100:00100000:0.0:1746065137.518008:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.520926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.521938:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272888320 00000100:00100000:2.0:1746065137.521944:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272888320 00002000:00100000:2.0:1746065137.521981:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072978700 x1830881272888320/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.521989:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978700 with x1830881272888320 ext(0->7) 00010000:00010000:2.0:1746065137.521994:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 66 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.522004:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 66 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.522010:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978700 00000100:00100000:2.0:1746065137.522024:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2778 00000100:00100000:2.0:1746065137.522029:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2003:x1830881272888320:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065137.522866:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2003:x1830881272888320:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 835us (1942us total) trans 4294972096 rc 0/0 00000100:00100000:0.0:1746065137.522873:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2778 00002000:00100000:0.0:1746065137.522878:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072978700 x1830881272888320/t4294972096(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.522886:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978700 with x1830881272888320 ext(0->7) 00010000:00010000:0.0:1746065137.522890:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 68 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.522900:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 68 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.522905:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978700 00000100:00100000:0.0:1746065137.524015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.524459:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272888448 00000100:00100000:2.0:1746065137.524464:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272888448 00010000:00010000:2.0:1746065137.524485:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 68 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.524503:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14174 00000100:00100000:2.0:1746065137.524509:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2002:x1830881272888448:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.524517:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.524528:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 68 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.524536:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 68 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.524553:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87f978 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58e9 expref: 68 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.524567:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.524569:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.524575:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f97f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f0 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.524582:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f0 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.524610:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f0 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.524620:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267647872:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.524680:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.526038:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.526059:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272888704 00000100:00100000:0.0:1746065137.526062:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272888704 00002000:00100000:0.0:1746065137.526100:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297b100 x1830881272888704/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.526108:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297b100 with x1830881272888704 ext(0->4095) 00002000:00010000:0.0:1746065137.526111:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007297b100 00000100:00100000:0.0:1746065137.526481:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13539 00000100:00100000:0.0:1746065137.526492:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272888704:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:0.0:1746065137.526603:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272888704:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 113us (566us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065137.526609:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13539 00002000:00100000:0.0:1746065137.526614:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297b100 x1830881272888704/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.526621:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297b100 with x1830881272888704 ext(0->4095) 00002000:00010000:0.0:1746065137.526628:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007297b100 00000100:00100000:0.0:1746065137.528363:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272888832 00000100:00100000:0.0:1746065137.528367:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272888832 00000100:00100000:0.0:1746065137.528400:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30203 00000100:00100000:0.0:1746065137.528405:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:1795:x1830881272888832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065137.528414:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.528425:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f986 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e58f7 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.528445:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f97f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f0 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.528451:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.528452:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.528455:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f986 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f7 expref: 68 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.528475:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f0 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.528488:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f97f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f0 expref: 5 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065137.528497:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267648000:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065137.528767:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.530145:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267648000:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065137.530164:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f986 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f7 expref: 68 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.530174:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe70800, rc 0) 00000100:00100000:2.0:1746065137.530491:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:1795:x1830881272888832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2084us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.530497:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30203 00000100:00100000:0.0:1746065137.531034:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.534140:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.534848:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272889216 00000100:00100000:2.0:1746065137.534866:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272889216 00002000:00100000:2.0:1746065137.534908:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297bb80 x1830881272889216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.534934:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297bb80 with x1830881272889216 ext(0->4095) 00002000:00010000:2.0:1746065137.534938:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007297bb80 00000100:00100000:2.0:1746065137.534978:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13540 00000100:00100000:2.0:1746065137.534985:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2003:x1830881272889216:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746065137.535180:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2003:x1830881272889216:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 185us (1031us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.535195:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13540 00002000:00100000:2.0:1746065137.535201:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297bb80 x1830881272889216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.535207:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297bb80 with x1830881272889216 ext(0->4095) 00002000:00010000:2.0:1746065137.535210:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007297bb80 00000100:00100000:0.0:1746065137.536983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.537035:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272889344 00000100:00100000:2.0:1746065137.537039:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272889344 00000100:00100000:2.0:1746065137.537076:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30204 00000100:00100000:2.0:1746065137.537098:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272889344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.537109:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.537121:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f98d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e58fe expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.537141:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f986 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f7 expref: 67 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.537147:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.537149:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.537152:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f98d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58fe expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.537176:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f986 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f7 expref: 67 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.537186:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f7 expref: 67 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.537201:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267648256:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065137.537271:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.540582:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.540644:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272889472 00000100:00100000:1.0:1746065137.540650:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272889472 00000100:00100000:2.0:1746065137.540656:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267648256:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065137.540677:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f98d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58fe expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746065137.540683:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072979500 x1830881272889472/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1746065137.540690:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00002000:00100000:1.0:1746065137.540697:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072979500 with x1830881272889472 ext(0->7) 00010000:00010000:1.0:1746065137.540703:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f7 expref: 68 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.540714:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f7 expref: 68 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.540720:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072979500 00000100:00100000:2.0:1746065137.540730:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272889344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3648us (3751us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.540737:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30204 00000100:00100000:1.0:1746065137.540754:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2779 00000100:00100000:1.0:1746065137.540760:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2004:x1830881272889472:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065137.542237:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:2004:x1830881272889472:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1473us (1656us total) trans 4294972097 rc 0/0 00000100:00100000:0.0:1746065137.542245:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2779 00002000:00100000:0.0:1746065137.542251:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072979500 x1830881272889472/t4294972097(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.542258:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072979500 with x1830881272889472 ext(0->7) 00010000:00010000:0.0:1746065137.542263:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f7 expref: 70 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.542274:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58f7 expref: 70 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.542280:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072979500 00000100:00100000:0.0:1746065137.544982:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.546307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.546406:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272889728 00000100:00100000:2.0:1746065137.546410:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272889728 00000100:00100000:2.0:1746065137.546509:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30205 00000100:00100000:2.0:1746065137.546515:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:1791:x1830881272889728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.546527:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.546536:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f994 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5905 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.546552:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f98d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58fe expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.546557:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.546558:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.546561:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f994 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5905 expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.546582:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f98d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58fe expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.546591:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f98d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58fe expref: 5 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.546599:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267648512:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065137.546645:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.547444:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.547517:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272889984 00000100:00100000:0.0:1746065137.547521:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272889984 00002000:00100000:0.0:1746065137.547541:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b100 x1830881272889984/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.547549:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b100 with x1830881272889984 ext(0->4095) 00010000:00010000:0.0:1746065137.547554:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f98d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58fe expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.547563:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f98d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58fe expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.547568:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017b100 00000100:00100000:0.0:1746065137.547588:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2780 00000100:00100000:0.0:1746065137.547594:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272889984:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065137.547904:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272889984:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 310us (459us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065137.547910:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2780 00002000:00100000:0.0:1746065137.547915:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b100 x1830881272889984/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.547921:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b100 with x1830881272889984 ext(0->4095) 00010000:00010000:0.0:1746065137.547926:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f98d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58fe expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.547933:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87f98d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e58fe expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.547938:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017b100 00000100:00100000:2.0:1746065137.548058:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267648512:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065137.548069:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f994 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5905 expref: 70 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.548077:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065137.548124:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:1791:x1830881272889728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1609us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.548129:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30205 00000100:00100000:0.0:1746065137.549392:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.549602:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.549644:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272890240 00000100:00100000:2.0:1746065137.549647:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272890240 00000100:00100000:2.0:1746065137.549674:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30206 00000100:00100000:2.0:1746065137.549679:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1795:x1830881272890240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.549687:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.549697:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e590c expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.549719:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.549723:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f994 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5905 expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.549729:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.549731:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 8 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.549760:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f994 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5905 expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.549775:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 8 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.549781:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065137.549811:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:1795:x1830881272890240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 131us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.549816:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30206 00000100:00100000:2.0:1746065137.551376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.552935:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.552985:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272890752 00000100:00100000:2.0:1746065137.552990:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272890752 00000100:00100000:0.0:1746065137.553005:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.553016:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30207 00000100:00100000:2.0:1746065137.553021:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:1791:x1830881272890752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.553030:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.553039:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87f9a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5913 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.553062:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.553066:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.553071:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065137.553074:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87f9a2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5913 expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.553113:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.553395:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87f9a2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5913 expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.553403:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.553404:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.553409:0:9635:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.553415:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.553430:0:9635:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.553439:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 5 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.553453:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267649024:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.553508:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.555244:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.555333:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267649024:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.555345:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:2.0:1746065137.555371:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:1791:x1830881272890752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2350us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.555377:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30207 00000100:00100000:1.0:1746065137.555450:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272891008 00000100:00100000:1.0:1746065137.555455:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272891008 00002000:00100000:1.0:1746065137.555483:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbdf80 x1830881272891008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.555491:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdf80 with x1830881272891008 ext(0->4095) 00010000:00010000:1.0:1746065137.555496:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.555507:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.555512:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbdf80 00000100:00100000:1.0:1746065137.555536:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2782 00000100:00100000:1.0:1746065137.555542:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272891008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.556042:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272891008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 496us (797us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.556047:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2782 00002000:00100000:1.0:1746065137.556052:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbdf80 x1830881272891008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.556059:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdf80 with x1830881272891008 ext(0->4095) 00010000:00010000:1.0:1746065137.556063:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.556072:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f87f99b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e590c expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.556077:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbdf80 00000100:00100000:0.0:1746065137.558331:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.559976:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.560018:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272891392 00000100:00100000:2.0:1746065137.560023:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272891392 00002000:00100000:2.0:1746065137.560046:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbc000 x1830881272891392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.560054:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc000 with x1830881272891392 ext(0->4095) 00002000:00010000:2.0:1746065137.560058:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbc000 00000100:00100000:0.0:1746065137.561624:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.561667:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272891520 00000100:00100000:2.0:1746065137.561672:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272891520 00000100:00100000:2.0:1746065137.561702:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30208 00000100:00100000:2.0:1746065137.561708:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272891520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.561716:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.561727:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f9a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e591a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.561746:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87f9a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5913 expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.561757:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.561758:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.561762:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f9a9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e591a expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.561780:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87f9a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5913 expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.561789:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87f9a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5913 expref: 69 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.561803:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267649280:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065137.561863:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.562819:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267649280:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065137.562832:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f9a9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e591a expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.562841:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065a00, rc 0) 00000100:00100000:0.0:1746065137.562844:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.562897:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272891520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1160us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.562903:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30208 00000100:00100000:0.0:1746065137.564843:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.566245:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.566347:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272892032 00000100:00100000:0.0:1746065137.566352:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272892032 00000100:00100000:0.0:1746065137.566383:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30209 00000100:00100000:0.0:1746065137.566389:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:1795:x1830881272892032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065137.566398:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.566410:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f9b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5921 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.566428:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f9a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e591a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.566434:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.566436:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.566438:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f9b0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5921 expref: 70 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.566609:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f9a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e591a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.566625:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f87f9a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e591a expref: 5 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065137.566635:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267649536:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065137.566690:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.568192:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.568268:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267649536:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065137.568284:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f9b0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5921 expref: 70 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.568298:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe70800, rc 0) 00000100:00100000:2.0:1746065137.568320:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:1795:x1830881272892032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1932us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.568326:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30209 00000100:00100000:0.0:1746065137.569842:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.569967:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272892416 00000100:00100000:2.0:1746065137.569971:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272892416 00002000:00100000:2.0:1746065137.569995:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb97480 x1830881272892416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.570003:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb97480 with x1830881272892416 ext(0->4095) 00002000:00010000:2.0:1746065137.570007:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb97480 00000100:00100000:2.0:1746065137.570019:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13543 00000100:00100000:2.0:1746065137.570024:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:2004:x1830881272892416:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.570131:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:2004:x1830881272892416:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 106us (288us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.570137:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13543 00002000:00100000:2.0:1746065137.570142:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb97480 x1830881272892416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.570149:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb97480 with x1830881272892416 ext(0->4095) 00002000:00010000:2.0:1746065137.570152:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb97480 00000100:00100000:0.0:1746065137.573459:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.573563:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272892544 00000100:00100000:2.0:1746065137.573569:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272892544 00000100:00100000:2.0:1746065137.573608:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30210 00000100:00100000:2.0:1746065137.573615:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272892544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.573629:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.573642:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f9b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5928 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.573664:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f9b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5921 expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.573670:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.573672:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.573675:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f9b7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5928 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.573697:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f9b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5921 expref: 69 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.573707:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f9b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5921 expref: 69 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.573716:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267649792:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065137.573783:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.574581:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267649792:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065137.574594:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f9b7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5928 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.574603:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065137.574623:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272892544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1009us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.574632:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30210 00000100:00100000:0.0:1746065137.575326:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.579104:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2005:x1830881272892672:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 3488us (3770us total) trans 4294972098 rc 0/0 00000100:00100000:0.0:1746065137.579114:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2783 00002000:00100000:0.0:1746065137.579122:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88008fb96680 x1830881272892672/t4294972098(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.579130:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb96680 with x1830881272892672 ext(0->7) 00010000:00010000:0.0:1746065137.579137:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f9b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5921 expref: 72 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.579150:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe70800/0x392ae0376f87f9b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5921 expref: 72 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.579155:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb96680 00000100:00100000:0.0:1746065137.581568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.581724:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272892928 00000100:00100000:2.0:1746065137.581730:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272892928 00000100:00100000:2.0:1746065137.581763:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30211 00000100:00100000:2.0:1746065137.581768:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1791:x1830881272892928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.581779:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.581790:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f9be lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e592f expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.581807:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.581811:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f9b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5928 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.581814:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065137.581816:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f9be lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e592f expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.581838:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f9b7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5928 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.581844:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f9be lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e592f expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.581849:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:0.0:1746065137.581882:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.582221:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1791:x1830881272892928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 452us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.582227:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30211 00000100:00100000:0.0:1746065137.584881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.584999:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272893184 00000100:00100000:1.0:1746065137.585004:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272893184 00002000:00100000:1.0:1746065137.585338:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f84b100 x1830881272893184/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.585347:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84b100 with x1830881272893184 ext(0->4095) 00010000:00010000:1.0:1746065137.585353:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f9b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5928 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.585363:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f9b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5928 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.585368:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f84b100 00000100:00100000:1.0:1746065137.585392:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2784 00000100:00100000:1.0:1746065137.585402:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272893184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.585615:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272893184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 213us (766us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.585621:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2784 00002000:00100000:1.0:1746065137.585626:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f84b100 x1830881272893184/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.585632:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84b100 with x1830881272893184 ext(0->4095) 00010000:00010000:1.0:1746065137.585636:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f9b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5928 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.585644:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87f9b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5928 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.585649:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f84b100 00000100:00100000:0.0:1746065137.587422:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.590772:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.590821:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272893568 00000100:00100000:1.0:1746065137.590826:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272893568 00002000:00100000:1.0:1746065137.590877:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f84b800 x1830881272893568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.590886:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84b800 with x1830881272893568 ext(0->4095) 00002000:00010000:1.0:1746065137.590890:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f84b800 00000100:00100000:1.0:1746065137.590915:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13544 00000100:00100000:1.0:1746065137.590921:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2002:x1830881272893568:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065137.591046:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2002:x1830881272893568:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 124us (273us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.591054:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13544 00002000:00100000:1.0:1746065137.591059:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f84b800 x1830881272893568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.591065:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84b800 with x1830881272893568 ext(0->4095) 00002000:00010000:1.0:1746065137.591068:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f84b800 00000100:00100000:0.0:1746065137.598371:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.598538:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272893696 00000100:00100000:2.0:1746065137.598547:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272893696 00000100:00100000:2.0:1746065137.598644:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30212 00000100:00100000:2.0:1746065137.598652:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272893696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.598667:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.598681:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f9c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5936 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.598703:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f9be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e592f expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.598709:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.598710:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.598714:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f9c5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5936 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.598736:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f9be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e592f expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.598746:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f9be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e592f expref: 71 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.598756:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267650304:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065137.600200:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065137.600214:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c4d7531-7474-4559-997c-c1b3824c301a:3765:1830881267650432:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600246:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.600269:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3765:1830881267650816:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600286:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065137.600294:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267650688:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600300:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267651328:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600314:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065137.600315:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.600322:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267651840:0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600328:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3768:1830881267651200:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600333:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065137.600340:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.600343:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746065137.600346:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267650944:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600359:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.600368:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267651456:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600382:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.600391:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267651968:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600403:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.600441:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267650816 00000100:00100000:0.0:1746065137.600444:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267650816 00000100:00100000:1.0:1746065137.600450:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3768:1830881267651712:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600460:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267651200 00000100:00100000:0.0:1746065137.600462:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267651200 00000100:00100000:1.0:1746065137.600467:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.600477:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267651712 00000100:00100000:0.0:1746065137.600478:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267651712 00000100:00100000:1.0:1746065137.600485:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267650432 00000100:00100000:1.0:1746065137.600487:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267650432 00000100:00100000:0.0:1746065137.600489:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1746065137.600493:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3765:x1830881267650816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600505:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1746065137.600508:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3765:x1830881267650432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600523:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3765:x1830881267650816:12345-0@lo:400:kworker.0 Request processed in 29us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.600527:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3765:x1830881267650432:12345-0@lo:400:kworker.0 Request processed in 18us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.600528:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1746065137.600530:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1746065137.600539:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1746065137.600543:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3768:x1830881267651200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600548:0:8658:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:1.0:1746065137.600552:0:8658:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3768:x1830881267650688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600561:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3768:x1830881267651200:12345-0@lo:400:kworker.0 Request processed in 19us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.600565:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:1.0:1746065137.600569:0:8658:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3768:x1830881267650688:12345-0@lo:400:kworker.0 Request processed in 17us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.600572:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1746065137.600573:0:8658:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1746065137.600575:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3768:x1830881267651712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600591:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3768:x1830881267651712:12345-0@lo:400:kworker.0 Request processed in 15us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.600595:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1746065137.600619:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3765:1830881267650816:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600626:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c4d7531-7474-4559-997c-c1b3824c301a:3765:1830881267650432:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600638:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267650944:0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600663:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267651328 00000100:00100000:1.0:1746065137.600665:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267651328 00000100:00100000:1.0:1746065137.600680:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267651840 00000100:00100000:1.0:1746065137.600681:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267651840 00000100:00100000:1.0:1746065137.600688:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267651456 00000100:00100000:1.0:1746065137.600689:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267651456 00000100:00100000:1.0:1746065137.600696:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267651968 00000100:00100000:1.0:1746065137.600698:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267651968 00000100:00100000:1.0:1746065137.600706:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1746065137.600709:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3765:x1830881267651328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600742:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3765:x1830881267651328:12345-0@lo:400:kworker.0 Request processed in 32us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.600746:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1746065137.600755:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1746065137.600759:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3765:x1830881267651840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600778:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3765:x1830881267651840:12345-0@lo:400:kworker.0 Request processed in 19us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.600783:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1746065137.600790:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1746065137.600793:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267651456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600811:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267651456:12345-0@lo:400:kworker.0 Request processed in 17us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.600816:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1746065137.600822:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:1.0:1746065137.600825:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267651968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600843:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267651968:12345-0@lo:400:kworker.0 Request processed in 18us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.600846:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267651456:0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600850:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1746065137.600853:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267651968:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600859:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267651328:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600865:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267651840:0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600870:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267650688:0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600876:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3768:1830881267651200:0@lo:400:kworker.0 00000100:00100000:1.0:1746065137.600882:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3768:1830881267651712:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600904:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.600917:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3767:1830881267651072:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600933:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.600941:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3767:1830881267651584:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.600969:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.600987:0:11924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267651584 00000100:00100000:0.0:1746065137.600989:0:11924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267651584 00000100:00100000:0.0:1746065137.600999:0:11924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1746065137.601003:0:11924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3767:x1830881267651072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.601018:0:11924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3767:x1830881267651072:12345-0@lo:400:kworker.0 Request processed in 15us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.601023:0:11924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1746065137.601042:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3767:1830881267650560:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.601048:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3767:1830881267651072:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.601054:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3767:1830881267651584:0@lo:400:kworker.0 00000100:00100000:0.0:1746065137.604190:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.604256:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272893824 00000100:00100000:2.0:1746065137.604263:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272893824 00002000:00100000:2.0:1746065137.604292:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d5a3800 x1830881272893824/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.604301:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3800 with x1830881272893824 ext(0->7) 00010000:00010000:2.0:1746065137.604307:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f9be lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e592f expref: 72 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.604318:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f9be lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e592f expref: 72 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.604324:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a3800 00000100:00100000:2.0:1746065137.604969:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2785 00000100:00100000:2.0:1746065137.604976:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881272893824:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065137.607226:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.608452:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2004:x1830881272893824:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 3475us (4267us total) trans 4294972099 rc 0/0 00000100:00100000:2.0:1746065137.608459:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2785 00002000:00100000:2.0:1746065137.608466:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d5a3800 x1830881272893824/t4294972099(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.608473:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3800 with x1830881272893824 ext(0->7) 00010000:00010000:2.0:1746065137.608479:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f9be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e592f expref: 75 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.608489:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87f9be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e592f expref: 75 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.608494:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a3800 00000100:00100000:0.0:1746065137.610607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.614617:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.614678:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272894336 00000100:00100000:2.0:1746065137.614684:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272894336 00002000:00100000:2.0:1746065137.614717:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f9880 x1830881272894336/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.614732:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9880 with x1830881272894336 ext(0->4095) 00010000:00010000:2.0:1746065137.614738:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f9c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5936 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.614750:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f9c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5936 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.614756:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9f9880 00000100:00100000:2.0:1746065137.614780:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2786 00000100:00100000:2.0:1746065137.614787:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272894336:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.614902:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272894336:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 115us (289us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.614908:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2786 00002000:00100000:2.0:1746065137.614913:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f9880 x1830881272894336/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.614919:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9880 with x1830881272894336 ext(0->4095) 00010000:00010000:2.0:1746065137.614924:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f9c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5936 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.614932:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87f9c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5936 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.614938:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9f9880 00000100:00100000:0.0:1746065137.616302:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.620259:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.620300:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272894720 00000100:00100000:2.0:1746065137.620310:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272894720 00002000:00100000:2.0:1746065137.620337:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e9c00 x1830881272894720/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.620346:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9c00 with x1830881272894720 ext(0->4095) 00002000:00010000:2.0:1746065137.620350:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5e9c00 00000100:00100000:2.0:1746065137.620481:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13545 00000100:00100000:2.0:1746065137.620488:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2005:x1830881272894720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.620593:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2005:x1830881272894720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 104us (334us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.620598:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13545 00002000:00100000:2.0:1746065137.620603:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e9c00 x1830881272894720/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.620610:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9c00 with x1830881272894720 ext(0->4095) 00002000:00010000:2.0:1746065137.620612:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5e9c00 00000100:00100000:0.0:1746065137.621556:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.623688:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.625888:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.626230:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272895232 00000100:00100000:2.0:1746065137.626235:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272895232 00002000:00100000:2.0:1746065137.626259:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e1180 x1830881272895232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.626268:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1180 with x1830881272895232 ext(0->4095) 00002000:00010000:2.0:1746065137.626271:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1180 00000100:00100000:2.0:1746065137.626290:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13546 00000100:00100000:2.0:1746065137.626296:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272895232:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.626391:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272895232:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 94us (509us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.626400:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13546 00002000:00100000:2.0:1746065137.626404:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e1180 x1830881272895232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.626411:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1180 with x1830881272895232 ext(0->4095) 00002000:00010000:2.0:1746065137.626414:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1180 00000100:00100000:0.0:1746065137.627549:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.629303:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.629534:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272895488 00000100:00100000:3.0:1746065137.629539:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272895488 00010000:00010000:3.0:1746065137.629555:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f9d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5944 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.629579:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14187 00000100:00100000:3.0:1746065137.629585:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272895488:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.629594:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.629608:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f9d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5944 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.629616:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f9d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5944 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.629632:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87f9d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5944 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.629650:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.629652:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.629658:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.629664:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.629685:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065137.629693:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267652864:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.629737:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.631233:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267652864:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.631245:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065137.631269:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.631283:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272895488:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1698us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.631291:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14187 00000100:00100000:2.0:1746065137.631382:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272895744 00000100:00100000:2.0:1746065137.631386:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272895744 00002000:00100000:2.0:1746065137.631413:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e0e00 x1830881272895744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.631422:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0e00 with x1830881272895744 ext(0->4095) 00002000:00010000:2.0:1746065137.631425:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e0e00 00000100:00100000:2.0:1746065137.631449:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13547 00000100:00100000:2.0:1746065137.631455:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2004:x1830881272895744:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.631670:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2004:x1830881272895744:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 214us (401us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.631676:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13547 00002000:00100000:2.0:1746065137.631681:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e0e00 x1830881272895744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.631687:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0e00 with x1830881272895744 ext(0->4095) 00002000:00010000:2.0:1746065137.631690:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e0e00 00000100:00100000:0.0:1746065137.632912:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.633053:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272895872 00000100:00100000:3.0:1746065137.633057:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272895872 00000100:00100000:3.0:1746065137.633155:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30216 00000100:00100000:3.0:1746065137.633162:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272895872:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.633171:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.633183:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5952 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.633202:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.633207:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.633208:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.633211:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.633230:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.633238:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 73 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.633251:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267652992:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.633626:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.635344:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267652992:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.635364:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.635377:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065137.635402:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272895872:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2241us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.635408:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30216 00000100:00100000:0.0:1746065137.635760:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.636074:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272896000 00000100:00100000:2.0:1746065137.636098:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272896000 00002000:00100000:2.0:1746065137.636126:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d1e1f80 x1830881272896000/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.636134:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1f80 with x1830881272896000 ext(0->7) 00010000:00010000:2.0:1746065137.636140:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 74 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.636150:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 74 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.636156:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e1f80 00000100:00100000:2.0:1746065137.636266:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2787 00000100:00100000:2.0:1746065137.636272:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2003:x1830881272896000:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065137.636936:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2003:x1830881272896000:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 662us (1175us total) trans 4294972100 rc 0/0 00000100:00100000:0.0:1746065137.636942:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2787 00002000:00100000:0.0:1746065137.636956:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d1e1f80 x1830881272896000/t4294972100(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.636963:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1f80 with x1830881272896000 ext(0->7) 00010000:00010000:0.0:1746065137.636967:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.636976:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.636982:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e1f80 00000100:00100000:0.0:1746065137.640586:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.640690:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272896128 00000100:00100000:3.0:1746065137.640697:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272896128 00010000:00010000:3.0:1746065137.640723:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.640757:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14188 00000100:00100000:3.0:1746065137.640764:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2002:x1830881272896128:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.640774:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.640789:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.640799:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.640822:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87f9da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e594b expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.640845:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.640846:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.640852:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.640858:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.640885:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065137.640895:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267653120:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.640978:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.642493:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.642578:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272896384 00000100:00100000:1.0:1746065137.642584:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272896384 00002000:00100000:1.0:1746065137.642613:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253c380 x1830881272896384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.642621:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253c380 with x1830881272896384 ext(0->4095) 00002000:00010000:1.0:1746065137.642625:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007253c380 00000100:00100000:1.0:1746065137.642640:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13548 00000100:00100000:1.0:1746065137.642646:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272896384:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065137.642740:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272896384:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 93us (249us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.642745:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13548 00002000:00100000:1.0:1746065137.642750:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253c380 x1830881272896384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.642757:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253c380 with x1830881272896384 ext(0->4095) 00002000:00010000:1.0:1746065137.642759:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007253c380 00000100:00100000:3.0:1746065137.642841:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267653120:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.642854:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065137.642884:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2002:x1830881272896128:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2120us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.642891:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14188 00000100:00100000:0.0:1746065137.644543:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.644605:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.644669:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272896512 00000100:00100000:3.0:1746065137.644674:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272896512 00000100:00100000:3.0:1746065137.644708:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272896640 00000100:00100000:3.0:1746065137.644710:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272896640 00000100:00100000:3.0:1746065137.644734:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30217 00000100:00100000:3.0:1746065137.644740:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1791:x1830881272896512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.644751:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.644762:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5959 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.644782:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.644788:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.644789:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.644792:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 77 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.644814:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.644824:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 5 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.644833:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267653248:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.644885:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.644939:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30218 00000100:00100000:1.0:1746065137.644955:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1795:x1830881272896640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.644961:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.644968:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5960 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.645006:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.645010:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 78 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.645016:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.645018:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 78 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.645036:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 78 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.645045:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 78 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.645053:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065137.645107:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:1795:x1830881272896640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 162us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.645113:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30218 00000100:00100000:3.0:1746065137.646189:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267653248:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.646202:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 77 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.646211:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065137.646239:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1791:x1830881272896512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1498us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.646245:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30217 00000100:00100000:0.0:1746065137.646518:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.646594:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272896768 00000100:00100000:3.0:1746065137.646598:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272896768 00010000:00010000:3.0:1746065137.646613:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.646641:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14189 00000100:00100000:3.0:1746065137.646647:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272896768:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.646655:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.646669:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.646678:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.646694:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87f9e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5952 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.646706:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.646707:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.646712:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 76 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.646994:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 76 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.647015:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 76 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.647025:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.647034:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267653504:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.648133:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.649124:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267653504:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.649137:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065137.649159:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.649167:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272896768:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2520us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.649176:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14189 00000100:00100000:1.0:1746065137.650060:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272897024 00000100:00100000:1.0:1746065137.650065:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272897024 00002000:00100000:1.0:1746065137.650105:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea77800 x1830881272897024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.650114:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77800 with x1830881272897024 ext(0->4095) 00010000:00010000:1.0:1746065137.650120:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.650135:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.650141:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea77800 00000100:00100000:1.0:1746065137.650165:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2788 00000100:00100000:1.0:1746065137.650171:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272897024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.650269:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272897024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 97us (1110us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.650275:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2788 00002000:00100000:1.0:1746065137.650280:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea77800 x1830881272897024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.650286:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77800 with x1830881272897024 ext(0->4095) 00010000:00010000:1.0:1746065137.650291:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.650299:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.650304:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea77800 00000100:00100000:2.0:1746065137.652267:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.652574:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272897152 00000100:00100000:3.0:1746065137.652579:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272897152 00010000:00010000:3.0:1746065137.652598:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.652709:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14190 00000100:00100000:3.0:1746065137.652717:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272897152:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.652726:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.652740:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.652750:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.652768:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87f9e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5959 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.652861:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.652864:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.652870:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 76 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.652878:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 76 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.652902:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 76 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065137.652913:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267653632:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.653276:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.654924:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267653632:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065137.654930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065137.654937:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.655006:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272897408 00000100:00100000:1.0:1746065137.655012:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272897408 00000100:00100000:3.0:1746065137.655155:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272897152:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2437us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.655162:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14190 00002000:00100000:1.0:1746065137.655174:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76a00 x1830881272897408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.655183:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76a00 with x1830881272897408 ext(0->4095) 00002000:00010000:1.0:1746065137.655187:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea76a00 00000100:00100000:1.0:1746065137.655333:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13549 00000100:00100000:1.0:1746065137.655339:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272897408:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.655424:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272897408:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 85us (494us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.655429:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13549 00002000:00100000:1.0:1746065137.655434:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76a00 x1830881272897408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.655441:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76a00 with x1830881272897408 ext(0->4095) 00002000:00010000:1.0:1746065137.655443:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea76a00 00000100:00100000:0.0:1746065137.656495:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.656589:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272897536 00000100:00100000:3.0:1746065137.656594:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272897536 00000100:00100000:3.0:1746065137.656665:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30219 00000100:00100000:3.0:1746065137.656671:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272897536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.656680:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.656693:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5967 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.656717:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 75 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.656723:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.656725:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.656728:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.656750:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 75 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.656765:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 75 pid: 9558 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.656775:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267653760:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.657119:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.657924:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267653760:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.657939:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.657960:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065137.657993:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272897536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1322us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.658000:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30219 00000100:00100000:0.0:1746065137.659342:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.659415:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272897664 00000100:00100000:3.0:1746065137.659420:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272897664 00010000:00010000:3.0:1746065137.659440:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 76 pid: 9558 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.659504:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14191 00000100:00100000:3.0:1746065137.659511:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272897664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.659521:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.659536:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 76 pid: 9558 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.659546:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 76 pid: 9558 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.659567:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87f9ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5960 expref: 76 pid: 9558 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.659589:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.659591:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.659624:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.659632:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.659659:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065137.659669:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267653888:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.659720:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.660571:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267653888:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.660582:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065137.660602:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2004:x1830881272897664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1092us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.660608:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14191 00000100:00100000:0.0:1746065137.663047:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.663298:0:3768:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065137.663312:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267654016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065137.663343:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065137.663379:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267654016 00000100:00100000:1.0:1746065137.663380:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272897920 00000100:00100000:1.0:1746065137.663384:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272897920 00000100:00100000:2.0:1746065137.663385:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267654016 00002000:00100000:1.0:1746065137.663413:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b480 x1830881272897920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.663421:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b480 with x1830881272897920 ext(0->4095) 00000100:00100000:2.0:1746065137.663422:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00002000:00010000:1.0:1746065137.663425:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93b480 00000100:00100000:2.0:1746065137.663427:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3768:x1830881267654016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065137.663437:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13550 00002000:00000024:2.0:1746065137.663441:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 504769344 pending 1003520 free 3920867328 avail 3689345024 00000100:00100000:1.0:1746065137.663441:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272897920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.663476:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3768:x1830881267654016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.663481:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1746065137.663492:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267654016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065137.664331:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272897920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 889us (1289us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.664340:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13550 00002000:00100000:1.0:1746065137.664345:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b480 x1830881272897920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.664351:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b480 with x1830881272897920 ext(0->4095) 00002000:00010000:1.0:1746065137.664354:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93b480 00000100:00100000:0.0:1746065137.668787:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.668993:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272898048 00000100:00100000:3.0:1746065137.669001:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272898048 00000100:00100000:0.0:1746065137.669152:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.669422:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272898176 00000100:00100000:3.0:1746065137.669425:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272898176 00000100:00100000:0.0:1746065137.669990:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30220 00000100:00100000:0.0:1746065137.669998:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1795:x1830881272898048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065137.670014:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.670028:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e596e expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.670050:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.670057:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.670059:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.670062:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 77 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.670101:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.670112:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 5 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065137.670121:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267654144:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065137.670175:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.670309:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30221 00000100:00100000:3.0:1746065137.670316:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1791:x1830881272898176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.670323:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.670329:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5975 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.670340:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.670343:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 78 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.670347:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.670349:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 78 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.670367:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 78 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.670377:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 78 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.670385:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065137.670410:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:1791:x1830881272898176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 95us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.670415:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30221 00000100:00100000:0.0:1746065137.672314:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.672406:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267654144:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065137.672427:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 77 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.672439:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072615e00, rc 0) 00000100:00100000:2.0:1746065137.672468:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1795:x1830881272898048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2471us (3692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.672476:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30220 00000100:00100000:3.0:1746065137.672547:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272898304 00000100:00100000:3.0:1746065137.672553:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272898304 00010000:00010000:3.0:1746065137.672575:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.672899:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14192 00000100:00100000:3.0:1746065137.672906:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272898304:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.672917:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.672931:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.672942:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.672967:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87f9f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5967 expref: 6 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.673421:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.673423:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.673429:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 76 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.673441:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 76 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.673465:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 76 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.673475:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 76 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.673486:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267654400:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.674138:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.676060:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267654400:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.676077:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065137.676142:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272898304:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3235us (3831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.676151:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14192 00000100:00100000:0.0:1746065137.676588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.676778:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272898560 00000100:00100000:2.0:1746065137.676784:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272898560 00002000:00100000:2.0:1746065137.676816:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5180 x1830881272898560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.676824:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5180 with x1830881272898560 ext(0->4095) 00010000:00010000:2.0:1746065137.676831:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 77 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.676842:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 77 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.676848:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5180 00000100:00100000:2.0:1746065137.676861:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2789 00000100:00100000:2.0:1746065137.676867:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2005:x1830881272898560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.676984:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2005:x1830881272898560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 117us (397us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.676990:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2789 00002000:00100000:2.0:1746065137.676995:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5180 x1830881272898560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.677001:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5180 with x1830881272898560 ext(0->4095) 00010000:00010000:2.0:1746065137.677005:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 77 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.677017:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 77 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.677023:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5180 00000100:00100000:0.0:1746065137.679579:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.679708:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272898688 00000100:00100000:2.0:1746065137.679716:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272898688 00000100:00100000:2.0:1746065137.679749:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30222 00000100:00100000:2.0:1746065137.679755:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272898688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.679768:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.679782:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e597c expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.679802:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.679807:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 76 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.679811:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065137.679814:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.679846:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 76 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.679856:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.679865:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065137.680988:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272898688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1229us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.680995:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30222 00000100:00100000:0.0:1746065137.681214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.681521:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272898816 00000100:00100000:3.0:1746065137.681525:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272898816 00010000:00010000:3.0:1746065137.681545:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 77 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.681935:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14193 00000100:00100000:3.0:1746065137.681942:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2003:x1830881272898816:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.681964:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.681980:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 77 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.681991:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 77 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.682008:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072615e00/0x392ae0376f87f9fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e596e expref: 77 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.682034:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.682036:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.682041:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 76 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.682048:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 76 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.682073:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 76 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.682100:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.682111:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267654656:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.682174:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.683755:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267654656:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.683769:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065137.683796:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2003:x1830881272898816:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1855us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.683804:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14193 00000100:00100000:0.0:1746065137.684034:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.685301:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272899072 00000100:00100000:1.0:1746065137.685309:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272899072 00002000:00100000:1.0:1746065137.685345:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79ea00 x1830881272899072/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.685354:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ea00 with x1830881272899072 ext(0->4095) 00010000:00010000:1.0:1746065137.685362:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.685374:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.685381:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79ea00 00000100:00100000:1.0:1746065137.685563:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2790 00000100:00100000:1.0:1746065137.685569:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272899072:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.685986:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272899072:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 415us (1951us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.685992:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2790 00002000:00100000:1.0:1746065137.685997:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79ea00 x1830881272899072/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.686010:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ea00 with x1830881272899072 ext(0->4095) 00010000:00010000:1.0:1746065137.686014:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.686023:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 76 pid: 9635 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.686028:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79ea00 00000100:00100000:0.0:1746065137.687630:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.687966:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.688037:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272899200 00000100:00100000:2.0:1746065137.688043:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272899200 00000100:00100000:2.0:1746065137.688101:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30223 00000100:00100000:2.0:1746065137.688107:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1791:x1830881272899200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.688122:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.688137:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5983 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.688157:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.688162:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.688168:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065137.688171:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 77 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.688201:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.688210:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 77 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.688218:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065137.688259:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1791:x1830881272899200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 152us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.688267:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30223 00000100:00100000:3.0:1746065137.688362:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272899328 00000100:00100000:3.0:1746065137.688366:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272899328 00010000:00010000:3.0:1746065137.688379:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.688394:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14194 00000100:00100000:3.0:1746065137.688398:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2003:x1830881272899328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.688405:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.688418:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.688428:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.688441:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5975 expref: 77 pid: 9635 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.688451:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.688452:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.688456:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.688463:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.688478:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.688487:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 5 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.688497:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267654912:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.688534:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5720c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.690897:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.691051:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272899584 00000100:00100000:1.0:1746065137.691056:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272899584 00000100:00100000:3.0:1746065137.691217:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267654912:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.691231:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065137.691256:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2003:x1830881272899328:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2857us (3290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.691264:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14194 00002000:00100000:1.0:1746065137.691316:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f983b80 x1830881272899584/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.691325:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983b80 with x1830881272899584 ext(0->4095) 00010000:00010000:1.0:1746065137.691331:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.691342:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.691348:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f983b80 00000100:00100000:1.0:1746065137.691368:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2791 00000100:00100000:1.0:1746065137.691374:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272899584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.691452:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272899584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 79us (561us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.691457:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2791 00002000:00100000:1.0:1746065137.691462:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f983b80 x1830881272899584/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.691468:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983b80 with x1830881272899584 ext(0->4095) 00010000:00010000:1.0:1746065137.691472:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.691485:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.691490:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f983b80 00000100:00100000:0.0:1746065137.693822:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.694317:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272899712 00000100:00100000:3.0:1746065137.694324:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272899712 00010000:00010000:3.0:1746065137.694349:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.694371:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14195 00000100:00100000:3.0:1746065137.694378:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801376a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272899712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.694388:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.694403:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.694413:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.694429:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fa0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e597c expref: 6 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.694452:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.694454:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.694459:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 75 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.694465:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 75 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.694490:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 75 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065137.694499:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267655040:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.694554:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.696221:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267655040:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.696235:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065137.696311:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801376a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272899712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1932us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.696319:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14195 00000100:00100000:0.0:1746065137.696759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.697221:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272899968 00000100:00100000:1.0:1746065137.697227:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272899968 00002000:00100000:1.0:1746065137.697260:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f983480 x1830881272899968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.697269:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983480 with x1830881272899968 ext(0->4095) 00002000:00010000:1.0:1746065137.697273:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f983480 00000100:00100000:1.0:1746065137.697410:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13551 00000100:00100000:1.0:1746065137.697419:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272899968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.697522:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272899968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 105us (764us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.697527:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13551 00002000:00100000:1.0:1746065137.697532:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f983480 x1830881272899968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.697539:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983480 with x1830881272899968 ext(0->4095) 00002000:00010000:1.0:1746065137.697541:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f983480 00000100:00100000:0.0:1746065137.700914:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.700961:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272900096 00000100:00100000:2.0:1746065137.700969:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272900096 00000100:00100000:2.0:1746065137.701001:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30224 00000100:00100000:2.0:1746065137.701006:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272900096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.701019:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.701032:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e598a expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.701054:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 75 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.701061:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.701062:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.701065:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.701107:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 75 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.701116:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 75 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.701126:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267655168:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065137.701192:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.703529:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267655168:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065137.703559:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.703574:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:0.0:1746065137.704336:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.704782:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272900096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3772us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.704789:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30224 00000100:00100000:3.0:1746065137.705098:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272900224 00000100:00100000:3.0:1746065137.705106:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272900224 00010000:00010000:3.0:1746065137.705128:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 76 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.705156:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14196 00000100:00100000:3.0:1746065137.705163:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272900224:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.705176:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.705192:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 76 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.705202:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 76 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.705220:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5983 expref: 76 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.705232:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.705235:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.705240:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.705247:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.705271:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065137.705282:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267655296:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.705323:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.706501:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267655296:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.706512:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065137.706544:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2005:x1830881272900224:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1382us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.706554:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14196 00000100:00100000:0.0:1746065137.707308:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.707370:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.707430:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272900608 00000100:00100000:3.0:1746065137.707435:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272900608 00000100:00100000:3.0:1746065137.707458:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30225 00000100:00100000:3.0:1746065137.707462:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:1791:x1830881272900608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.707473:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.707484:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5991 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.707504:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.707510:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.707511:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.707514:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.707532:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.707541:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 5 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.707551:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267655424:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.707602:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.707704:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272900480 00000100:00100000:2.0:1746065137.707708:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272900480 00002000:00100000:2.0:1746065137.707731:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f981c00 x1830881272900480/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.707740:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981c00 with x1830881272900480 ext(0->4095) 00010000:00010000:2.0:1746065137.707745:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.707755:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.707761:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f981c00 00000100:00100000:2.0:1746065137.707783:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2792 00000100:00100000:2.0:1746065137.707788:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272900480:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.707875:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272900480:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 86us (567us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.707880:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2792 00002000:00100000:2.0:1746065137.707885:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f981c00 x1830881272900480/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.707893:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981c00 with x1830881272900480 ext(0->4095) 00010000:00010000:2.0:1746065137.707897:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.707905:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.707911:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f981c00 00000100:00100000:0.0:1746065137.713070:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.713317:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267655424:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.713343:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.713358:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065137.713400:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1791:x1830881272900608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5937us (6029us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.713407:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30225 00000100:00100000:3.0:1746065137.713428:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272900736 00000100:00100000:3.0:1746065137.713432:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272900736 00000100:00100000:3.0:1746065137.713452:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30226 00000100:00100000:3.0:1746065137.713458:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1795:x1830881272900736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.713468:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.713478:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5998 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.713492:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.713496:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.713501:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.713504:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.713526:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.713534:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.713545:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065137.713558:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1795:x1830881272900736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 100us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.713562:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30226 00000100:00100000:0.0:1746065137.713771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.714700:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272900864 00000100:00100000:3.0:1746065137.714704:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272900864 00010000:00010000:3.0:1746065137.714720:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.715059:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14197 00000100:00100000:3.0:1746065137.715065:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272900864:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.715073:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.715106:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.715115:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.715129:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fa19 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e598a expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.715151:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.715152:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.715157:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.715168:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.715186:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.715194:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.715203:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267655680:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.715858:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.719270:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.719542:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267655680:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.719558:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065137.719592:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272900864:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4527us (5820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.719601:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14197 00000100:00100000:2.0:1746065137.719675:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272901120 00000100:00100000:2.0:1746065137.719681:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272901120 00002000:00100000:2.0:1746065137.719710:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077a300 x1830881272901120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.719718:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077a300 with x1830881272901120 ext(0->4095) 00010000:00010000:2.0:1746065137.719724:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.719736:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.719741:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077a300 00000100:00100000:2.0:1746065137.719765:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2793 00000100:00100000:2.0:1746065137.719771:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272901120:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.719861:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272901120:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (596us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.719866:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2793 00002000:00100000:2.0:1746065137.719871:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077a300 x1830881272901120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.719878:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077a300 with x1830881272901120 ext(0->4095) 00010000:00010000:2.0:1746065137.719882:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.719890:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.719895:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077a300 00000100:00100000:0.0:1746065137.722135:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.722803:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272901248 00000100:00100000:3.0:1746065137.722809:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272901248 00010000:00010000:3.0:1746065137.722833:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.722911:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14198 00000100:00100000:3.0:1746065137.722918:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2003:x1830881272901248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.722929:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.722960:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.722972:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.722990:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5991 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.723011:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.723013:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.723019:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.723026:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.723146:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065137.723159:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267655808:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.723533:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.725647:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267655808:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.725664:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065137.725708:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2003:x1830881272901248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2789us (3578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.725716:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14198 00000100:00100000:0.0:1746065137.726466:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.726568:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272901504 00000100:00100000:2.0:1746065137.726574:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272901504 00002000:00100000:2.0:1746065137.726601:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130779f80 x1830881272901504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.726610:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779f80 with x1830881272901504 ext(0->4095) 00002000:00010000:2.0:1746065137.726614:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130779f80 00000100:00100000:2.0:1746065137.726633:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13552 00000100:00100000:2.0:1746065137.726639:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272901504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.726738:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272901504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (272us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.726747:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13552 00002000:00100000:2.0:1746065137.726752:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130779f80 x1830881272901504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.726759:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779f80 with x1830881272901504 ext(0->4095) 00002000:00010000:2.0:1746065137.726761:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130779f80 00000100:00100000:0.0:1746065137.728209:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.728519:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272901632 00000100:00100000:3.0:1746065137.728524:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272901632 00000100:00100000:3.0:1746065137.728558:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30227 00000100:00100000:3.0:1746065137.728564:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272901632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.728573:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.728587:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e599f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.728607:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 75 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.728613:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.728615:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.728617:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.728638:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 75 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.728649:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 75 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.728664:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267655936:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.728729:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.730440:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267655936:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.730456:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.730474:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065137.730509:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272901632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1944us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.730515:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30227 00000100:00100000:0.0:1746065137.730662:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.730804:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272901760 00000100:00100000:3.0:1746065137.730808:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272901760 00010000:00010000:3.0:1746065137.730824:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.730840:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14199 00000100:00100000:3.0:1746065137.730846:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272901760:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065137.730853:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065137.730868:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.730877:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.730891:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5998 expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.730908:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.730909:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.730914:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.730921:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.730943:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065137.731982:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267656064:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.732057:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.736888:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.736968:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267656064:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.736972:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272902016 00000100:00100000:1.0:1746065137.736977:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272902016 00010000:00010000:3.0:1746065137.736983:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065137.737010:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1dc00 x1830881272902016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065137.737017:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2004:x1830881272901760:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6171us (6356us total) trans 0 rc 0/0 00002000:00100000:1.0:1746065137.737019:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1dc00 with x1830881272902016 ext(0->4095) 00002000:00010000:1.0:1746065137.737023:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1dc00 00000100:00100000:3.0:1746065137.737025:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14199 00000100:00100000:1.0:1746065137.737106:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13553 00000100:00100000:1.0:1746065137.737112:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272902016:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.737223:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272902016:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 111us (342us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.737228:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13553 00002000:00100000:1.0:1746065137.737233:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1dc00 x1830881272902016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.737240:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1dc00 with x1830881272902016 ext(0->4095) 00002000:00010000:1.0:1746065137.737243:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1dc00 00000100:00100000:0.0:1746065137.737581:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.737618:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272902144 00000100:00100000:3.0:1746065137.737621:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272902144 00000100:00100000:3.0:1746065137.737647:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30228 00000100:00100000:3.0:1746065137.737656:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:1791:x1830881272902144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.737664:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.737675:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59a6 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.737695:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.737701:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.737702:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.737704:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.737725:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.737733:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 5 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.737739:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267656192:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.737793:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.742260:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.742473:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267656192:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.742494:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.742508:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065137.742540:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1791:x1830881272902144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4888us (4959us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.742548:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30228 00000100:00100000:3.0:1746065137.742620:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272902272 00000100:00100000:3.0:1746065137.742625:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272902272 00000100:00100000:3.0:1746065137.742663:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30229 00000100:00100000:3.0:1746065137.742670:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1795:x1830881272902272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.742681:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.742691:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59ad expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.742708:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.742712:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.742717:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.742720:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065137.742722:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065137.742779:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.742787:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.742793:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065137.742811:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1795:x1830881272902272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 142us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.742816:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30229 00000100:00100000:2.0:1746065137.742859:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272902400 00000100:00100000:2.0:1746065137.742862:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272902400 00010000:00010000:2.0:1746065137.742878:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.742938:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14200 00000100:00100000:2.0:1746065137.742951:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272902400:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.742958:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.742971:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.742980:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.742994:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa2e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e599f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.743018:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.743019:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.743024:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.743031:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.743049:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.743067:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.743601:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267656448:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.743653:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.749615:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267656448:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.749633:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.749665:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272902400:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6720us (6942us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.749673:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14200 00000100:00100000:0.0:1746065137.750624:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.751236:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272902656 00000100:00100000:1.0:1746065137.751243:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272902656 00002000:00100000:1.0:1746065137.751274:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1fb80 x1830881272902656/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.751282:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1fb80 with x1830881272902656 ext(0->4095) 00010000:00010000:1.0:1746065137.751290:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.751302:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.751312:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1fb80 00000100:00100000:1.0:1746065137.751339:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2794 00000100:00100000:1.0:1746065137.751344:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272902656:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.752299:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272902656:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 952us (1674us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.752310:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2794 00002000:00100000:1.0:1746065137.752315:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1fb80 x1830881272902656/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.752323:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1fb80 with x1830881272902656 ext(0->4095) 00010000:00010000:1.0:1746065137.752328:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.752336:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.752342:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1fb80 00000100:00100000:0.0:1746065137.758692:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.758915:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272902784 00000100:00100000:2.0:1746065137.758923:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272902784 00010000:00010000:2.0:1746065137.758960:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.759106:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14201 00000100:00100000:2.0:1746065137.759114:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2005:x1830881272902784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.759126:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.759142:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.759152:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.759169:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59a6 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.759191:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.759193:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.759199:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.759206:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.759231:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.759241:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267656576:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.759306:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5206c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.760100:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267656704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746065137.760132:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065137.760170:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267656704 00000100:00100000:3.0:1746065137.760174:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267656704 00000100:00100000:3.0:1746065137.760203:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1746065137.760208:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267656704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1746065137.760223:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 504769344 pending 1003520 free 3920867328 avail 3689345024 00000100:00100000:3.0:1746065137.760264:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267656704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.760269:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1746065137.760523:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267656704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746065137.760695:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267656576:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.760706:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.760736:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272902784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1623us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.760742:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14201 00000100:00100000:0.0:1746065137.761172:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.761231:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272903040 00000100:00100000:1.0:1746065137.761235:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272903040 00002000:00100000:1.0:1746065137.761257:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f100 x1830881272903040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.761272:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f100 with x1830881272903040 ext(0->4095) 00002000:00010000:1.0:1746065137.761275:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1f100 00000100:00100000:1.0:1746065137.761345:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13554 00000100:00100000:1.0:1746065137.761351:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272903040:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.761577:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272903040:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 225us (404us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.761582:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13554 00002000:00100000:1.0:1746065137.761587:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f100 x1830881272903040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.761593:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f100 with x1830881272903040 ext(0->4095) 00002000:00010000:1.0:1746065137.761596:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1f100 00000100:00100000:0.0:1746065137.762717:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.762800:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272903168 00000100:00100000:3.0:1746065137.762804:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272903168 00000100:00100000:3.0:1746065137.762837:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30230 00000100:00100000:3.0:1746065137.762843:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272903168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.762851:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.762862:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59b4 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.762881:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 75 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.762888:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.762889:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.762892:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.762915:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 75 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.762925:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 75 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.762934:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267656832:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.763726:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.763901:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267656832:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.763920:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.763935:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065137.764384:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272903168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1233us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.764390:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30230 00000100:00100000:0.0:1746065137.764981:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.765295:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272903296 00000100:00100000:2.0:1746065137.765300:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272903296 00010000:00010000:2.0:1746065137.765318:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.765335:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14202 00000100:00100000:2.0:1746065137.765340:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a943dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272903296:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.765350:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.765364:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.765373:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.765388:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ad expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.765397:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.765399:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.765404:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.765649:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.765672:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.765681:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267656960:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.766033:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.766781:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267656960:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.766793:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.766811:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a943dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2004:x1830881272903296:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1471us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.766821:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14202 00000100:00100000:0.0:1746065137.767511:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.767570:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272903552 00000100:00100000:1.0:1746065137.767574:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272903552 00002000:00100000:1.0:1746065137.767597:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ca80 x1830881272903552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.767605:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ca80 with x1830881272903552 ext(0->4095) 00002000:00010000:1.0:1746065137.767609:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ca80 00000100:00100000:1.0:1746065137.767629:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13555 00000100:00100000:1.0:1746065137.767635:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272903552:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.767734:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272903552:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (223us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.767740:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13555 00002000:00100000:1.0:1746065137.767746:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ca80 x1830881272903552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.767752:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ca80 with x1830881272903552 ext(0->4095) 00002000:00010000:1.0:1746065137.767755:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ca80 00000100:00100000:0.0:1746065137.769789:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.770069:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272903680 00000100:00100000:3.0:1746065137.770075:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272903680 00000100:00100000:3.0:1746065137.770143:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30231 00000100:00100000:3.0:1746065137.770150:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:1795:x1830881272903680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.770170:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.770184:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59bb expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.770205:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.770212:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.770213:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.770216:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.770244:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.770254:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 5 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.770268:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267657088:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.770370:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.771205:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267657088:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.771222:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.771230:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065137.771250:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1795:x1830881272903680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1101us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.771260:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30231 00000100:00100000:0.0:1746065137.771578:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.771639:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.771748:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272903808 00000100:00100000:2.0:1746065137.771752:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272903808 00010000:00010000:2.0:1746065137.771774:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.771801:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14203 00000100:00100000:2.0:1746065137.771806:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272903808:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.771813:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.771830:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.771838:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.771852:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fa43 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59b4 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.771876:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.771877:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.771882:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 75 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.771894:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 75 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.771919:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 75 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.771928:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267657216:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.771983:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.772127:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272903936 00000100:00100000:3.0:1746065137.772136:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272903936 00000100:00100000:3.0:1746065137.772154:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30232 00000100:00100000:3.0:1746065137.772164:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1791:x1830881272903936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.772173:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.772179:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59c2 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.772198:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.772204:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.772205:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.772208:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.772227:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.772236:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.772250:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267657344:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.772286:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.774838:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267657216:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.774857:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.775428:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272903808:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3620us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.775440:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14203 00000100:00100000:1.0:1746065137.775659:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.775720:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267657344:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.775744:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.775755:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:2.0:1746065137.775844:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272904192 00000100:00100000:2.0:1746065137.775849:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272904192 00002000:00100000:2.0:1746065137.775880:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf9500 x1830881272904192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.775887:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9500 with x1830881272904192 ext(0->4095) 00010000:00010000:2.0:1746065137.775899:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 78 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.775909:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 78 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.775914:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009faf9500 00000100:00100000:2.0:1746065137.775933:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2795 00000100:00100000:2.0:1746065137.775939:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2004:x1830881272904192:12345-192.168.202.8@tcp:3:ldlm_bl.0 00000100:00100000:3.0:1746065137.776329:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:1791:x1830881272903936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4169us (4750us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.776335:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30232 00000100:00100000:2.0:1746065137.776780:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881272904192:12345-192.168.202.8@tcp:3:ldlm_bl.0 Request processed in 841us (1120us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.776786:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2795 00002000:00100000:2.0:1746065137.776792:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf9500 x1830881272904192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.776799:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9500 with x1830881272904192 ext(0->4095) 00010000:00010000:2.0:1746065137.776804:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.776813:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.776818:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009faf9500 00000100:00100000:0.0:1746065137.780171:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.780265:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272904320 00000100:00100000:2.0:1746065137.780272:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272904320 00010000:00010000:2.0:1746065137.780306:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.780343:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14204 00000100:00100000:2.0:1746065137.780350:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2005:x1830881272904320:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.780361:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.780383:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.780393:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.780414:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fa4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59bb expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.780432:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.780433:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.780443:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.780449:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.780475:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.780484:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267657472:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.780560:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.783384:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.783589:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267657472:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.783613:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.783652:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881272904320:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3302us (3492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.783661:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14204 00000100:00100000:3.0:1746065137.783745:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272904576 00000100:00100000:3.0:1746065137.783751:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272904576 00002000:00100000:3.0:1746065137.783785:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f800 x1830881272904576/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.783792:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f800 with x1830881272904576 ext(0->4095) 00002000:00010000:3.0:1746065137.783796:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1f800 00000100:00100000:3.0:1746065137.784074:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13556 00000100:00100000:3.0:1746065137.784118:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2002:x1830881272904576:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746065137.784253:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2002:x1830881272904576:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 173us (875us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065137.784258:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13556 00002000:00100000:3.0:1746065137.784262:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f800 x1830881272904576/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.784277:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f800 with x1830881272904576 ext(0->4095) 00002000:00010000:3.0:1746065137.784280:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1f800 00000100:00100000:0.0:1746065137.786889:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.786979:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272904704 00000100:00100000:3.0:1746065137.786987:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272904704 00000100:00100000:3.0:1746065137.787429:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30233 00000100:00100000:3.0:1746065137.787436:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272904704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.787455:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.787470:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59c9 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.787498:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 75 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.787504:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.787505:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.787508:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.787536:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 75 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.787545:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 75 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.787560:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267657600:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.787631:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.789496:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.789621:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267657600:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.789641:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.789655:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065137.789692:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272904704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2256us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.789699:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30233 00000100:00100000:1.0:1746065137.789921:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272904832 00000100:00100000:1.0:1746065137.789927:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272904832 00002000:00100000:1.0:1746065137.789967:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4eb100 x1830881272904832/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.789975:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eb100 with x1830881272904832 ext(0->7) 00010000:00010000:1.0:1746065137.789980:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.789990:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 76 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.789996:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4eb100 00000100:00100000:1.0:1746065137.790010:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2796 00000100:00100000:1.0:1746065137.790016:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881272904832:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065137.791750:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2004:x1830881272904832:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1730us (2254us total) trans 4294972101 rc 0/0 00000100:00100000:0.0:1746065137.791758:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2796 00002000:00100000:0.0:1746065137.791765:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4eb100 x1830881272904832/t4294972101(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.791772:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eb100 with x1830881272904832 ext(0->7) 00010000:00010000:0.0:1746065137.791778:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 78 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.791789:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 78 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.791795:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4eb100 00000100:00100000:0.0:1746065137.797623:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.797729:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272904960 00000100:00100000:2.0:1746065137.797737:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272904960 00010000:00010000:2.0:1746065137.797766:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 78 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.797803:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14205 00000100:00100000:2.0:1746065137.797810:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881272904960:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.797825:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065137.797837:0:7200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1746065136 -> 1746065137 00002000:00010000:2.0:1746065137.797840:0:7200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1746065136 -> 1746065137 00010000:00010000:2.0:1746065137.797846:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 78 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.797857:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 78 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.797876:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fa51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c2 expref: 78 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.797901:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.797903:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.797909:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.797916:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.797954:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.797966:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267657728:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.798038:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.800351:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.800421:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.800684:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272905088 00000100:00100000:3.0:1746065137.800691:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272905088 00000100:00100000:3.0:1746065137.800735:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30234 00000100:00100000:3.0:1746065137.800741:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:1791:x1830881272905088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.800754:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.800766:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59d0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.800786:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.800792:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.800794:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.800797:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.800820:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.800830:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 5 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.800840:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267657856:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.800895:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.800995:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267657728:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.801010:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.801030:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881272904960:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3220us (3415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.801037:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14205 00000100:00100000:1.0:1746065137.801122:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272905344 00000100:00100000:1.0:1746065137.801126:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272905344 00002000:00100000:1.0:1746065137.801149:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9f80 x1830881272905344/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.801157:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9f80 with x1830881272905344 ext(0->4095) 00010000:00010000:1.0:1746065137.801162:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.801171:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.801177:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9f80 00000100:00100000:1.0:1746065137.801189:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2797 00000100:00100000:1.0:1746065137.801195:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272905344:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065137.801302:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272905344:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 106us (880us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.801307:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2797 00002000:00100000:1.0:1746065137.801311:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9f80 x1830881272905344/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.801318:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9f80 with x1830881272905344 ext(0->4095) 00010000:00010000:1.0:1746065137.801322:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.801330:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.801336:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9f80 00000100:00100000:3.0:1746065137.802292:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267657856:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.802305:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 78 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.802316:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065137.802346:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:1791:x1830881272905088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1605us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.802351:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30234 00000100:00100000:0.0:1746065137.805659:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.805842:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272905472 00000100:00100000:2.0:1746065137.805849:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272905472 00010000:00010000:2.0:1746065137.805878:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.805974:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14206 00000100:00100000:2.0:1746065137.805981:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272905472:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.805992:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.806007:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.806017:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.806035:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fa58 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59c9 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.806233:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.806236:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.806249:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.806258:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.806302:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.806313:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267657984:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.806669:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.808639:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.808737:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272905728 00000100:00100000:3.0:1746065137.808742:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272905728 00000100:00100000:2.0:1746065137.808747:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbf8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267657984:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.808764:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065137.808770:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4eaa00 x1830881272905728/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.808778:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eaa00 with x1830881272905728 ext(0->4095) 00002000:00010000:3.0:1746065137.808781:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4eaa00 00000100:00100000:2.0:1746065137.808792:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272905472:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2812us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.808809:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13557 00000100:00100000:3.0:1746065137.808815:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881272905728:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065137.808903:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881272905728:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 88us (269us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065137.808909:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13557 00002000:00100000:3.0:1746065137.808914:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4eaa00 x1830881272905728/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.808926:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eaa00 with x1830881272905728 ext(0->4095) 00002000:00010000:3.0:1746065137.808929:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4eaa00 00000100:00100000:2.0:1746065137.809047:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14206 00000100:00100000:0.0:1746065137.811250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.811378:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272905856 00000100:00100000:3.0:1746065137.811385:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272905856 00000100:00100000:3.0:1746065137.811417:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30235 00000100:00100000:3.0:1746065137.811423:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272905856:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.811439:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.811452:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59d7 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.811646:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.811652:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.811653:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.811656:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.811679:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 77 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.811689:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 77 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.811698:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267658112:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.812039:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.814154:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267658112:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.814180:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.814196:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065137.814225:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272905856:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2802us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.814232:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30235 00000100:00100000:0.0:1746065137.816126:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.816257:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272905984 00000100:00100000:3.0:1746065137.816264:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272905984 00002000:00100000:3.0:1746065137.816298:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f7c0380 x1830881272905984/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.816306:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0380 with x1830881272905984 ext(0->7) 00010000:00010000:3.0:1746065137.816311:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 78 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.816321:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 78 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:3.0:1746065137.816327:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0380 00000100:00100000:3.0:1746065137.816371:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2798 00000100:00100000:3.0:1746065137.816378:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881272905984:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065137.817204:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272905984:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 825us (1081us total) trans 4294972102 rc 0/0 00000100:00100000:0.0:1746065137.817211:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2798 00002000:00100000:0.0:1746065137.817217:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f7c0380 x1830881272905984/t4294972102(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 496/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.817224:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0380 with x1830881272905984 ext(0->7) 00010000:00010000:0.0:1746065137.817228:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.817238:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.817244:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0380 00000100:00100000:0.0:1746065137.818800:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.818860:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272906112 00000100:00100000:2.0:1746065137.818865:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272906112 00010000:00010000:2.0:1746065137.818884:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.819179:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14207 00000100:00100000:1.0:1746065137.819187:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2003:x1830881272906112:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.819197:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.819210:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.819219:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.819236:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fa5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d0 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.819250:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.819252:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.819257:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.819263:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.819285:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.819295:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267658240:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.819350:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.822831:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.822889:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272906368 00000100:00100000:2.0:1746065137.822898:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272906368 00002000:00100000:2.0:1746065137.822937:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c1c00 x1830881272906368/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.822957:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1c00 with x1830881272906368 ext(0->4095) 00002000:00010000:2.0:1746065137.822960:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c1c00 00000100:00100000:2.0:1746065137.822989:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13558 00000100:00100000:2.0:1746065137.822995:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272906368:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065137.823108:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267658240:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.823123:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.823161:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2003:x1830881272906112:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3975us (4364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.823170:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14207 00000100:00100000:2.0:1746065137.824019:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272906368:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 1023us (1193us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.824025:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13558 00002000:00100000:2.0:1746065137.824029:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c1c00 x1830881272906368/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.824036:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1c00 with x1830881272906368 ext(0->4095) 00002000:00010000:2.0:1746065137.824039:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c1c00 00000100:00100000:0.0:1746065137.825555:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.825613:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272906496 00000100:00100000:3.0:1746065137.825619:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272906496 00000100:00100000:3.0:1746065137.825682:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30236 00000100:00100000:3.0:1746065137.825688:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1795:x1830881272906496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.825700:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.825713:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59de expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.825735:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.825747:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.825749:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.825752:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.825777:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.825787:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 5 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.825797:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267658368:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.825870:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.827539:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.827757:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272906624 00000100:00100000:2.0:1746065137.827762:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272906624 00000100:00100000:2.0:1746065137.829349:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30237 00000100:00100000:2.0:1746065137.829358:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272906624:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065137.829373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065137.829374:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.829387:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59e5 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.829408:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.829412:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.829417:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746065137.829419:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272906752 00010000:00010000:2.0:1746065137.829420:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.829424:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272906752 00010000:00010000:1.0:1746065137.829442:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.829449:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.829458:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.829458:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14208 00000100:00100000:1.0:1746065137.829462:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272906752:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.829469:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.829471:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00010000:00010000:1.0:1746065137.829482:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.829490:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746065137.829500:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272906624:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (1966us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065137.829501:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.829503:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065137.829506:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30237 00010000:00010000:1.0:1746065137.829507:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.829513:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.829529:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.829538:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.829549:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267658624:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065137.829610:0:9560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa66 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59d7 expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.829625:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267658368:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.829637:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.829648:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065137.829654:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065137.829669:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272906496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3982us (4118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.829674:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30236 00000100:00100000:1.0:1746065137.829744:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.831123:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267658624:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.831134:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.831157:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272906752:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1694us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.831164:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14208 00000100:00100000:0.0:1746065137.831365:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.831399:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272907008 00000100:00100000:2.0:1746065137.831404:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272907008 00002000:00100000:2.0:1746065137.831429:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a6680 x1830881272907008/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.831436:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a6680 with x1830881272907008 ext(0->4095) 00010000:00010000:2.0:1746065137.831441:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.831452:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.831458:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a6680 00000100:00100000:2.0:1746065137.831480:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2799 00000100:00100000:2.0:1746065137.831486:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272907008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.831584:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272907008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (219us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.831590:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2799 00002000:00100000:2.0:1746065137.831596:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a6680 x1830881272907008/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.831608:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a6680 with x1830881272907008 ext(0->4095) 00010000:00010000:2.0:1746065137.831612:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.831621:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.831626:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a6680 00000100:00100000:0.0:1746065137.832998:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.833062:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.833139:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272907136 00000100:00100000:1.0:1746065137.833145:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272907136 00010000:00010000:1.0:1746065137.833165:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.833195:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14209 00000100:00100000:1.0:1746065137.833201:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272907136:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.833211:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.833223:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.833232:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.833249:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59de expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.833262:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.833264:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.833269:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.833279:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065137.833302:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272907264 00010000:00010000:1.0:1746065137.833302:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065137.833306:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272907264 00000100:00100000:1.0:1746065137.833312:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267658752:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065137.833330:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30238 00000100:00100000:3.0:1746065137.833335:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272907264:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.833345:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.833353:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59ec expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.833358:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77240 going to sleep for 11 seconds 00010000:00010000:3.0:1746065137.833370:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.833375:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.833376:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.833380:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.833394:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.833408:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.833415:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267658880:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.833436:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.835230:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267658752:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.835244:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.835279:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272907136:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2077us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.835287:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14209 00000100:00100000:0.0:1746065137.835590:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.835663:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272907520 00000100:00100000:2.0:1746065137.835668:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272907520 00002000:00100000:2.0:1746065137.835696:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a7b80 x1830881272907520/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.835705:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7b80 with x1830881272907520 ext(0->4095) 00010000:00010000:2.0:1746065137.835710:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.835722:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.835727:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a7b80 00000100:00100000:2.0:1746065137.835741:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2800 00000100:00100000:2.0:1746065137.835746:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272907520:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.835834:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272907520:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 87us (244us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.835839:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2800 00002000:00100000:2.0:1746065137.835844:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a7b80 x1830881272907520/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.835850:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7b80 with x1830881272907520 ext(0->4095) 00010000:00010000:2.0:1746065137.835854:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.835862:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.835867:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a7b80 00000100:00100000:3.0:1746065137.836073:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267658880:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.836109:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.836120:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065137.836140:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272907264:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2805us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.836145:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30238 00000100:00100000:0.0:1746065137.837760:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.838075:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272907648 00000100:00100000:3.0:1746065137.838110:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272907648 00000100:00100000:3.0:1746065137.838152:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30239 00000100:00100000:3.0:1746065137.838159:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272907648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.838171:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.838184:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59f3 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.838204:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.838208:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.838217:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065137.838220:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.838246:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065137.838253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065137.838255:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.838262:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065137.838291:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272907648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 133us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.838353:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30239 00000100:00100000:1.0:1746065137.838422:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272907776 00000100:00100000:1.0:1746065137.838425:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272907776 00010000:00010000:1.0:1746065137.838439:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 81 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.838465:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14210 00000100:00100000:1.0:1746065137.838470:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272907776:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.838477:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.838489:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 81 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.838498:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 81 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.838511:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fa74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59e5 expref: 81 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.838521:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.838522:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.838526:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.838533:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.838551:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.838560:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 5 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.838570:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267659136:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.838672:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.839146:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746065137.839385:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267659264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746065137.839530:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065137.839713:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267659264 00000100:00100000:3.0:1746065137.839716:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267659264 00000100:00100000:3.0:1746065137.839745:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1746065137.839751:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3766:x1830881267659264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746065137.839772:0:7217:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1445990400 avail 1316528128 00000100:00100000:3.0:1746065137.839806:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3766:x1830881267659264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.839810:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1746065137.839926:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267659264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746065137.840262:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267659136:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.840273:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.840285:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.840300:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272907776:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1830us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.840308:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14210 00000100:00100000:0.0:1746065137.840420:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272908032 00000100:00100000:0.0:1746065137.840424:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272908032 00002000:00100000:0.0:1746065137.840445:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93aa00 x1830881272908032/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.840454:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93aa00 with x1830881272908032 ext(0->4095) 00010000:00010000:0.0:1746065137.840482:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.840493:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.840499:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f93aa00 00000100:00100000:0.0:1746065137.840511:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2801 00000100:00100000:0.0:1746065137.840516:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272908032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065137.840594:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272908032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 77us (308us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065137.840599:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2801 00002000:00100000:0.0:1746065137.840604:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93aa00 x1830881272908032/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.840610:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93aa00 with x1830881272908032 ext(0->4095) 00010000:00010000:0.0:1746065137.840614:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.840622:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.840627:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f93aa00 00000100:00100000:0.0:1746065137.842409:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.842459:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272908160 00000100:00100000:1.0:1746065137.842465:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272908160 00010000:00010000:1.0:1746065137.842487:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.842526:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14211 00000100:00100000:1.0:1746065137.842532:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272908160:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.842553:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.842566:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.842576:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.842594:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fa7b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59ec expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.842606:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.842607:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.842613:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.842620:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.842645:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.842655:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267659392:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.842730:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.844529:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267659392:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.844546:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.844587:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881272908160:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2052us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.844622:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14211 00000100:00100000:0.0:1746065137.845033:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.845148:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272908416 00000100:00100000:2.0:1746065137.845154:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272908416 00002000:00100000:2.0:1746065137.845181:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1880 x1830881272908416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.845190:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1880 with x1830881272908416 ext(0->4095) 00002000:00010000:2.0:1746065137.845194:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b1880 00000100:00100000:2.0:1746065137.845212:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13559 00000100:00100000:2.0:1746065137.845218:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272908416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.845329:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272908416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 111us (296us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.845337:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13559 00002000:00100000:2.0:1746065137.845342:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1880 x1830881272908416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.845348:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1880 with x1830881272908416 ext(0->4095) 00002000:00010000:2.0:1746065137.845350:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b1880 00000100:00100000:0.0:1746065137.846758:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.846858:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272908544 00000100:00100000:3.0:1746065137.846864:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272908544 00000100:00100000:3.0:1746065137.846900:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30240 00000100:00100000:3.0:1746065137.846906:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272908544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.846916:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.846929:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e59fa expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.846963:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.846969:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.846971:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.846974:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.846999:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.847009:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 79 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.847019:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267659520:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.847122:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.848439:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267659520:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.848457:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.848467:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065137.848489:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272908544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1584us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.848498:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30240 00000100:00100000:0.0:1746065137.849926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.849983:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272908672 00000100:00100000:1.0:1746065137.849989:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272908672 00010000:00010000:1.0:1746065137.850012:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.850072:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14212 00000100:00100000:1.0:1746065137.850108:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272908672:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.850119:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.850134:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.850144:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.850162:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fa82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59f3 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.850181:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.850183:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.850189:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.850196:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.850219:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.850229:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267659648:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.850551:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.852192:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267659648:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.852207:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.852236:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881272908672:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2157us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.852245:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14212 00000100:00100000:0.0:1746065137.852557:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.852577:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272908928 00000100:00100000:2.0:1746065137.852582:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272908928 00002000:00100000:2.0:1746065137.852610:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2680 x1830881272908928/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.852617:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2680 with x1830881272908928 ext(0->4095) 00002000:00010000:2.0:1746065137.852621:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b2680 00000100:00100000:2.0:1746065137.852648:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13560 00000100:00100000:2.0:1746065137.852654:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272908928:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.852756:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272908928:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (199us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.852762:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13560 00002000:00100000:2.0:1746065137.852767:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2680 x1830881272908928/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.852773:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2680 with x1830881272908928 ext(0->4095) 00002000:00010000:2.0:1746065137.852776:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b2680 00000100:00100000:0.0:1746065137.854541:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.854584:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272909056 00000100:00100000:3.0:1746065137.854590:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272909056 00000100:00100000:3.0:1746065137.854627:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30241 00000100:00100000:3.0:1746065137.854633:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1795:x1830881272909056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.854645:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.854658:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a01 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.854679:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.854685:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.854687:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.854690:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.854712:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.854722:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 5 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.854732:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267659776:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.854801:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.855891:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.856017:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272909184 00000100:00100000:2.0:1746065137.856023:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272909184 00000100:00100000:0.0:1746065137.856203:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.856239:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30242 00000100:00100000:2.0:1746065137.856246:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272909184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.856258:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065137.856261:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267659776:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065137.856267:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a08 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.856279:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.856281:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.856284:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.856289:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746065137.856290:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272909312 00010000:00010000:2.0:1746065137.856292:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.856295:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272909312 00010000:00010000:3.0:1746065137.856301:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00010000:00010000:1.0:1746065137.856314:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.856315:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.856323:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.856329:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:3.0:1746065137.856335:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881272909056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1703us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.856335:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14213 00000100:00100000:1.0:1746065137.856340:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272909312:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065137.856341:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30241 00000100:00100000:2.0:1746065137.856343:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272909184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 99us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.856347:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30242 00010000:00010000:1.0:1746065137.856349:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.856364:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.856374:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.856390:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fa89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e59fa expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.856418:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.856420:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.856425:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.856698:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.856719:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.856727:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 80 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.856737:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267660032:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.856784:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.859984:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267660032:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.860001:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.860049:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272909312:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3708us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.860058:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14213 00000100:00100000:0.0:1746065137.860362:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.860408:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272909568 00000100:00100000:1.0:1746065137.860413:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272909568 00002000:00100000:1.0:1746065137.860442:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918e00 x1830881272909568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.860456:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918e00 with x1830881272909568 ext(0->4095) 00010000:00010000:1.0:1746065137.860468:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.860479:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.860485:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918e00 00000100:00100000:1.0:1746065137.860500:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2802 00000100:00100000:1.0:1746065137.860506:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272909568:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.860596:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272909568:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 90us (235us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.860601:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2802 00002000:00100000:1.0:1746065137.860606:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918e00 x1830881272909568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.860611:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918e00 with x1830881272909568 ext(0->4095) 00010000:00010000:1.0:1746065137.860615:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.860622:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065137.860627:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918e00 00000100:00100000:0.0:1746065137.862541:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.862582:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272909824 00000100:00100000:1.0:1746065137.862588:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272909824 00010000:00010000:1.0:1746065137.862611:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.862679:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14214 00000100:00100000:1.0:1746065137.862686:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272909824:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.862696:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.862712:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.862721:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.862739:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fa90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a01 expref: 81 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.862751:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.862753:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.862759:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.862766:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.862791:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.862802:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267660160:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.862856:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.862941:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.863100:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272909696 00000100:00100000:3.0:1746065137.863104:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272909696 00000100:00100000:3.0:1746065137.863129:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30243 00000100:00100000:3.0:1746065137.863134:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272909696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.863144:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.863153:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a0f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.863168:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.863174:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.863175:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.863178:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.863191:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.863199:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.863383:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267660288:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.863435:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.864582:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267660160:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.864594:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.864616:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272909824:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1930us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.864624:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14214 00000100:00100000:0.0:1746065137.865231:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.865383:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272910080 00000100:00100000:2.0:1746065137.865388:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272910080 00002000:00100000:2.0:1746065137.865416:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091ca80 x1830881272910080/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.865424:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ca80 with x1830881272910080 ext(0->4095) 00010000:00010000:2.0:1746065137.865431:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.865441:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.865447:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091ca80 00000100:00100000:2.0:1746065137.865468:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2803 00000100:00100000:2.0:1746065137.865473:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272910080:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.865557:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272910080:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 83us (328us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.865562:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2803 00002000:00100000:2.0:1746065137.865566:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091ca80 x1830881272910080/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.865572:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ca80 with x1830881272910080 ext(0->4095) 00010000:00010000:2.0:1746065137.865575:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746065137.865583:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746065137.865587:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091ca80 00000100:00100000:3.0:1746065137.866744:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267660288:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.866766:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.866780:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065137.866823:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272909696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3688us (3881us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.866830:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30243 00000100:00100000:0.0:1746065137.868557:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.868807:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.868880:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272910208 00000100:00100000:1.0:1746065137.868887:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272910208 00010000:00010000:1.0:1746065137.868914:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.868958:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14215 00000100:00100000:1.0:1746065137.868966:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272910208:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.868977:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.868995:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.869006:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.869024:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fa97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a08 expref: 80 pid: 21550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.869050:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.869052:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.869057:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.869069:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.869116:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.869128:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267660416:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.869190:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.870205:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272910336 00000100:00100000:3.0:1746065137.870211:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272910336 00000100:00100000:3.0:1746065137.870251:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30244 00000100:00100000:3.0:1746065137.870258:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272910336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.870271:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.870283:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a16 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.870301:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.870307:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.870308:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.870311:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.870332:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.870341:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 5 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065137.870349:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267660544:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.870408:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.870868:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267660416:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.870881:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.870903:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272910208:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1937us (2351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.870910:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14215 00000100:00100000:2.0:1746065137.872631:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.872749:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272910592 00000100:00100000:0.0:1746065137.872755:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272910592 00002000:00100000:0.0:1746065137.872785:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938700 x1830881272910592/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.872793:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938700 with x1830881272910592 ext(0->4095) 00010000:00010000:0.0:1746065137.872800:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.872811:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.872818:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938700 00000100:00100000:0.0:1746065137.872842:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2804 00000100:00100000:0.0:1746065137.872853:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272910592:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065137.872981:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272910592:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 132us (355us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065137.872987:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2804 00002000:00100000:0.0:1746065137.872992:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938700 x1830881272910592/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065137.872999:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938700 with x1830881272910592 ext(0->4095) 00010000:00010000:0.0:1746065137.873003:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065137.873011:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065137.873016:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938700 00000100:00100000:3.0:1746065137.873106:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267660544:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.873124:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.873135:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065137.873168:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272910336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2910us (4361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.873175:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30244 00000100:00100000:0.0:1746065137.876173:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.876241:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272910720 00000100:00100000:1.0:1746065137.876248:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272910720 00010000:00010000:1.0:1746065137.876274:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065137.876734:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14216 00000100:00100000:1.0:1746065137.876741:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272910720:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.876751:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.876768:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.876778:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.876797:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fa9e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a0f expref: 6 pid: 9560 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065137.876823:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.876824:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.876830:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.876836:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.876861:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.876871:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267660672:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.876950:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.879525:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.879643:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267660672:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.879658:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.879693:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272910720:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2953us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.879702:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14216 00000100:00100000:2.0:1746065137.879939:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272910976 00000100:00100000:2.0:1746065137.879962:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272910976 00002000:00100000:2.0:1746065137.879993:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc10a80 x1830881272910976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.880003:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10a80 with x1830881272910976 ext(0->4095) 00002000:00010000:2.0:1746065137.880006:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc10a80 00000100:00100000:2.0:1746065137.880022:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13561 00000100:00100000:2.0:1746065137.880028:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272910976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.880158:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272910976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 130us (638us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.880163:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13561 00002000:00100000:2.0:1746065137.880168:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc10a80 x1830881272910976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.880174:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10a80 with x1830881272910976 ext(0->4095) 00002000:00010000:2.0:1746065137.880177:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc10a80 00000100:00100000:0.0:1746065137.882423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.882571:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272911104 00000100:00100000:3.0:1746065137.882577:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272911104 00000100:00100000:3.0:1746065137.882624:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30245 00000100:00100000:3.0:1746065137.882631:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272911104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.882644:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.882659:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a1d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.882683:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.882691:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.882693:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.882696:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.882722:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.882733:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 79 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065137.882743:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267660800:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.882822:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.884251:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267660800:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.884269:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.884281:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065137.884306:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272911104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1676us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.884313:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30245 00000100:00100000:0.0:1746065137.886133:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.886188:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272911232 00000100:00100000:1.0:1746065137.886198:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272911232 00010000:00010000:1.0:1746065137.886225:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.886568:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14217 00000100:00100000:1.0:1746065137.886575:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272911232:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.886585:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.886602:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.886612:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.886634:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faa5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a16 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.886755:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.886757:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.886763:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.886770:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.886796:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.886807:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267660928:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.886886:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.888295:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267660928:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.888308:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.888331:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2004:x1830881272911232:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1758us (2205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.888339:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14217 00000100:00100000:0.0:1746065137.888639:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.888743:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272911488 00000100:00100000:1.0:1746065137.888748:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272911488 00002000:00100000:1.0:1746065137.888773:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3a680 x1830881272911488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.888782:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3a680 with x1830881272911488 ext(0->4095) 00002000:00010000:1.0:1746065137.888786:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc3a680 00000100:00100000:1.0:1746065137.888833:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13562 00000100:00100000:1.0:1746065137.888839:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272911488:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065137.889102:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272911488:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 242us (442us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065137.889108:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13562 00002000:00100000:1.0:1746065137.889113:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3a680 x1830881272911488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.889120:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3a680 with x1830881272911488 ext(0->4095) 00002000:00010000:1.0:1746065137.889123:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc3a680 00000100:00100000:2.0:1746065137.890373:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.890496:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272911616 00000100:00100000:3.0:1746065137.890502:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272911616 00000100:00100000:3.0:1746065137.890541:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30246 00000100:00100000:3.0:1746065137.890547:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1791:x1830881272911616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.890560:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.890573:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a24 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.890594:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.890601:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.890602:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.890605:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.890628:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.890637:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065137.890647:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267661056:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.890717:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.893576:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.893752:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272911744 00000100:00100000:2.0:1746065137.893784:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272911744 00000100:00100000:2.0:1746065137.893832:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30247 00000100:00100000:2.0:1746065137.893838:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272911744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065137.893852:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065137.893865:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a2b expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.893884:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.893889:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.893899:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065137.893905:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.893932:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.893952:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.893961:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065137.893992:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881272911744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 155us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.893998:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30247 00000100:00100000:3.0:1746065137.894118:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267661056:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.894134:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.894142:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065137.894158:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272911616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3611us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.894167:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30246 00000100:00100000:0.0:1746065137.894240:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.894256:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272911872 00000100:00100000:1.0:1746065137.894260:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272911872 00010000:00010000:1.0:1746065137.894275:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.894294:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14218 00000100:00100000:1.0:1746065137.894300:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272911872:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.894306:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.894321:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.894330:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.894344:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87faac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a1d expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.894355:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.894357:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.894362:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.894368:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.894386:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.894395:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.894409:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267661312:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.894459:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.897468:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267661312:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.897483:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.897521:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272911872:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3219us (3279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.897529:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14218 00000100:00100000:0.0:1746065137.897587:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.897790:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272912128 00000100:00100000:1.0:1746065137.897795:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272912128 00002000:00100000:1.0:1746065137.897822:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3df80 x1830881272912128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065137.897832:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3df80 with x1830881272912128 ext(0->4095) 00010000:00010000:1.0:1746065137.897838:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.897850:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065137.897856:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3df80 00000100:00100000:2.0:1746065137.898294:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2805 00000100:00100000:2.0:1746065137.898301:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2002:x1830881272912128:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746065137.898412:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2002:x1830881272912128:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 112us (825us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.898418:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2805 00002000:00100000:2.0:1746065137.898422:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3df80 x1830881272912128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.898429:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3df80 with x1830881272912128 ext(0->4095) 00010000:00010000:2.0:1746065137.898434:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.898447:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065137.898452:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3df80 00000100:00100000:0.0:1746065137.902828:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.903897:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272912256 00000100:00100000:1.0:1746065137.903906:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272912256 00010000:00010000:1.0:1746065137.903939:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.904025:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14219 00000100:00100000:1.0:1746065137.904032:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2003:x1830881272912256:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.904043:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.904059:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.904071:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.904227:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fab3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a24 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.905003:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.905006:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.905014:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.905024:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.905054:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.905065:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267661440:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.905736:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.913353:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.913372:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267661440:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.913388:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.913424:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2003:x1830881272912256:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 9392us (10604us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.913432:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14219 00000100:00100000:2.0:1746065137.913493:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272912512 00000100:00100000:2.0:1746065137.913499:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272912512 00002000:00100000:2.0:1746065137.913528:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b89500 x1830881272912512/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.913537:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b89500 with x1830881272912512 ext(0->4095) 00002000:00010000:2.0:1746065137.913541:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b89500 00000100:00100000:2.0:1746065137.913570:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13563 00000100:00100000:2.0:1746065137.913576:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272912512:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.913673:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272912512:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 97us (327us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.913679:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13563 00002000:00100000:2.0:1746065137.913683:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b89500 x1830881272912512/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.913690:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b89500 with x1830881272912512 ext(0->4095) 00002000:00010000:2.0:1746065137.913693:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b89500 00000100:00100000:0.0:1746065137.918872:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.918922:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272912640 00000100:00100000:1.0:1746065137.918930:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272912640 00000100:00100000:1.0:1746065137.918984:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30248 00000100:00100000:1.0:1746065137.918991:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272912640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.919003:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.919017:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a32 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.919041:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.919047:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.919048:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.919056:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.919096:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.919107:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 79 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.919117:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267661568:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065137.919196:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.920753:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267661568:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065137.920773:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.920784:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065137.920821:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272912640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1830us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.920829:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30248 00000100:00100000:0.0:1746065137.921433:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.921551:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272912768 00000100:00100000:1.0:1746065137.921556:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272912768 00010000:00010000:1.0:1746065137.921576:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.921856:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14220 00000100:00100000:1.0:1746065137.921863:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272912768:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.921872:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.921887:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.921899:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.922112:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87faba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a2b expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.922131:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.922132:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.922139:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.922145:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.922165:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.922175:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267661696:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.922236:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.922618:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.922673:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272912896 00000100:00100000:1.0:1746065137.922677:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272912896 00000100:00100000:1.0:1746065137.922703:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30249 00000100:00100000:1.0:1746065137.922789:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272912896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.922799:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.922808:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a39 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.922821:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.922826:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.922827:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.922830:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.922845:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.922857:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.922865:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267661824:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065137.922896:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.924036:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.924052:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267661696:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.924062:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.924098:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272912768:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2235us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.924104:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14220 00000100:00100000:2.0:1746065137.924235:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272913152 00000100:00100000:2.0:1746065137.924240:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272913152 00002000:00100000:2.0:1746065137.924263:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a0000 x1830881272913152/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.924277:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0000 with x1830881272913152 ext(0->4095) 00010000:00010000:2.0:1746065137.924282:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.924291:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065137.924297:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a0000 00000100:00100000:2.0:1746065137.924319:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2806 00000100:00100000:2.0:1746065137.924323:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272913152:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.924404:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272913152:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 80us (368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.924409:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2806 00002000:00100000:2.0:1746065137.924414:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a0000 x1830881272913152/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.924421:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0000 with x1830881272913152 ext(0->4095) 00010000:00010000:2.0:1746065137.924425:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.924433:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065137.924438:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a0000 00000100:00100000:1.0:1746065137.924765:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267661824:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065137.924777:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.924787:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065137.924875:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272912896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2165us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.924880:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30249 00000100:00100000:0.0:1746065137.926138:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.926156:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272913280 00000100:00100000:1.0:1746065137.926162:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272913280 00000100:00100000:1.0:1746065137.926196:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30250 00000100:00100000:1.0:1746065137.926202:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881272913280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.926211:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.926221:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a40 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.926236:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.926240:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.926245:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.926248:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.926272:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.926281:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.926288:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:1.0:1746065137.926322:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272913280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 120us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.926327:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30250 00000100:00100000:0.0:1746065137.926500:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.926729:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272913408 00000100:00100000:1.0:1746065137.926733:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272913408 00010000:00010000:1.0:1746065137.926746:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.926763:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14221 00000100:00100000:1.0:1746065137.926768:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272913408:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.926778:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.926791:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.926800:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.926814:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fac1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a32 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.926926:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.926928:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.926933:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.926940:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.926968:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.926977:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.926986:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267662080:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.927035:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.928118:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267662080:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.928129:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.928150:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272913408:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1382us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.928157:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14221 00000100:00100000:0.0:1746065137.929408:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.929507:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272913664 00000100:00100000:3.0:1746065137.929514:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272913664 00002000:00100000:3.0:1746065137.929549:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1180 x1830881272913664/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.929559:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1180 with x1830881272913664 ext(0->4095) 00010000:00010000:3.0:1746065137.929566:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065137.929577:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065137.929583:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1180 00000100:00100000:3.0:1746065137.929615:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2807 00000100:00100000:3.0:1746065137.929622:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272913664:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065137.929738:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272913664:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 116us (333us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065137.929744:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2807 00002000:00100000:3.0:1746065137.929749:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1180 x1830881272913664/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.929756:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1180 with x1830881272913664 ext(0->4095) 00010000:00010000:3.0:1746065137.929760:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065137.929773:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065137.929779:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1180 00000100:00100000:0.0:1746065137.933027:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.933179:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272913792 00000100:00100000:1.0:1746065137.933187:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272913792 00010000:00010000:1.0:1746065137.933214:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.933237:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14222 00000100:00100000:1.0:1746065137.933243:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272913792:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.933254:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.933268:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.933279:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.933297:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fac8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a39 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.933310:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.933313:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.933318:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.933325:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.933350:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.933361:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267662208:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065137.933726:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.935672:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267662208:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065137.935686:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.935714:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272913792:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2471us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.935723:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14222 00000100:00100000:0.0:1746065137.944234:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.944340:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272914048 00000100:00100000:2.0:1746065137.944349:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272914048 00002000:00100000:2.0:1746065137.944384:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788380 x1830881272914048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.944394:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788380 with x1830881272914048 ext(0->4095) 00002000:00010000:2.0:1746065137.944399:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788380 00000100:00100000:2.0:1746065137.944545:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13564 00000100:00100000:2.0:1746065137.944552:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272914048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.944667:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272914048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 115us (440us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.944673:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13564 00002000:00100000:2.0:1746065137.944679:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788380 x1830881272914048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.944685:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788380 with x1830881272914048 ext(0->4095) 00002000:00010000:2.0:1746065137.944687:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788380 00000100:00100000:0.0:1746065137.947217:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.947287:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272914176 00000100:00100000:3.0:1746065137.947294:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272914176 00000100:00100000:3.0:1746065137.947384:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30251 00000100:00100000:3.0:1746065137.947391:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272914176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.947404:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.947418:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a47 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.947442:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.947448:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.947450:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.947453:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.947477:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.947486:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 79 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065137.947496:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267662336:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.947591:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.948992:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267662336:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.949011:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.949023:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065137.949064:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272914176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1672us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.949070:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30251 00000100:00100000:0.0:1746065137.949152:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.949204:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272914304 00000100:00100000:2.0:1746065137.949209:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272914304 00010000:00010000:2.0:1746065137.949228:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065137.949246:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14223 00000100:00100000:2.0:1746065137.949252:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272914304:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.949260:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.949429:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.949445:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.949462:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87facf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a40 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.949483:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.949485:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.949490:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.949497:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.949518:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.949526:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267662464:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.949575:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.950648:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267662464:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.950659:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.950713:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881272914304:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1461us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.950719:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14223 00000100:00100000:1.0:1746065137.950771:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.950877:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272914560 00000100:00100000:3.0:1746065137.950881:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272914560 00002000:00100000:3.0:1746065137.950905:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ed80 x1830881272914560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.950913:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ed80 with x1830881272914560 ext(0->4095) 00002000:00010000:3.0:1746065137.950916:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ed80 00000100:00100000:3.0:1746065137.950938:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13565 00000100:00100000:3.0:1746065137.950952:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272914560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065137.951043:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272914560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 99us (272us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065137.951047:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13565 00002000:00100000:3.0:1746065137.951052:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ed80 x1830881272914560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.951058:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ed80 with x1830881272914560 ext(0->4095) 00002000:00010000:3.0:1746065137.951060:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ed80 00000100:00100000:0.0:1746065137.952608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.952641:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.952732:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272914688 00000100:00100000:1.0:1746065137.952738:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272914688 00000100:00100000:1.0:1746065137.952931:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272914816 00000100:00100000:1.0:1746065137.952934:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272914816 00000100:00100000:3.0:1746065137.952935:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30252 00000100:00100000:3.0:1746065137.952952:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272914688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:1.0:1746065137.952970:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30253 00000100:00100000:1.0:1746065137.952975:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881272914816:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.952981:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.952981:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.952993:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a4e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.952994:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a55 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.953013:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.953209:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.953212:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.953216:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.953224:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.953228:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.953233:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.953235:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.953253:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.953256:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.953263:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065137.953271:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.953272:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267662720:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.953279:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065137.953341:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272914688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 398us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.953346:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30252 00000100:00100000:1.0:1746065137.953357:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.956612:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.956682:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272914944 00000100:00100000:2.0:1746065137.956688:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272914944 00010000:00010000:2.0:1746065137.956716:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065137.956738:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14224 00000100:00100000:2.0:1746065137.956744:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272914944:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.956755:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.956784:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.956794:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.956811:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.956812:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.956818:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.956825:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.956850:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.956859:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065137.956867:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267662848:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.956931:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065137.957023:0:9558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fad6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a47 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.957038:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267662720:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065137.957053:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.957060:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065137.957068:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065137.957112:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272914816:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4135us (4470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.957118:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30253 00000100:00100000:2.0:1746065137.958845:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267662848:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.958858:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.958887:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272914944:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2143us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.958895:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14224 00000100:00100000:0.0:1746065137.959483:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.959573:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272915200 00000100:00100000:2.0:1746065137.959579:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272915200 00002000:00100000:2.0:1746065137.959607:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788a80 x1830881272915200/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.959616:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788a80 with x1830881272915200 ext(0->4095) 00010000:00010000:2.0:1746065137.959623:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.959634:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065137.959640:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b788a80 00000100:00100000:2.0:1746065137.960056:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2808 00000100:00100000:2.0:1746065137.960064:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272915200:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065137.960206:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272915200:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 142us (723us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.960214:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2808 00002000:00100000:2.0:1746065137.960219:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788a80 x1830881272915200/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.960226:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788a80 with x1830881272915200 ext(0->4095) 00010000:00010000:2.0:1746065137.960231:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.960239:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065137.960244:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b788a80 00000100:00100000:0.0:1746065137.962072:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.962233:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272915328 00000100:00100000:1.0:1746065137.962240:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272915328 00000100:00100000:1.0:1746065137.962280:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30254 00000100:00100000:1.0:1746065137.962286:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272915328:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.962297:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.962308:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a5c expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.962328:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.962333:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.962339:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065137.962342:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.962370:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.962381:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065137.962483:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.962576:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272915456 00010000:00010000:1.0:1746065137.962578:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:2.0:1746065137.962580:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272915456 00010000:00010000:2.0:1746065137.962595:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.962607:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272915328:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 322us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.962613:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30254 00000100:00100000:2.0:1746065137.962614:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14225 00000100:00100000:2.0:1746065137.962618:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272915456:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.962625:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.962638:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.962646:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.962660:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fae4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a55 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.962686:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.962687:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.962692:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.962703:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.962722:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.962731:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065137.962812:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267663104:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.962919:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.964060:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267663104:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.964068:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.964104:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272915456:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1486us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.964110:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14225 00000100:00100000:0.0:1746065137.965069:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.965708:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272915712 00000100:00100000:2.0:1746065137.965713:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272915712 00002000:00100000:2.0:1746065137.965743:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d650e00 x1830881272915712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.965752:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d650e00 with x1830881272915712 ext(0->4095) 00010000:00010000:2.0:1746065137.965758:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.965769:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065137.965776:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d650e00 00000100:00100000:2.0:1746065137.965801:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2809 00000100:00100000:2.0:1746065137.965806:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2002:x1830881272915712:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746065137.965900:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2002:x1830881272915712:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 94us (834us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.965905:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2809 00002000:00100000:2.0:1746065137.965910:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d650e00 x1830881272915712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.965917:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d650e00 with x1830881272915712 ext(0->4095) 00010000:00010000:2.0:1746065137.965920:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.965928:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065137.965933:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d650e00 00000100:00100000:0.0:1746065137.968303:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.968342:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272915840 00000100:00100000:1.0:1746065137.968347:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272915840 00000100:00100000:0.0:1746065137.968366:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065137.968383:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30255 00000100:00100000:1.0:1746065137.968389:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272915840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065137.968402:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.968414:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a63 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.968434:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.968440:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.968446:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065137.968454:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.968484:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.968498:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.968506:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00000100:00100000:2.0:1746065137.968518:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272915968 00000100:00100000:2.0:1746065137.968522:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272915968 00010000:00010000:2.0:1746065137.968534:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 82 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065137.968545:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272915840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 157us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.968551:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30255 00000100:00100000:2.0:1746065137.969209:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14226 00000100:00100000:2.0:1746065137.969215:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2003:x1830881272915968:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.969222:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.969236:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.969246:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.969260:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fadd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a4e expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.969280:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.969281:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.969286:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.969292:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.969311:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.969320:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065137.969330:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267663360:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.970343:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.974507:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267663360:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.974527:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.974560:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2003:x1830881272915968:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5345us (6193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.974570:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14226 00000100:00100000:0.0:1746065137.975171:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.975420:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272916224 00000100:00100000:3.0:1746065137.975427:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272916224 00002000:00100000:3.0:1746065137.975457:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d650000 x1830881272916224/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.975471:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d650000 with x1830881272916224 ext(0->4095) 00010000:00010000:3.0:1746065137.975477:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065137.975488:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065137.975493:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d650000 00000100:00100000:3.0:1746065137.975519:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2810 00000100:00100000:3.0:1746065137.975526:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272916224:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065137.975630:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272916224:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 105us (460us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065137.975636:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2810 00002000:00100000:3.0:1746065137.975642:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d650000 x1830881272916224/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.975649:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d650000 with x1830881272916224 ext(0->4095) 00010000:00010000:3.0:1746065137.975653:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065137.975661:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065137.975666:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d650000 00000100:00100000:0.0:1746065137.980517:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.980595:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272916352 00000100:00100000:2.0:1746065137.980603:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272916352 00010000:00010000:2.0:1746065137.980630:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065137.980667:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14227 00000100:00100000:2.0:1746065137.980674:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272916352:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.981125:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.981142:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.981154:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.981173:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87faeb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a5c expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.981200:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.981202:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.981208:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.981216:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.981244:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.981255:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267663488:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.982108:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065137.984388:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267663488:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.984404:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.984436:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272916352:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3762us (3926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.984444:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14227 00000100:00100000:0.0:1746065137.985351:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.985403:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272916608 00000100:00100000:2.0:1746065137.985409:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272916608 00002000:00100000:2.0:1746065137.985440:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d651180 x1830881272916608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.985448:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651180 with x1830881272916608 ext(0->4095) 00002000:00010000:2.0:1746065137.985452:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d651180 00000100:00100000:2.0:1746065137.985573:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13566 00000100:00100000:2.0:1746065137.985580:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272916608:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065137.985676:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272916608:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (327us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065137.985681:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13566 00002000:00100000:2.0:1746065137.985686:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d651180 x1830881272916608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065137.985692:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651180 with x1830881272916608 ext(0->4095) 00002000:00010000:2.0:1746065137.985695:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d651180 00000100:00100000:0.0:1746065137.987739:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.987795:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272916736 00000100:00100000:3.0:1746065137.987801:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272916736 00000100:00100000:3.0:1746065137.987854:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30256 00000100:00100000:3.0:1746065137.987861:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272916736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.987888:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.987902:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a6a expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.987923:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.987930:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.987931:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.987934:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.987975:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.987985:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 79 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065137.987996:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267663616:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.988101:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.989299:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267663616:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.989314:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.989325:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065137.989475:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272916736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1500us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.989482:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30256 00000100:00100000:0.0:1746065137.989893:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065137.989967:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272916864 00000100:00100000:2.0:1746065137.989972:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272916864 00010000:00010000:2.0:1746065137.989991:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065137.990027:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14228 00000100:00100000:2.0:1746065137.990033:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272916864:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065137.990046:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065137.990061:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.990070:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.990122:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87faf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a63 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065137.990143:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.990145:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065137.990150:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.990156:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065137.990177:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065137.990198:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267663744:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065137.990256:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.995719:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065137.995780:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.995999:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272917120 00000100:00100000:3.0:1746065137.996007:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272917120 00000100:00100000:3.0:1746065137.996053:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30257 00000100:00100000:3.0:1746065137.996060:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272917120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.996072:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.996110:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a71 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.996135:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.996141:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.996143:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.996146:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.996170:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.996179:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065137.996189:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267663872:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065137.996249:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065137.996264:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272917248 00000100:00100000:3.0:1746065137.996267:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272917248 00002000:00100000:3.0:1746065137.996287:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb95880 x1830881272917248/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.996294:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb95880 with x1830881272917248 ext(0->4095) 00010000:00010000:3.0:1746065137.996299:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065137.996307:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065137.996312:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb95880 00000100:00100000:3.0:1746065137.996325:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2811 00000100:00100000:3.0:1746065137.996329:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272917248:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065137.996414:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272917248:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 85us (634us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065137.996420:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2811 00002000:00100000:3.0:1746065137.996425:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb95880 x1830881272917248/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065137.996431:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb95880 with x1830881272917248 ext(0->4095) 00010000:00010000:3.0:1746065137.996435:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065137.996442:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065137.996446:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb95880 00000100:00100000:2.0:1746065137.996556:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267663744:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065137.996567:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065137.996583:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272916864:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6551us (6692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065137.996589:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14228 00000100:00100000:0.0:1746065137.998016:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065137.998121:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267663872:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065137.998137:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.998149:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065137.998174:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272917120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2116us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.998189:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30257 00000100:00100000:3.0:1746065137.998915:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272917376 00000100:00100000:3.0:1746065137.998920:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272917376 00000100:00100000:3.0:1746065137.998964:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30258 00000100:00100000:3.0:1746065137.998970:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881272917376:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065137.998980:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065137.998989:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a78 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.999003:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065137.999007:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.999011:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065137.999014:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.999033:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.999041:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065137.999047:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065137.999074:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272917376:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 105us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065137.999093:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30258 00000100:00100000:0.0:1746065138.000325:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.000393:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272917504 00000100:00100000:2.0:1746065138.000398:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272917504 00010000:00010000:2.0:1746065138.000464:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00080000:3.0:1746065138.000514:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065138.000557:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14229 00000100:00100000:2.0:1746065138.000563:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272917504:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.000572:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.000586:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.000596:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.000610:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87faf9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a6a expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.000631:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.000633:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.000638:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.000645:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.000664:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.000673:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.000682:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267664128:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.000979:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.002801:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267664128:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.002815:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.002841:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272917504:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2278us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.002849:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14229 00000100:00100000:0.0:1746065138.003465:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.004056:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272917760 00000100:00100000:3.0:1746065138.004062:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272917760 00002000:00100000:3.0:1746065138.004132:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9fa680 x1830881272917760/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.004141:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9fa680 with x1830881272917760 ext(0->4095) 00010000:00010000:3.0:1746065138.004148:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.004160:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.004166:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9fa680 00000100:00100000:3.0:1746065138.004191:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2812 00000100:00100000:3.0:1746065138.004197:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272917760:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.004299:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272917760:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (835us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.004305:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2812 00002000:00100000:3.0:1746065138.004310:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9fa680 x1830881272917760/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.004321:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9fa680 with x1830881272917760 ext(0->4095) 00010000:00010000:3.0:1746065138.004325:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.004333:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.004337:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9fa680 00000100:00080000:0.0:1746065138.004377:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065138.006464:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.006508:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272917888 00000100:00100000:2.0:1746065138.006514:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272917888 00010000:00010000:2.0:1746065138.006535:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.006561:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14230 00000100:00100000:2.0:1746065138.006567:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2003:x1830881272917888:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.006578:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.006590:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.006599:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.006615:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fb00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a71 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.006633:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.006635:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.006640:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.006647:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.006669:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.006677:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267664256:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.006732:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.008035:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267664256:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.008046:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.008071:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2003:x1830881272917888:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1500us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.008101:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14230 00000100:00100000:0.0:1746065138.008531:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.008642:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272918144 00000100:00100000:3.0:1746065138.008647:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272918144 00002000:00100000:3.0:1746065138.008671:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f8000 x1830881272918144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.008679:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f8000 with x1830881272918144 ext(0->4095) 00002000:00010000:3.0:1746065138.008683:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9f8000 00000100:00100000:3.0:1746065138.008707:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13567 00000100:00100000:3.0:1746065138.008712:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272918144:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.008789:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272918144:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 77us (259us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.008793:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13567 00002000:00100000:3.0:1746065138.008797:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f8000 x1830881272918144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.008804:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f8000 with x1830881272918144 ext(0->4095) 00002000:00010000:3.0:1746065138.008806:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9f8000 00000100:00100000:0.0:1746065138.009989:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.010240:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272918272 00000100:00100000:2.0:1746065138.010244:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272918272 00000100:00100000:2.0:1746065138.010278:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30259 00000100:00100000:2.0:1746065138.010284:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272918272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.010294:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.010306:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a7f expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.010327:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.010333:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.010334:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.010337:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.010358:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.010367:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 79 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.010376:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267664384:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.010432:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.011424:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267664384:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.011441:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.011450:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065138.011578:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272918272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1292us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.011583:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30259 00000100:00100000:0.0:1746065138.011887:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.011953:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272918400 00000100:00100000:2.0:1746065138.011957:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272918400 00010000:00010000:2.0:1746065138.011972:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.012133:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14231 00000100:00100000:2.0:1746065138.012139:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f849f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272918400:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.012147:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.012164:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.012173:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.012189:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a78 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.012208:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.012210:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.012215:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.012221:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.012239:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.012245:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267664512:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.012287:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.013309:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267664512:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.013318:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.013339:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f849f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881272918400:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1200us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.013345:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14231 00000100:00100000:0.0:1746065138.014233:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.014327:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272918656 00000100:00100000:2.0:1746065138.014331:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272918656 00002000:00100000:2.0:1746065138.014352:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e9f80 x1830881272918656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.014358:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9f80 with x1830881272918656 ext(0->4095) 00002000:00010000:2.0:1746065138.014361:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5e9f80 00000100:00100000:2.0:1746065138.014379:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13568 00000100:00100000:2.0:1746065138.014384:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272918656:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.014500:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272918656:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 115us (268us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.014508:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13568 00002000:00100000:2.0:1746065138.014512:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e9f80 x1830881272918656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.014519:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9f80 with x1830881272918656 ext(0->4095) 00002000:00010000:2.0:1746065138.014521:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5e9f80 00000100:00100000:0.0:1746065138.015752:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.015853:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272918784 00000100:00100000:2.0:1746065138.015857:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272918784 00000100:00100000:2.0:1746065138.015889:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30260 00000100:00100000:2.0:1746065138.015894:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1795:x1830881272918784:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.015904:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.015917:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a86 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.015936:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.015953:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.015955:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.015958:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.015981:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.015990:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 5 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.016004:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267664640:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.016064:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.018366:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.018434:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272918912 00000100:00100000:3.0:1746065138.018440:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272918912 00010000:00010000:3.0:1746065138.018465:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.018497:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14232 00000100:00100000:3.0:1746065138.018504:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272918912:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.018513:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.018527:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.018536:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.018553:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.018555:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.018560:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.018567:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.018596:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.018607:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267664768:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.018674:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00010000:00010000:2.0:1746065138.018743:0:21550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fb0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a7f expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.018766:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267664640:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.018782:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.018790:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065138.018809:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881272918784:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2914us (3059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.018815:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30260 00000100:00100000:0.0:1746065138.020373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.020529:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272919040 00000100:00100000:2.0:1746065138.020534:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272919040 00000100:00100000:2.0:1746065138.020567:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30261 00000100:00100000:3.0:1746065138.020570:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267664768:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.020573:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272919040:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.020582:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.020584:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065138.020591:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a8d expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.020607:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272918912:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2103us (2246us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065138.020608:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.020613:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14232 00010000:00010000:2.0:1746065138.020619:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.020621:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.020627:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.020644:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.020652:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.020661:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267664896:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.020703:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.022312:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.022487:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267664896:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.022504:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.022515:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:2.0:1746065138.022539:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272919040:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1967us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.022545:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30261 00000100:00100000:2.0:1746065138.022566:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272919296 00000100:00100000:2.0:1746065138.022569:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272919296 00002000:00100000:2.0:1746065138.022590:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ce00 x1830881272919296/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.022603:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ce00 with x1830881272919296 ext(0->4095) 00010000:00010000:2.0:1746065138.022608:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.022617:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.022622:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1ce00 00000100:00100000:2.0:1746065138.022634:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2813 00000100:00100000:2.0:1746065138.022639:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272919296:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.022737:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272919296:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (428us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.022742:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2813 00002000:00100000:2.0:1746065138.022747:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ce00 x1830881272919296/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.022753:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ce00 with x1830881272919296 ext(0->4095) 00010000:00010000:2.0:1746065138.022757:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.022765:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.022770:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1ce00 00000100:00100000:0.0:1746065138.025036:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.025660:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272919424 00000100:00100000:2.0:1746065138.025667:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272919424 00000100:00100000:2.0:1746065138.025716:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30262 00000100:00100000:2.0:1746065138.025723:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272919424:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.025735:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.025748:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a94 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.025770:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.025775:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.025780:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065138.025784:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.025810:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.025821:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.025829:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065138.026774:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272919424:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1048us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.026781:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30262 00000100:00100000:0.0:1746065138.026989:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.027047:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272919552 00000100:00100000:3.0:1746065138.027051:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272919552 00010000:00010000:3.0:1746065138.027069:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.027113:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14233 00000100:00100000:3.0:1746065138.027119:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272919552:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.027128:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.027142:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.027152:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.027168:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fb15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a86 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.027180:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.027181:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.027186:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.027192:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.027213:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.027222:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.027232:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267665152:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.027275:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.031505:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.031553:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272919808 00000100:00100000:2.0:1746065138.031560:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272919808 00002000:00100000:2.0:1746065138.031596:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072979180 x1830881272919808/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.031611:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072979180 with x1830881272919808 ext(0->4095) 00010000:00010000:2.0:1746065138.031618:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.031632:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.031638:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072979180 00000100:00100000:2.0:1746065138.031655:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2814 00000100:00100000:2.0:1746065138.031661:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272919808:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.031765:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272919808:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (272us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.031770:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2814 00002000:00100000:2.0:1746065138.031775:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072979180 x1830881272919808/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.031781:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072979180 with x1830881272919808 ext(0->4095) 00010000:00010000:2.0:1746065138.031785:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.031793:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.031798:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072979180 00000100:00100000:3.0:1746065138.031912:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267665152:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.031927:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.031972:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272919552:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4853us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.031980:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14233 00000100:00100000:0.0:1746065138.033728:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.033780:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272919936 00000100:00100000:2.0:1746065138.033786:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272919936 00000100:00100000:2.0:1746065138.033821:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30263 00000100:00100000:2.0:1746065138.033827:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272919936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.033838:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.033848:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5a9b expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.033865:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.033868:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.033872:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065138.033874:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.033896:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.033902:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.033907:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065138.033926:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272919936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 100us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.033929:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30263 00000100:00100000:0.0:1746065138.034145:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.034569:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272920064 00000100:00100000:2.0:1746065138.034573:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272920064 00010000:00010000:2.0:1746065138.034585:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.034616:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14234 00000100:00100000:2.0:1746065138.034621:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2002:x1830881272920064:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.034628:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.034639:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.034649:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.034662:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fb1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a8d expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.034674:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.034675:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.034681:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.034687:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.034703:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.034711:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 5 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.034726:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267665408:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.034779:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.036710:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267665408:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.036719:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065138.036722:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.036740:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2002:x1830881272920064:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2120us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.036746:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14234 00000100:00100000:1.0:1746065138.036769:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272920320 00000100:00100000:1.0:1746065138.036774:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272920320 00002000:00100000:1.0:1746065138.036799:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e3b80 x1830881272920320/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.036807:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3b80 with x1830881272920320 ext(0->4095) 00010000:00010000:1.0:1746065138.036812:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.036822:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.036827:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e3b80 00000100:00100000:1.0:1746065138.036843:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2815 00000100:00100000:1.0:1746065138.036849:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272920320:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.037324:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272920320:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 474us (602us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.037330:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2815 00002000:00100000:1.0:1746065138.037335:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e3b80 x1830881272920320/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.037342:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3b80 with x1830881272920320 ext(0->4095) 00010000:00010000:1.0:1746065138.037351:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.037360:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.037365:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e3b80 00000100:00100000:0.0:1746065138.041527:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.041685:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272920448 00000100:00100000:2.0:1746065138.041692:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272920448 00010000:00010000:2.0:1746065138.041716:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.041738:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14235 00000100:00100000:2.0:1746065138.041744:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272920448:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.041754:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.041770:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.041780:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.041800:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fb23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a94 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.042264:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.042267:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.042274:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.042280:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.042306:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.042315:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267665536:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.042800:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.046312:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267665536:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.046327:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.046358:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272920448:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4614us (4837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.046366:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14235 00000100:00100000:0.0:1746065138.046739:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.047064:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272920704 00000100:00100000:1.0:1746065138.047070:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272920704 00002000:00100000:1.0:1746065138.047111:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e1880 x1830881272920704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.047125:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1880 with x1830881272920704 ext(0->4095) 00002000:00010000:1.0:1746065138.047129:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1880 00000100:00100000:1.0:1746065138.047150:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13569 00000100:00100000:1.0:1746065138.047155:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272920704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.047264:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272920704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 109us (525us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.047270:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13569 00002000:00100000:1.0:1746065138.047275:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e1880 x1830881272920704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.047282:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1880 with x1830881272920704 ext(0->4095) 00002000:00010000:1.0:1746065138.047285:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1880 00000100:00100000:0.0:1746065138.049281:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.049442:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272920832 00000100:00100000:1.0:1746065138.049448:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272920832 00000100:00100000:1.0:1746065138.049525:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30264 00000100:00100000:1.0:1746065138.049532:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272920832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.049544:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.049557:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5aa2 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.049579:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.049585:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.049587:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.049590:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.049611:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.049621:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 79 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.049631:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267665664:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.049691:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.051663:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267665664:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.051683:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.051697:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065138.051726:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272920832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2195us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.051733:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30264 00000100:00100000:0.0:1746065138.052579:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.053272:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272920960 00000100:00100000:2.0:1746065138.053278:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272920960 00010000:00010000:2.0:1746065138.053301:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.053727:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14236 00000100:00100000:2.0:1746065138.053733:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272920960:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.053745:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.053759:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.053773:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.053789:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fb2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5a9b expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.053801:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.053803:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.053808:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.053814:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.053835:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.053844:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267665792:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.054423:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.056430:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267665792:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.056444:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.056474:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881272920960:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2741us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.056481:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14236 00000100:00100000:0.0:1746065138.056733:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.057038:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272921216 00000100:00100000:2.0:1746065138.057044:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272921216 00002000:00100000:2.0:1746065138.057070:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbf800 x1830881272921216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.057078:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881272921216 ext(0->4095) 00002000:00010000:2.0:1746065138.057095:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbf800 00000100:00100000:2.0:1746065138.057107:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13570 00000100:00100000:2.0:1746065138.057112:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272921216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.057199:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272921216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 87us (467us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.057204:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13570 00002000:00100000:2.0:1746065138.057208:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbf800 x1830881272921216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.057214:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881272921216 ext(0->4095) 00002000:00010000:2.0:1746065138.057216:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbf800 00000100:00100000:0.0:1746065138.058668:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.058779:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272921344 00000100:00100000:1.0:1746065138.058783:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272921344 00000100:00100000:1.0:1746065138.058813:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30265 00000100:00100000:1.0:1746065138.058818:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1791:x1830881272921344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.058827:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.058838:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5aa9 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.058859:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.058866:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.058867:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.058869:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.058890:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.058899:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.058908:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267665920:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.058978:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.059318:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.059351:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272921472 00000100:00100000:3.0:1746065138.059355:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272921472 00000100:00100000:3.0:1746065138.059375:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30266 00000100:00100000:3.0:1746065138.059381:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272921472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.059387:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.059393:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ab0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.059405:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.059408:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.059418:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.059421:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.059437:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.059446:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.059453:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065138.059473:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881272921472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 92us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.059477:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30266 00000100:00100000:1.0:1746065138.060809:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267665920:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.060822:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.060833:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:1.0:1746065138.061242:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272921344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2422us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.061249:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30265 00000100:00100000:0.0:1746065138.062218:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.062292:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272921600 00000100:00100000:2.0:1746065138.062298:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272921600 00010000:00010000:2.0:1746065138.062320:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.062376:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14237 00000100:00100000:2.0:1746065138.062382:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272921600:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.062394:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.062409:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.062418:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.062435:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa2 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.062732:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.062734:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.062740:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.062747:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.062774:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.062783:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.062792:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267666176:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.062845:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e520cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.065341:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267666176:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.065356:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.065397:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272921600:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3015us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.065409:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14237 00000100:00100000:0.0:1746065138.066563:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.066782:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272921856 00000100:00100000:1.0:1746065138.066792:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272921856 00002000:00100000:1.0:1746065138.066820:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbfb80 x1830881272921856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.066828:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbfb80 with x1830881272921856 ext(0->4095) 00010000:00010000:1.0:1746065138.066834:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.066846:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.066851:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbfb80 00000100:00100000:1.0:1746065138.066948:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2816 00000100:00100000:1.0:1746065138.066954:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272921856:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.067604:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272921856:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 648us (1041us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.067611:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2816 00002000:00100000:1.0:1746065138.067616:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbfb80 x1830881272921856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.067623:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbfb80 with x1830881272921856 ext(0->4095) 00010000:00010000:1.0:1746065138.067628:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.067636:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.067642:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbfb80 00000100:00100000:0.0:1746065138.069373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.069450:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272921984 00000100:00100000:2.0:1746065138.069457:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272921984 00010000:00010000:2.0:1746065138.069480:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.069501:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14238 00000100:00100000:2.0:1746065138.069508:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2003:x1830881272921984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.069518:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.069533:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.069543:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.069561:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fb38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aa9 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.069573:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.069574:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.069580:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.069586:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.069611:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.069621:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267666304:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.069696:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.071213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.071292:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267666304:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.071305:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.071332:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2003:x1830881272921984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1824us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.071339:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14238 00000100:00100000:1.0:1746065138.071345:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272922240 00000100:00100000:1.0:1746065138.071349:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272922240 00002000:00100000:1.0:1746065138.071374:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c321c00 x1830881272922240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.071383:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321c00 with x1830881272922240 ext(0->4095) 00002000:00010000:1.0:1746065138.071386:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c321c00 00000100:00100000:1.0:1746065138.071407:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13571 00000100:00100000:1.0:1746065138.071412:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272922240:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.071494:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272922240:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 81us (283us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.071499:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13571 00002000:00100000:1.0:1746065138.071503:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c321c00 x1830881272922240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.071510:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321c00 with x1830881272922240 ext(0->4095) 00002000:00010000:1.0:1746065138.071512:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c321c00 00000100:00100000:0.0:1746065138.073756:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.073832:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272922368 00000100:00100000:1.0:1746065138.073838:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272922368 00000100:00100000:1.0:1746065138.073866:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30267 00000100:00100000:1.0:1746065138.073872:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272922368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.073883:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.073899:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ab7 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.073920:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.073932:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.073934:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.073936:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.073972:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.073983:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 79 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.073994:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267666432:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.074067:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.076204:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267666432:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.076226:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.076240:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065138.076287:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272922368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2414us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.076294:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30267 00000100:00100000:2.0:1746065138.076594:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.076740:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272922496 00000100:00100000:0.0:1746065138.076745:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272922496 00010000:00010000:0.0:1746065138.076764:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065138.076793:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14239 00000100:00100000:0.0:1746065138.076964:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272922496:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065138.076974:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065138.076991:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.077001:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.077016:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab0 expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.077038:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.077040:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.077045:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.077052:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.077073:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.077099:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267666560:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065138.077151:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.079616:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.079698:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267666560:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.079715:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.079740:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881272922496:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2779us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.079749:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14239 00000100:00100000:3.0:1746065138.079812:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272922752 00000100:00100000:3.0:1746065138.079816:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272922752 00002000:00100000:3.0:1746065138.079844:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c322680 x1830881272922752/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.079854:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322680 with x1830881272922752 ext(0->4095) 00002000:00010000:3.0:1746065138.079857:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c322680 00000100:00100000:3.0:1746065138.080258:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13572 00000100:00100000:3.0:1746065138.080264:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272922752:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.080357:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272922752:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (747us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.080366:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13572 00002000:00100000:3.0:1746065138.080370:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c322680 x1830881272922752/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.080377:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322680 with x1830881272922752 ext(0->4095) 00002000:00010000:3.0:1746065138.080379:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c322680 00000100:00100000:0.0:1746065138.082533:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.082999:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272922880 00000100:00100000:1.0:1746065138.083006:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272922880 00000100:00100000:1.0:1746065138.083045:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30268 00000100:00100000:1.0:1746065138.083052:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1795:x1830881272922880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.083067:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.083275:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5abe expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.083307:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.083313:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.083315:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.083317:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.083340:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.083350:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.083358:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267666688:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065138.083568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.083875:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.084057:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272923008 00000100:00100000:0.0:1746065138.084061:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272923008 00000100:00100000:0.0:1746065138.084421:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30269 00000100:00100000:0.0:1746065138.084427:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272923008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065138.084435:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.084441:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ac5 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.084452:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.084456:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.084460:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065138.084463:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.084482:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.084491:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.084498:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f85c000, rc 0) 00000100:00100000:0.0:1746065138.084523:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272923008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 97us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.084531:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30269 00000100:00100000:1.0:1746065138.086327:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267666688:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065138.086329:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065138.086344:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.086355:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065138.086394:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272922880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3342us (3867us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.086404:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30268 00000100:00100000:2.0:1746065138.086487:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272923136 00000100:00100000:2.0:1746065138.086492:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272923136 00010000:00010000:2.0:1746065138.086516:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.086533:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14240 00000100:00100000:2.0:1746065138.086538:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272923136:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.086551:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.086564:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.086574:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.086596:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fb46 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ab7 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.086619:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.086621:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.086627:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.086635:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.086712:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.086721:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.086730:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267666944:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.086784:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.090813:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267666944:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.090833:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.090885:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272923136:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4344us (4556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.090894:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14240 00000100:00100000:0.0:1746065138.091042:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.091246:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272923392 00000100:00100000:1.0:1746065138.091252:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272923392 00002000:00100000:1.0:1746065138.091359:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c321880 x1830881272923392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.091367:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321880 with x1830881272923392 ext(0->4095) 00010000:00010000:1.0:1746065138.091375:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.091385:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.091390:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c321880 00000100:00100000:1.0:1746065138.091414:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2817 00000100:00100000:1.0:1746065138.091419:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272923392:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.091507:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272923392:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 88us (466us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.091512:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2817 00002000:00100000:1.0:1746065138.091516:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c321880 x1830881272923392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.091522:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321880 with x1830881272923392 ext(0->4095) 00010000:00010000:1.0:1746065138.091526:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.091537:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.091542:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c321880 00000100:00100000:0.0:1746065138.094332:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.094394:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272923520 00000100:00100000:1.0:1746065138.094402:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272923520 00000100:00100000:1.0:1746065138.094638:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30270 00000100:00100000:1.0:1746065138.094645:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272923520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.094658:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.094671:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5acc expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.094695:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.094699:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.094703:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065138.094706:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.094725:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065138.094731:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.094740:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.094747:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00000100:00100000:1.0:1746065138.094789:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272923520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.094793:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272923648 00000100:00100000:1.0:1746065138.094793:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30270 00000100:00100000:2.0:1746065138.094798:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272923648 00010000:00010000:2.0:1746065138.094815:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.094835:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14241 00000100:00100000:2.0:1746065138.094840:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272923648:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.094848:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.094863:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.094873:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.094886:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fb4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5abe expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.094900:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.094902:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.094907:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.094915:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.094934:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.094956:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.094967:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267667200:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.095033:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.096582:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.096739:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272923904 00000100:00100000:3.0:1746065138.096744:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272923904 00002000:00100000:3.0:1746065138.096771:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0939500 x1830881272923904/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.096779:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0939500 with x1830881272923904 ext(0->4095) 00010000:00010000:3.0:1746065138.096785:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.096795:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.096801:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0939500 00000100:00100000:3.0:1746065138.097021:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2818 00000100:00100000:3.0:1746065138.097027:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272923904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.097068:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267667200:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.097105:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.097316:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272923648:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2473us (2589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.097324:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14241 00000100:00100000:3.0:1746065138.097405:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272923904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 378us (826us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.097410:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2818 00002000:00100000:3.0:1746065138.097414:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0939500 x1830881272923904/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.097426:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0939500 with x1830881272923904 ext(0->4095) 00010000:00010000:3.0:1746065138.097429:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.097437:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.097442:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0939500 00000100:00100000:0.0:1746065138.099221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.099312:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.099359:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272924032 00000100:00100000:3.0:1746065138.099364:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272924032 00000100:00100000:2.0:1746065138.099381:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272924160 00000100:00100000:2.0:1746065138.099386:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272924160 00010000:00010000:2.0:1746065138.099401:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.099421:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14242 00000100:00100000:2.0:1746065138.099427:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272924160:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.099436:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065138.099447:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30271 00010000:00010000:2.0:1746065138.099450:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.099452:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272924032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.099459:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.099463:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.099473:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ad3 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.099475:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f85c000/0x392ae0376f87fb54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ac5 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.099486:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.099540:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.099546:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.099549:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.099558:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.099560:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.099566:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.099574:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.099593:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.099606:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.099613:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.099615:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267667328:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.099620:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.099627:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267667456:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.099684:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.099684:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.101459:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267667328:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.101476:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.101487:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:0.0:1746065138.101559:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267667456:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065138.101568:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.101673:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272924032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2219us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.101679:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30271 00000100:00100000:0.0:1746065138.101789:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272924160:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2362us (2476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.101796:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14242 00000100:00100000:1.0:1746065138.101877:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.102138:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272924416 00000100:00100000:3.0:1746065138.102144:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272924416 00002000:00100000:3.0:1746065138.102168:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffdc00 x1830881272924416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.102176:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffdc00 with x1830881272924416 ext(0->4095) 00010000:00010000:3.0:1746065138.102182:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.102191:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.102201:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffdc00 00000100:00100000:3.0:1746065138.102212:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2819 00000100:00100000:3.0:1746065138.102217:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272924416:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.102300:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272924416:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 83us (424us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.102305:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2819 00002000:00100000:3.0:1746065138.102309:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffdc00 x1830881272924416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.102315:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffdc00 with x1830881272924416 ext(0->4095) 00010000:00010000:3.0:1746065138.102319:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.102325:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.102330:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffdc00 00000100:00100000:0.0:1746065138.105446:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.105549:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272924544 00000100:00100000:2.0:1746065138.105556:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272924544 00010000:00010000:2.0:1746065138.105581:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.105609:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14243 00000100:00100000:2.0:1746065138.105615:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272924544:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.105626:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.105642:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.105652:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.105673:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5acc expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.105894:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.105897:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.105904:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.105911:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.105937:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.105957:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267667584:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.106528:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.109127:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267667584:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.109146:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.109179:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272924544:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3563us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.109189:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14243 00000100:00100000:0.0:1746065138.109316:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.109419:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272924800 00000100:00100000:1.0:1746065138.109425:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272924800 00002000:00100000:1.0:1746065138.109451:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b480 x1830881272924800/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.109459:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b480 with x1830881272924800 ext(0->4095) 00002000:00010000:1.0:1746065138.109462:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54b480 00000100:00100000:1.0:1746065138.109686:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13573 00000100:00100000:1.0:1746065138.109692:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272924800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.109796:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272924800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 104us (481us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.109801:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13573 00002000:00100000:1.0:1746065138.109806:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b480 x1830881272924800/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.109812:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b480 with x1830881272924800 ext(0->4095) 00002000:00010000:1.0:1746065138.109815:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54b480 00000100:00100000:0.0:1746065138.112131:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.112492:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272924928 00000100:00100000:3.0:1746065138.112501:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272924928 00000100:00100000:3.0:1746065138.112544:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30272 00000100:00100000:3.0:1746065138.112550:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272924928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.112563:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.112576:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ada expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.112600:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.112606:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.112608:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.112610:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.112633:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.112642:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 79 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.112651:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267667712:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.112808:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.115413:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.115490:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267667712:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.115519:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.115534:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:2.0:1746065138.115550:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272925056 00000100:00100000:2.0:1746065138.115556:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272925056 00000100:00100000:3.0:1746065138.115566:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272924928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3016us (3441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.115574:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30272 00010000:00010000:2.0:1746065138.115580:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.115620:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14244 00000100:00100000:2.0:1746065138.115626:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272925056:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.115638:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.115655:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.115664:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.115681:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fb62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ad3 expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.115694:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.115696:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.115701:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.115709:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.115733:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.115743:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267667840:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.115809:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.120406:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.120443:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267667840:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.120460:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.120510:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881272925056:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4884us (5103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.120520:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14244 00000100:00100000:3.0:1746065138.120794:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272925312 00000100:00100000:3.0:1746065138.120801:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272925312 00000100:00100000:3.0:1746065138.121615:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30273 00000100:00100000:3.0:1746065138.121623:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1791:x1830881272925312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.121638:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.121651:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ae1 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.121673:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.121680:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.121681:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.121684:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.121709:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.121717:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 5 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.121727:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267667968:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.123988:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.124640:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.124707:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272925440 00000100:00100000:3.0:1746065138.124714:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272925440 00002000:00100000:3.0:1746065138.124749:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1500 x1830881272925440/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.124757:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1500 with x1830881272925440 ext(0->4095) 00010000:00010000:3.0:1746065138.124766:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.124777:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.124783:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b1500 00000100:00100000:3.0:1746065138.124799:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2820 00000100:00100000:3.0:1746065138.124804:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272925440:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.124914:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272925440:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 109us (276us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.124919:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2820 00002000:00100000:3.0:1746065138.124924:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1500 x1830881272925440/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.124930:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1500 with x1830881272925440 ext(0->4095) 00010000:00010000:3.0:1746065138.124934:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.124950:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.124955:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b1500 00000100:00100000:3.0:1746065138.127184:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267667968:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.127209:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.127229:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:0.0:1746065138.127233:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.127819:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272925312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6195us (7419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.127828:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30273 00000100:00100000:3.0:1746065138.128019:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272925568 00000100:00100000:3.0:1746065138.128024:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272925568 00000100:00100000:0.0:1746065138.128228:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.128978:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30274 00000100:00100000:1.0:1746065138.128989:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881272925568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.129008:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.129028:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ae8 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.129057:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.129063:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.129069:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.129071:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.129118:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.129128:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.129136:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065138.129170:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272925568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 184us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.129175:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30274 00000100:00100000:2.0:1746065138.130360:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272925696 00000100:00100000:2.0:1746065138.130368:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272925696 00010000:00010000:2.0:1746065138.130395:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.130651:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14245 00000100:00100000:2.0:1746065138.130657:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272925696:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.130669:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.130684:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.130693:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.130708:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fb69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ada expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.131119:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.131122:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.131127:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.131135:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.131162:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.131173:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.131183:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267668224:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.131600:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.134879:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267668224:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.134897:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.134929:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272925696:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4272us (6701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.134937:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14245 00000100:00100000:0.0:1746065138.135142:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.135489:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272925952 00000100:00100000:2.0:1746065138.135495:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272925952 00002000:00100000:2.0:1746065138.135522:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548a80 x1830881272925952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.135530:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548a80 with x1830881272925952 ext(0->4095) 00010000:00010000:2.0:1746065138.135539:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.135549:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.135554:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548a80 00000100:00100000:2.0:1746065138.135578:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2821 00000100:00100000:2.0:1746065138.135584:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272925952:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.135670:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272925952:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 86us (529us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.135675:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2821 00002000:00100000:2.0:1746065138.135679:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548a80 x1830881272925952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.135685:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548a80 with x1830881272925952 ext(0->4095) 00010000:00010000:2.0:1746065138.135688:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.135696:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.135701:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548a80 00000100:00100000:0.0:1746065138.138676:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.138848:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272926080 00000100:00100000:2.0:1746065138.138856:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272926080 00010000:00010000:2.0:1746065138.138883:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.138918:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14246 00000100:00100000:2.0:1746065138.138924:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272926080:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.138935:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.138978:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.138994:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.139013:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fb70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae1 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.139550:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.139553:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.139560:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.139568:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.139598:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.139609:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267668352:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.140018:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.143394:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.143485:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272926336 00000100:00100000:2.0:1746065138.143493:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272926336 00002000:00100000:2.0:1746065138.143529:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04700 x1830881272926336/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.143538:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04700 with x1830881272926336 ext(0->4095) 00002000:00010000:2.0:1746065138.143543:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04700 00000100:00100000:2.0:1746065138.143559:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13574 00000100:00100000:2.0:1746065138.143566:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272926336:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.143679:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272926336:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (291us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.143685:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13574 00002000:00100000:2.0:1746065138.143690:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04700 x1830881272926336/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.143698:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04700 with x1830881272926336 ext(0->4095) 00002000:00010000:2.0:1746065138.143700:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04700 00000100:00100000:3.0:1746065138.143847:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267668352:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.143861:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.143880:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272926080:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4957us (5210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.143898:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14246 00000100:00100000:0.0:1746065138.146015:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.146071:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272926464 00000100:00100000:1.0:1746065138.146077:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272926464 00000100:00100000:1.0:1746065138.146196:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30275 00000100:00100000:1.0:1746065138.146202:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272926464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.146215:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.146229:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5aef expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.146257:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.146263:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.146265:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.146268:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.146292:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.146302:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 79 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.146312:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267668480:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.146375:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.147716:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267668480:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.147734:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.147746:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065138.147773:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272926464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1571us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.147779:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30275 00000100:00100000:0.0:1746065138.150367:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.151012:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272926592 00000100:00100000:3.0:1746065138.151021:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272926592 00010000:00010000:3.0:1746065138.151054:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.151120:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14247 00000100:00100000:3.0:1746065138.151127:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272926592:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.151139:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.151155:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.151166:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.151189:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fb77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ae8 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.151212:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.151214:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.151222:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.151229:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.151258:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.151270:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267668608:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.151341:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.153201:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.153342:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272926720 00000100:00100000:1.0:1746065138.153349:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272926720 00000100:00100000:1.0:1746065138.153379:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30276 00000100:00100000:1.0:1746065138.153384:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272926720:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.153397:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.153408:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5af6 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.153429:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.153435:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.153436:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.153439:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.153460:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.153470:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.153479:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267668736:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065138.154337:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.154355:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272926976 00000100:00100000:0.0:1746065138.154359:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272926976 00002000:00100000:0.0:1746065138.154383:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130692d80 x1830881272926976/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.154391:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130692d80 with x1830881272926976 ext(0->4095) 00010000:00010000:0.0:1746065138.154397:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 7/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.154411:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 7/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.154417:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130692d80 00000100:00100000:1.0:1746065138.154442:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.154514:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267668608:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.154527:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.154630:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272926592:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3502us (4269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.154638:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14247 00000100:00100000:0.0:1746065138.156127:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2822 00000100:00100000:0.0:1746065138.156137:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272926976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065138.156249:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272926976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 115us (1914us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065138.156255:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2822 00002000:00100000:0.0:1746065138.156261:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130692d80 x1830881272926976/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.156270:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130692d80 with x1830881272926976 ext(0->4095) 00010000:00010000:0.0:1746065138.156277:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.156289:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.156295:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130692d80 00000100:00100000:1.0:1746065138.156644:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267668736:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.156662:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.156673:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065138.156704:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272926720:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3320us (3512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.156710:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30276 00000100:00100000:0.0:1746065138.158709:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.158780:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272927104 00000100:00100000:1.0:1746065138.158787:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272927104 00000100:00100000:1.0:1746065138.158816:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30277 00000100:00100000:1.0:1746065138.158821:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881272927104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.158835:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.158848:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5afd expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.158870:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.158876:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.158881:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.158884:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.158910:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.158919:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.158927:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065138.159035:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272927104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 212us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.159044:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30277 00000100:00100000:0.0:1746065138.162360:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.162898:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272927232 00000100:00100000:3.0:1746065138.162905:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272927232 00010000:00010000:3.0:1746065138.162929:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.162971:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14248 00000100:00100000:3.0:1746065138.162976:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272927232:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.162986:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.163000:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.163007:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.163021:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fb7e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5aef expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.163215:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.163216:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.163222:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.163226:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.163249:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.163255:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.163266:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267668992:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.163740:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.166271:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267668992:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.166288:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.166335:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272927232:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3357us (3978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.166343:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14248 00000100:00100000:0.0:1746065138.166543:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.166578:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272927488 00000100:00100000:2.0:1746065138.166583:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272927488 00002000:00100000:2.0:1746065138.166948:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130690380 x1830881272927488/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.166960:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130690380 with x1830881272927488 ext(0->4095) 00010000:00010000:2.0:1746065138.166968:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.166983:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.166989:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130690380 00000100:00100000:2.0:1746065138.167136:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2823 00000100:00100000:2.0:1746065138.167143:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272927488:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.167237:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272927488:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 95us (694us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.167246:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2823 00002000:00100000:2.0:1746065138.167251:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130690380 x1830881272927488/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.167257:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130690380 with x1830881272927488 ext(0->4095) 00010000:00010000:2.0:1746065138.167261:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.167270:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.167275:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130690380 00000100:00100000:0.0:1746065138.169060:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.169555:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272927616 00000100:00100000:3.0:1746065138.169562:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272927616 00010000:00010000:3.0:1746065138.169588:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.169610:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14249 00000100:00100000:3.0:1746065138.169616:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272927616:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.169625:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.169640:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.169650:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.169667:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fb85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5af6 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.169826:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.169828:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.169835:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.169841:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.169868:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.169878:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267669120:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.170019:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.171119:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267669120:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.171133:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.171167:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272927616:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1550us (2111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.171175:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14249 00000100:00100000:0.0:1746065138.172912:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.173028:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272927872 00000100:00100000:2.0:1746065138.173035:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272927872 00002000:00100000:2.0:1746065138.173067:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1ce00 x1830881272927872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.173103:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1ce00 with x1830881272927872 ext(0->4095) 00002000:00010000:2.0:1746065138.173108:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1ce00 00000100:00100000:2.0:1746065138.173124:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13575 00000100:00100000:2.0:1746065138.173130:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272927872:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.174137:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272927872:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1003us (1226us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.174144:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13575 00002000:00100000:2.0:1746065138.174150:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1ce00 x1830881272927872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.174163:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1ce00 with x1830881272927872 ext(0->4095) 00002000:00010000:2.0:1746065138.174166:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1ce00 00000100:00100000:0.0:1746065138.175497:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.175550:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272928000 00000100:00100000:1.0:1746065138.175557:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272928000 00000100:00100000:1.0:1746065138.175596:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30278 00000100:00100000:1.0:1746065138.175602:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272928000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.175612:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.175626:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b04 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.175647:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.175654:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.175655:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.175658:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.175683:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.175694:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 79 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.175704:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267669248:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.175781:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.177775:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267669248:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.177800:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.177813:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065138.177854:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272928000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2252us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.177860:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30278 00000100:00100000:0.0:1746065138.178057:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.178110:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272928128 00000100:00100000:3.0:1746065138.178116:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272928128 00010000:00010000:3.0:1746065138.178137:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.178165:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14250 00000100:00100000:3.0:1746065138.178170:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272928128:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.178180:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.178196:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.178210:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.178228:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fb8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5afd expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.178251:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.178253:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.178259:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.178266:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.178291:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.178300:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267669376:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.178343:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.179708:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267669376:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.179720:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.179753:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2004:x1830881272928128:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1583us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.179760:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14250 00000100:00100000:0.0:1746065138.181924:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.181981:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.181996:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272928384 00000100:00100000:2.0:1746065138.182003:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272928384 00002000:00100000:2.0:1746065138.182037:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6ca300 x1830881272928384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.182046:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6ca300 with x1830881272928384 ext(0->4095) 00002000:00010000:2.0:1746065138.182050:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6ca300 00000100:00100000:1.0:1746065138.182094:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272928512 00000100:00100000:2.0:1746065138.182097:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13576 00000100:00100000:1.0:1746065138.182098:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272928512 00000100:00100000:2.0:1746065138.182103:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272928384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.182119:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30279 00000100:00100000:1.0:1746065138.182124:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1791:x1830881272928512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.182133:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.182146:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b0b expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.182167:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.182174:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.182176:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.182179:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.182201:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.182211:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.182221:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267669504:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.182229:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272928384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 125us (310us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.182234:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13576 00002000:00100000:2.0:1746065138.182239:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6ca300 x1830881272928384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.182244:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6ca300 with x1830881272928384 ext(0->4095) 00010000:00010000:2.0:1746065138.182249:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.182258:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.182262:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6ca300 00000100:00100000:1.0:1746065138.182273:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.183833:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.183838:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267669504:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.183857:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.183869:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00000100:00100000:1.0:1746065138.183912:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272928512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1787us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.183919:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30279 00000100:00100000:1.0:1746065138.184025:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272928640 00000100:00100000:1.0:1746065138.184030:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272928640 00000100:00100000:1.0:1746065138.184059:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30280 00000100:00100000:1.0:1746065138.184064:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881272928640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.184073:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.184104:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b12 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.184119:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.184123:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.184123:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065138.184129:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.184132:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.184157:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.184161:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272928768 00000100:00100000:3.0:1746065138.184166:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272928768 00010000:00010000:1.0:1746065138.184166:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.184173:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00010000:00010000:3.0:1746065138.184185:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.184194:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272928640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 129us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.184198:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30280 00000100:00100000:3.0:1746065138.184204:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14251 00000100:00100000:3.0:1746065138.184209:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272928768:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.184216:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.184229:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.184239:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.184255:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fb93 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b04 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.184283:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.184284:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.184289:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.184295:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.184313:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.184322:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.184336:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267669760:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.184378:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.185730:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.185737:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267669760:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.185748:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.185781:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272928768:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1571us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.185781:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272929024 00000100:00100000:1.0:1746065138.185786:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272929024 00000100:00100000:3.0:1746065138.185789:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14251 00002000:00100000:1.0:1746065138.185814:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9180 x1830881272929024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.185822:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9180 with x1830881272929024 ext(0->4095) 00010000:00010000:1.0:1746065138.185827:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.185842:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.185848:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9180 00000100:00100000:1.0:1746065138.185863:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2824 00000100:00100000:1.0:1746065138.185868:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2003:x1830881272929024:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065138.185976:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2003:x1830881272929024:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 107us (250us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.185982:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2824 00002000:00100000:1.0:1746065138.185990:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9180 x1830881272929024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.185996:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9180 with x1830881272929024 ext(0->4095) 00010000:00010000:1.0:1746065138.186001:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.186009:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.186013:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9180 00000100:00100000:0.0:1746065138.187728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.187848:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272929152 00000100:00100000:3.0:1746065138.187854:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272929152 00010000:00010000:3.0:1746065138.187876:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.187895:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14252 00000100:00100000:3.0:1746065138.187901:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272929152:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.187911:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.187924:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.187933:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.187962:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fb9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b0b expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.187973:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.187976:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.187981:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.187987:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.188011:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.188021:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267669888:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.188538:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.190369:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.190446:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267669888:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.190458:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.190484:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272929152:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2583us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.190492:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14252 00000100:00100000:1.0:1746065138.190744:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272929408 00000100:00100000:1.0:1746065138.190750:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272929408 00002000:00100000:1.0:1746065138.190779:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d652300 x1830881272929408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.190822:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652300 with x1830881272929408 ext(0->4095) 00002000:00010000:1.0:1746065138.190825:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d652300 00000100:00100000:1.0:1746065138.190890:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13577 00000100:00100000:1.0:1746065138.190897:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272929408:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.191013:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272929408:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 116us (647us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.191019:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13577 00002000:00100000:1.0:1746065138.191024:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d652300 x1830881272929408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.191037:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652300 with x1830881272929408 ext(0->4095) 00002000:00010000:1.0:1746065138.191039:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d652300 00000100:00100000:0.0:1746065138.192204:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.192269:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272929536 00000100:00100000:1.0:1746065138.192273:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272929536 00000100:00100000:1.0:1746065138.192338:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30281 00000100:00100000:1.0:1746065138.192344:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272929536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.192358:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.192371:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b19 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.192395:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.192401:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.192402:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.192405:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.192428:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.192438:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 79 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.192447:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267670016:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.192808:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.194623:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267670016:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.194648:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.194662:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:1.0:1746065138.194696:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272929536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2352us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.194704:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30281 00000100:00100000:0.0:1746065138.194990:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.195308:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272929664 00000100:00100000:3.0:1746065138.195313:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272929664 00010000:00010000:3.0:1746065138.195336:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.195354:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14253 00000100:00100000:3.0:1746065138.195359:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272929664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.195369:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.195384:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.195398:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.195415:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fba1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b12 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.195431:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.195433:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.195439:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.195446:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.195470:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.195480:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267670144:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.195528:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.197239:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267670144:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.197252:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.197286:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881272929664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1926us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.197295:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14253 00000100:00100000:0.0:1746065138.197486:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.197569:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272929920 00000100:00100000:3.0:1746065138.197573:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272929920 00002000:00100000:3.0:1746065138.197600:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d651500 x1830881272929920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.197614:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651500 with x1830881272929920 ext(0->4095) 00002000:00010000:3.0:1746065138.197618:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d651500 00000100:00100000:3.0:1746065138.197643:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13578 00000100:00100000:3.0:1746065138.197650:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272929920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.197753:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272929920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 104us (268us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.197759:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13578 00002000:00100000:3.0:1746065138.197764:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d651500 x1830881272929920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.197771:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651500 with x1830881272929920 ext(0->4095) 00002000:00010000:3.0:1746065138.197773:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d651500 00000100:00100000:0.0:1746065138.199223:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.199371:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272930048 00000100:00100000:1.0:1746065138.199377:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272930048 00000100:00100000:1.0:1746065138.199617:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30282 00000100:00100000:1.0:1746065138.199623:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1795:x1830881272930048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.199636:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.199649:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b20 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.199671:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.199677:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.199679:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.199682:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.199702:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.199711:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.199722:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267670272:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.199791:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.200750:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.201401:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272930176 00000100:00100000:2.0:1746065138.201409:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272930176 00000100:00100000:2.0:1746065138.201450:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30283 00000100:00100000:2.0:1746065138.201457:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272930176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.201468:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.201481:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b27 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.201499:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.201503:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.201508:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.201511:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.201537:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.201548:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.201556:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065138.201594:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272930176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 138us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.201600:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30283 00000100:00100000:1.0:1746065138.201882:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267670272:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.201897:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.201904:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065138.201923:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272930048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2301us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.201928:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30282 00000100:00100000:0.0:1746065138.202292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.202335:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272930304 00000100:00100000:3.0:1746065138.202340:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272930304 00010000:00010000:3.0:1746065138.202358:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.202388:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14254 00000100:00100000:3.0:1746065138.202394:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272930304:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.202403:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.202418:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.202428:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.202445:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fba8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b19 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.202469:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.202471:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.202478:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.202484:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.202504:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.202515:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.202525:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267670528:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.202584:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.208382:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.208438:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272930560 00000100:00100000:2.0:1746065138.208445:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272930560 00000100:00100000:3.0:1746065138.208472:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267670528:192.168.202.8@tcp:105: 00002000:00100000:2.0:1746065138.208486:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a3480 x1830881272930560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1746065138.208489:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746065138.208501:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a3480 with x1830881272930560 ext(0->4095) 00010000:00010000:2.0:1746065138.208508:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.208536:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272930304:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6141us (6244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.208546:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14254 00010000:00010000:2.0:1746065138.208611:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.208617:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a3480 00000100:00100000:2.0:1746065138.208673:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2825 00000100:00100000:2.0:1746065138.208680:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2003:x1830881272930560:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746065138.208780:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2003:x1830881272930560:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 101us (404us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.208785:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2825 00002000:00100000:2.0:1746065138.208790:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a3480 x1830881272930560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.208796:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a3480 with x1830881272930560 ext(0->4095) 00010000:00010000:2.0:1746065138.208800:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.208808:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.208813:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a3480 00000100:00100000:0.0:1746065138.211022:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.211099:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272930688 00000100:00100000:3.0:1746065138.211106:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272930688 00010000:00010000:3.0:1746065138.211131:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.211165:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14255 00000100:00100000:3.0:1746065138.211171:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272930688:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.211181:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.211195:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.211205:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.211224:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fbaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b20 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.211252:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.211254:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.211259:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.211267:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.211293:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.211304:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267670656:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.211359:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.213169:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.213800:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272930816 00000100:00100000:1.0:1746065138.213806:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272930816 00000100:00100000:1.0:1746065138.213849:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30284 00000100:00100000:1.0:1746065138.213855:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272930816:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.213868:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.213881:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b2e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.213901:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.213908:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.213909:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.213912:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.213938:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.213961:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.213970:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267670784:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.215477:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.216008:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.216036:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267670656:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.216051:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.216108:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272930688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4936us (5091us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.216117:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14255 00000100:00100000:1.0:1746065138.216281:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267670784:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.216296:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.216307:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065138.217270:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272930816:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3412us (4101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.217276:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30284 00000100:00100000:1.0:1746065138.217298:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272931072 00000100:00100000:1.0:1746065138.217304:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272931072 00002000:00100000:1.0:1746065138.217328:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2680 x1830881272931072/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.217336:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2680 with x1830881272931072 ext(0->4095) 00010000:00010000:1.0:1746065138.217342:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.217356:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.217361:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a2680 00000100:00100000:1.0:1746065138.217383:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2826 00000100:00100000:1.0:1746065138.217388:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272931072:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.217766:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272931072:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 377us (1760us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.217771:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2826 00002000:00100000:1.0:1746065138.217775:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2680 x1830881272931072/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.217781:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2680 with x1830881272931072 ext(0->4095) 00010000:00010000:1.0:1746065138.217785:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.217793:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 80 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.217798:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a2680 00000100:00100000:0.0:1746065138.219797:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.219834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.219846:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272931200 00000100:00100000:1.0:1746065138.219853:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272931200 00000100:00100000:1.0:1746065138.219915:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30285 00000100:00100000:1.0:1746065138.219923:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272931200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.219936:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.219960:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b35 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.219981:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746065138.219985:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272931328 00010000:00010000:1.0:1746065138.219986:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.219990:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272931328 00010000:00010000:1.0:1746065138.219991:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065138.219994:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.220007:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.220023:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.220034:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.220037:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14256 00010000:00010000:1.0:1746065138.220042:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00000100:00100000:3.0:1746065138.220043:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272931328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.220055:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.220068:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.220075:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272931200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 153us (281us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065138.220077:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.220101:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30285 00010000:00010000:3.0:1746065138.220242:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fbb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b27 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.220266:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.220268:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.220273:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.220284:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.220303:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.220312:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.220321:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267671040:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.220521:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.223734:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.223806:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267671040:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.223821:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.223851:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272931328:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3807us (4016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.223859:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14256 00000100:00100000:1.0:1746065138.224117:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272931584 00000100:00100000:1.0:1746065138.224124:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272931584 00002000:00100000:1.0:1746065138.224359:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8aa00 x1830881272931584/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.224370:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8aa00 with x1830881272931584 ext(0->4095) 00010000:00010000:1.0:1746065138.224378:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.224395:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.224401:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8aa00 00000100:00100000:1.0:1746065138.224428:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2827 00000100:00100000:1.0:1746065138.224434:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272931584:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.224967:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272931584:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 531us (1237us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.224973:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2827 00002000:00100000:1.0:1746065138.224978:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8aa00 x1830881272931584/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.224984:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8aa00 with x1830881272931584 ext(0->4095) 00010000:00010000:1.0:1746065138.224988:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.225536:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.225542:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8aa00 00000100:00100000:0.0:1746065138.229330:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.229435:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272931712 00000100:00100000:3.0:1746065138.229443:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272931712 00010000:00010000:3.0:1746065138.229473:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.229507:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14257 00000100:00100000:3.0:1746065138.229514:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272931712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.229526:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.229542:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.229553:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.229572:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fbbd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b2e expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.229601:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.229603:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.229609:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.229616:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.229641:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.229651:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267671168:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.229723:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572300 going to sleep for 11 seconds 00010000:00010000:3.0:1746065138.231420:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065138.232302:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267671168:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065138.232308:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065138.232323:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.232355:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272931712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2842us (3033us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.232363:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14257 00000100:00100000:1.0:1746065138.232375:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272931968 00000100:00100000:1.0:1746065138.232381:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272931968 00002000:00100000:1.0:1746065138.232410:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3fb80 x1830881272931968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.232419:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3fb80 with x1830881272931968 ext(0->4095) 00002000:00010000:1.0:1746065138.232423:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3fb80 00000100:00100000:1.0:1746065138.232777:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13579 00000100:00100000:1.0:1746065138.232784:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272931968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.232881:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272931968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (574us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.232887:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13579 00002000:00100000:1.0:1746065138.232892:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3fb80 x1830881272931968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.232898:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3fb80 with x1830881272931968 ext(0->4095) 00002000:00010000:1.0:1746065138.232901:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3fb80 00000100:00100000:0.0:1746065138.233981:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.234148:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272932096 00000100:00100000:1.0:1746065138.234155:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272932096 00000100:00100000:3.0:1746065138.234377:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30286 00000100:00100000:3.0:1746065138.234385:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272932096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.234394:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.234409:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b3c expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.234431:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.234437:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.234439:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.234442:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.234465:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.234476:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 79 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.234486:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267671296:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.234545:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.236104:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267671296:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.236124:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.236135:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065138.236177:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272932096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1794us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.236184:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30286 00000100:00100000:0.0:1746065138.236226:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.237246:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272932224 00000100:00100000:3.0:1746065138.237252:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272932224 00010000:00010000:3.0:1746065138.237280:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.237317:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14258 00000100:00100000:3.0:1746065138.237324:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272932224:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.237333:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.237349:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.237358:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.237375:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fbc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b35 expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.237400:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.237402:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.237408:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.237414:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.237440:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.237449:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267671424:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.237512:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.239006:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267671424:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.239020:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.239644:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2004:x1830881272932224:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2319us (3417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.239653:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14258 00000100:00100000:0.0:1746065138.240183:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.240245:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272932480 00000100:00100000:1.0:1746065138.240250:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272932480 00002000:00100000:1.0:1746065138.240279:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1500 x1830881272932480/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.240298:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1500 with x1830881272932480 ext(0->4095) 00002000:00010000:1.0:1746065138.240301:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a1500 00000100:00100000:1.0:1746065138.240324:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13580 00000100:00100000:1.0:1746065138.240330:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272932480:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.240424:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272932480:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 95us (243us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.240429:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13580 00002000:00100000:1.0:1746065138.240434:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1500 x1830881272932480/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.240441:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1500 with x1830881272932480 ext(0->4095) 00002000:00010000:1.0:1746065138.240444:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a1500 00000100:00100000:0.0:1746065138.242578:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.242649:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.242680:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272932608 00000100:00100000:3.0:1746065138.242686:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272932608 00000100:00100000:3.0:1746065138.242717:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272932736 00000100:00100000:3.0:1746065138.242719:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272932736 00000100:00100000:3.0:1746065138.242729:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30287 00000100:00100000:3.0:1746065138.242733:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272932608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.242743:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.242754:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b43 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.242772:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.242777:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.242778:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.242781:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.242790:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30288 00000100:00100000:1.0:1746065138.242798:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272932736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.242800:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.242806:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.242808:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 5 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.242812:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b4a expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.242815:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267671552:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.242824:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.242828:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.242832:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.242835:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.242854:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.242864:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.242866:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572480 going to sleep for 11 seconds 00010000:00010000:1.0:1746065138.242872:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065138.242890:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881272932736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.242895:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30288 00000100:00100000:3.0:1746065138.243871:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267671552:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.243886:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.243894:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065138.243914:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272932608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1180us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.243920:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30287 00000100:00100000:0.0:1746065138.246916:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.247636:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272932864 00000100:00100000:3.0:1746065138.247645:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272932864 00010000:00010000:3.0:1746065138.247675:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.247712:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14259 00000100:00100000:3.0:1746065138.247719:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272932864:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.247730:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.247749:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.247760:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.247779:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fbcb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b3c expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.247808:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.247809:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.247816:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.247823:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.247850:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.247859:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.247869:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267671808:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.247967:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.249932:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267671808:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.249957:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.249992:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272932864:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2272us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.250000:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14259 00000100:00100000:0.0:1746065138.252743:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.252843:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272933120 00000100:00100000:3.0:1746065138.252850:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272933120 00002000:00100000:3.0:1746065138.252884:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859880 x1830881272933120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.252894:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859880 with x1830881272933120 ext(0->4095) 00010000:00010000:3.0:1746065138.252901:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.252913:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.252918:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859880 00000100:00100000:3.0:1746065138.252958:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2828 00000100:00100000:3.0:1746065138.252966:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272933120:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.253323:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272933120:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 357us (585us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.253329:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2828 00002000:00100000:3.0:1746065138.253334:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859880 x1830881272933120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.253339:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859880 with x1830881272933120 ext(0->4095) 00010000:00010000:3.0:1746065138.253343:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.253355:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.253360:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859880 00000100:00100000:0.0:1746065138.256779:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.256960:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272933248 00000100:00100000:3.0:1746065138.256968:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272933248 00010000:00010000:3.0:1746065138.257002:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.257035:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14260 00000100:00100000:3.0:1746065138.257043:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272933248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.257058:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.257077:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.257115:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.257133:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b43 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.257318:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.257321:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.257328:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.257339:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.257366:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.257376:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267671936:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.257457:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.259042:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267671936:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.259054:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.259101:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272933248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2038us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.259110:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14260 00000100:00100000:0.0:1746065138.259428:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.259535:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272933504 00000100:00100000:3.0:1746065138.259540:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272933504 00002000:00100000:3.0:1746065138.259564:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880079c37100 x1830881272933504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.259573:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880079c37100 with x1830881272933504 ext(0->4095) 00002000:00010000:3.0:1746065138.259577:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880079c37100 00000100:00100000:3.0:1746065138.259603:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13581 00000100:00100000:3.0:1746065138.259609:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272933504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.259760:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272933504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 151us (332us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.259769:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13581 00002000:00100000:3.0:1746065138.259774:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880079c37100 x1830881272933504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.259781:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880079c37100 with x1830881272933504 ext(0->4095) 00002000:00010000:3.0:1746065138.259784:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880079c37100 00000100:00100000:0.0:1746065138.262370:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.262446:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272933632 00000100:00100000:3.0:1746065138.262453:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272933632 00000100:00100000:3.0:1746065138.262499:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30289 00000100:00100000:3.0:1746065138.262506:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272933632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.262519:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.262532:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b51 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.262554:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.262561:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.262563:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.262566:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.262589:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 79 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.262598:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 79 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.262613:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267672064:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.262683:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.264618:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267672064:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.264640:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.264655:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065138.264691:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272933632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2184us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.264698:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30289 00000100:00100000:0.0:1746065138.264886:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.265165:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272933760 00000100:00100000:3.0:1746065138.265171:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272933760 00010000:00010000:3.0:1746065138.265192:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.265210:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14261 00000100:00100000:3.0:1746065138.265216:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881272933760:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.265226:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.265240:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.265249:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.265271:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fbd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b4a expref: 80 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.265297:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.265298:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.265304:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.265312:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.265334:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.265344:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267672192:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.265391:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.269061:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.269169:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267672192:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.269184:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.269238:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2004:x1830881272933760:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4021us (4352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.269248:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14261 00000100:00100000:2.0:1746065138.269575:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272934016 00000100:00100000:2.0:1746065138.269581:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272934016 00002000:00100000:2.0:1746065138.269611:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ce00 x1830881272934016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.269620:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ce00 with x1830881272934016 ext(0->4095) 00002000:00010000:2.0:1746065138.269623:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549ce00 00000100:00100000:2.0:1746065138.269650:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13582 00000100:00100000:2.0:1746065138.269655:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272934016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.269762:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272934016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 106us (708us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.269767:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13582 00002000:00100000:2.0:1746065138.269772:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ce00 x1830881272934016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.269778:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ce00 with x1830881272934016 ext(0->4095) 00002000:00010000:2.0:1746065138.269781:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549ce00 00000100:00100000:0.0:1746065138.271061:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.271118:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272934144 00000100:00100000:3.0:1746065138.271232:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272934144 00000100:00100000:3.0:1746065138.272172:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30290 00000100:00100000:3.0:1746065138.272182:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1791:x1830881272934144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.272199:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.272213:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b58 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.272240:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.272246:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.272248:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.272251:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.272276:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.272286:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 5 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.272297:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267672320:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.272372:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.274495:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267672320:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.274517:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.274532:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065138.274566:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881272934144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2386us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.274576:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30290 00000100:00100000:0.0:1746065138.275224:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.276124:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272934272 00000100:00100000:3.0:1746065138.276132:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272934272 00000100:00100000:0.0:1746065138.276703:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.276793:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30291 00000100:00100000:3.0:1746065138.276801:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881272934272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.276815:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.276829:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b5f expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.276850:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.276854:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.276859:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746065138.277201:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272934400 00000100:00100000:2.0:1746065138.277205:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272934400 00010000:00010000:2.0:1746065138.277222:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.277237:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14262 00000100:00100000:2.0:1746065138.277242:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272934400:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.277248:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.277288:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.277364:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.277378:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.277393:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fbe0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b51 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.277461:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.277472:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.277480:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.277481:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.277485:0:21550:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.277495:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.277511:0:21550:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.277520:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.277530:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267672576:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.277818:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.277998:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.278064:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272934400:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 820us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.278071:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14262 00000100:00100000:3.0:1746065138.283030:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267672576:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.283049:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065138.283113:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272934272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6311us (7888us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.283121:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30291 00000100:00100000:0.0:1746065138.284508:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.285134:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272934656 00000100:00100000:2.0:1746065138.285142:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272934656 00002000:00100000:2.0:1746065138.285179:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549c700 x1830881272934656/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.285189:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549c700 with x1830881272934656 ext(0->4095) 00010000:00010000:2.0:1746065138.285197:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.285209:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.285216:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549c700 00000100:00100000:2.0:1746065138.285246:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2829 00000100:00100000:2.0:1746065138.285253:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272934656:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.285342:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272934656:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (838us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.285348:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2829 00002000:00100000:2.0:1746065138.285355:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549c700 x1830881272934656/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.285362:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549c700 with x1830881272934656 ext(0->4095) 00010000:00010000:2.0:1746065138.285366:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.285375:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.285380:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549c700 00000100:00100000:1.0:1746065138.291394:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.291950:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272934784 00000100:00100000:3.0:1746065138.291959:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272934784 00010000:00010000:3.0:1746065138.291989:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.292101:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14263 00000100:00100000:3.0:1746065138.292109:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272934784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.292120:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.292137:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.292148:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.292167:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fbe7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b58 expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.292191:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.292193:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.292198:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.292204:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.292230:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 80 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.292240:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267672704:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.295993:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.296024:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267672704:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.296038:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.296071:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272934784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3963us (4690us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.296096:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14263 00000100:00100000:0.0:1746065138.297931:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.298003:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272935040 00000100:00100000:1.0:1746065138.298012:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272935040 00002000:00100000:1.0:1746065138.298046:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549d500 x1830881272935040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.298056:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d500 with x1830881272935040 ext(0->4095) 00002000:00010000:1.0:1746065138.298060:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549d500 00000100:00100000:1.0:1746065138.301248:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13583 00000100:00100000:1.0:1746065138.301262:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272935040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.301376:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272935040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 119us (3449us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.301381:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13583 00002000:00100000:1.0:1746065138.301387:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549d500 x1830881272935040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.301396:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d500 with x1830881272935040 ext(0->4095) 00002000:00010000:1.0:1746065138.301401:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549d500 00000100:00100000:0.0:1746065138.304473:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.304547:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272935168 00000100:00100000:3.0:1746065138.304555:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272935168 00000100:00100000:3.0:1746065138.304596:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30292 00000100:00100000:3.0:1746065138.304602:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272935168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.304615:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.304627:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b66 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.304650:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.304657:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.304658:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.304661:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.304683:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 79 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.304693:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 79 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.304702:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267672832:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.304758:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.309724:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267672832:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.309748:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.309768:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065138.309812:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272935168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5208us (5343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.309820:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30292 00000100:00100000:2.0:1746065138.318693:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.318757:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272935296 00000100:00100000:1.0:1746065138.318765:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272935296 00002000:00100000:1.0:1746065138.318800:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f849f80 x1830881272935296/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.318810:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f849f80 with x1830881272935296 ext(0->7) 00010000:00010000:1.0:1746065138.318817:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.318831:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 80 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.318838:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f849f80 00000100:00100000:1.0:1746065138.318853:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2830 00000100:00100000:1.0:1746065138.318859:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881272935296:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065138.321582:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272935296:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2716us (2890us total) trans 4294972103 rc 0/0 00000100:00100000:0.0:1746065138.321591:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2830 00002000:00100000:0.0:1746065138.321599:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f849f80 x1830881272935296/t4294972103(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.321608:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f849f80 with x1830881272935296 ext(0->7) 00010000:00010000:0.0:1746065138.321616:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.321630:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.321636:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f849f80 00000100:00100000:2.0:1746065138.324471:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.325990:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272935424 00000100:00100000:0.0:1746065138.325999:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272935424 00000100:00100000:0.0:1746065138.326050:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30293 00000100:00100000:0.0:1746065138.326057:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272935424:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065138.326071:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.326295:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b6d expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.326319:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065138.326325:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.326331:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065138.326334:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 83 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.326364:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.326376:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 83 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.326384:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f85d400, rc 0) 00000100:00100000:0.0:1746065138.326435:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1791:x1830881272935424:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 377us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.326441:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30293 00000100:00100000:2.0:1746065138.326561:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.326683:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272935552 00000100:00100000:0.0:1746065138.326687:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272935552 00010000:00010000:0.0:1746065138.326700:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065138.326764:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14264 00000100:00100000:0.0:1746065138.326769:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2002:x1830881272935552:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065138.326777:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065138.326790:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.326799:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.326814:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fbee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b5f expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.327180:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.327182:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.327188:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.327195:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.327213:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.327222:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 5 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065138.327236:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c92a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267673088:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065138.327658:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.328968:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c92a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267673088:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.328984:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.329022:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2002:x1830881272935552:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2251us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.329030:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14264 00000100:00100000:0.0:1746065138.329500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.329845:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272935808 00000100:00100000:2.0:1746065138.329852:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272935808 00002000:00100000:2.0:1746065138.329883:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91f80 x1830881272935808/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.329892:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91f80 with x1830881272935808 ext(0->4095) 00010000:00010000:2.0:1746065138.329899:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.329912:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.329918:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91f80 00000100:00100000:2.0:1746065138.329934:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2831 00000100:00100000:2.0:1746065138.329954:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272935808:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746065138.330152:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272935808:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 210us (652us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.330159:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2831 00002000:00100000:2.0:1746065138.330165:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91f80 x1830881272935808/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.330172:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91f80 with x1830881272935808 ext(0->4095) 00010000:00010000:2.0:1746065138.330176:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.330191:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.330197:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91f80 00000100:00100000:0.0:1746065138.332819:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.332885:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272935936 00000100:00100000:2.0:1746065138.332893:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272935936 00010000:00010000:2.0:1746065138.332918:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.332960:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14265 00000100:00100000:2.0:1746065138.332967:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272935936:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.332979:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.332993:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.333003:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.333021:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fbf5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b66 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.333041:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.333043:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.333048:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.333054:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.333079:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.333115:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267673216:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.333177:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.334350:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267673216:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.334365:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.334390:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272935936:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1423us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.334398:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14265 00000100:00100000:0.0:1746065138.335340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.335480:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272936192 00000100:00100000:2.0:1746065138.335485:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272936192 00002000:00100000:2.0:1746065138.335515:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90a80 x1830881272936192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.335523:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90a80 with x1830881272936192 ext(0->4095) 00002000:00010000:2.0:1746065138.335527:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90a80 00000100:00100000:2.0:1746065138.335635:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13584 00000100:00100000:2.0:1746065138.335642:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272936192:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.335750:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272936192:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 108us (411us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.335756:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13584 00002000:00100000:2.0:1746065138.335761:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90a80 x1830881272936192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.335767:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90a80 with x1830881272936192 ext(0->4095) 00002000:00010000:2.0:1746065138.335770:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90a80 00000100:00100000:0.0:1746065138.336880:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.337048:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272936320 00000100:00100000:2.0:1746065138.337053:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272936320 00000100:00100000:2.0:1746065138.337152:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30294 00000100:00100000:2.0:1746065138.337159:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272936320:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.337169:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.337182:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b74 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.337206:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.337212:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.337214:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.337217:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.337238:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 81 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.337247:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 81 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.337256:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267673344:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.337315:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.339530:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267673344:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.339555:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.339569:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065138.339613:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272936320:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2454us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.339619:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30294 00000100:00100000:0.0:1746065138.341127:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.341395:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272936448 00000100:00100000:2.0:1746065138.341402:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272936448 00010000:00010000:2.0:1746065138.341427:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.341463:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14266 00000100:00100000:2.0:1746065138.341470:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272936448:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.341480:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.341496:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.341506:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.341525:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f85d400/0x392ae0376f87fbfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b6d expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.341588:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.341590:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.341597:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.341604:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.341630:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.341640:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267673472:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.341869:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.344370:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267673472:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.344387:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.344483:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272936448:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3012us (3358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.344491:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14266 00000100:00100000:0.0:1746065138.345563:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.345615:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272936704 00000100:00100000:2.0:1746065138.345622:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272936704 00002000:00100000:2.0:1746065138.345653:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90e00 x1830881272936704/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.345662:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90e00 with x1830881272936704 ext(0->4095) 00002000:00010000:2.0:1746065138.345666:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90e00 00000100:00100000:2.0:1746065138.345982:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13585 00000100:00100000:2.0:1746065138.345989:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272936704:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.346110:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272936704:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 121us (548us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.346116:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13585 00002000:00100000:2.0:1746065138.346121:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90e00 x1830881272936704/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.346129:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90e00 with x1830881272936704 ext(0->4095) 00002000:00010000:2.0:1746065138.346131:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90e00 00000100:00100000:0.0:1746065138.346255:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.346415:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272936832 00000100:00100000:3.0:1746065138.346419:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272936832 00000100:00100000:3.0:1746065138.346585:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30295 00000100:00100000:3.0:1746065138.346593:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272936832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.346602:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.346614:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b7b expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.346636:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.346642:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.346643:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.346646:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.346669:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.346679:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 5 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.346692:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267673600:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.347605:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.348374:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.348785:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272936960 00000100:00100000:2.0:1746065138.348791:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272936960 00000100:00100000:2.0:1746065138.348823:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30296 00000100:00100000:2.0:1746065138.348828:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1795:x1830881272936960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.348839:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.348851:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b82 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.348867:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.348871:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 84 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.348876:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.348878:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.348899:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 84 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.348908:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.348915:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065138.348962:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1795:x1830881272936960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 133us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.348967:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30296 00000100:00100000:3.0:1746065138.349959:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267673600:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.349976:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 83 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.349985:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065138.350008:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1791:x1830881272936832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3416us (3754us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.350014:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30295 00000100:00100000:0.0:1746065138.350278:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.350345:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272937088 00000100:00100000:2.0:1746065138.350349:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272937088 00010000:00010000:2.0:1746065138.350366:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.350507:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14267 00000100:00100000:2.0:1746065138.350514:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272937088:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.350522:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.350535:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.350544:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.350559:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b74 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.350739:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.350741:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.350748:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.350754:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.350776:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.350786:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.350795:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267673856:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.350855:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.352960:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.353037:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267673856:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.353051:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.353672:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272937344 00000100:00100000:1.0:1746065138.353678:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272937344 00002000:00100000:1.0:1746065138.353709:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92a00 x1830881272937344/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.353718:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92a00 with x1830881272937344 ext(0->4095) 00010000:00010000:1.0:1746065138.353725:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.353736:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.353742:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c92a00 00000100:00100000:1.0:1746065138.353770:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2832 00000100:00100000:1.0:1746065138.353776:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272937344:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.353964:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272937088:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3449us (3685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.353971:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14267 00000100:00100000:1.0:1746065138.354871:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272937344:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1093us (1914us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.354878:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2832 00002000:00100000:1.0:1746065138.354884:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92a00 x1830881272937344/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.354891:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92a00 with x1830881272937344 ext(0->4095) 00010000:00010000:1.0:1746065138.354901:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.354910:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.354916:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c92a00 00000100:00100000:0.0:1746065138.356664:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.356955:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272937472 00000100:00100000:2.0:1746065138.356963:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272937472 00010000:00010000:2.0:1746065138.356986:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.357162:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14268 00000100:00100000:2.0:1746065138.357169:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272937472:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.357181:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.357196:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.357207:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.357398:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b7b expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.357414:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.357416:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.357422:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.357429:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.357458:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.357468:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267673984:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.357540:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.358872:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267673984:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.358885:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.358921:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272937472:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1751us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.358928:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14268 00000100:00100000:0.0:1746065138.359459:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.359505:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272937728 00000100:00100000:1.0:1746065138.359511:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272937728 00002000:00100000:1.0:1746065138.359539:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f086300 x1830881272937728/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.359547:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086300 with x1830881272937728 ext(0->4095) 00002000:00010000:1.0:1746065138.359551:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f086300 00000100:00100000:1.0:1746065138.359575:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13586 00000100:00100000:1.0:1746065138.359582:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272937728:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.359679:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272937728:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 97us (222us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.359684:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13586 00002000:00100000:1.0:1746065138.359687:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f086300 x1830881272937728/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.359692:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086300 with x1830881272937728 ext(0->4095) 00002000:00010000:1.0:1746065138.359694:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f086300 00000100:00100000:2.0:1746065138.361413:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.361476:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272937856 00000100:00100000:3.0:1746065138.361483:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272937856 00000100:00100000:3.0:1746065138.361526:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30297 00000100:00100000:3.0:1746065138.361533:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272937856:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.361545:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.361560:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b89 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.361583:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.361590:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.361592:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.361594:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.361621:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.361637:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.361647:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267674112:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.361722:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.364790:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.364979:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272937984 00000100:00100000:3.0:1746065138.364984:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267674112:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.364985:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272937984 00010000:00010000:3.0:1746065138.365006:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.365009:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.365020:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:2.0:1746065138.365046:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14269 00000100:00100000:2.0:1746065138.365053:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272937984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.365064:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.365111:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.365120:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.365146:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b82 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.365158:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.365160:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.365165:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.365171:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.365195:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.365203:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272937856:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3670us (3793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.365205:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267674240:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.365210:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30297 00000100:00100000:2.0:1746065138.365255:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.366709:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.367050:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272938240 00000100:00100000:1.0:1746065138.367056:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272938240 00000100:00100000:2.0:1746065138.367065:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267674240:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.367077:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065138.367099:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084a80 x1830881272938240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.367114:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084a80 with x1830881272938240 ext(0->4095) 00002000:00010000:1.0:1746065138.367117:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f084a80 00000100:00100000:2.0:1746065138.367123:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272937984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2069us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.367129:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14269 00000100:00100000:1.0:1746065138.367141:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13587 00000100:00100000:1.0:1746065138.367146:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272938240:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.367239:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272938240:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 93us (532us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.367245:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13587 00002000:00100000:1.0:1746065138.367417:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084a80 x1830881272938240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.367424:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084a80 with x1830881272938240 ext(0->4095) 00002000:00010000:1.0:1746065138.367427:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f084a80 00000100:00100000:0.0:1746065138.371735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.372270:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.372353:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272938368 00000100:00100000:2.0:1746065138.372361:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272938368 00000100:00100000:2.0:1746065138.372395:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272938496 00000100:00100000:2.0:1746065138.372397:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272938496 00000100:00100000:2.0:1746065138.372545:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30298 00000100:00100000:2.0:1746065138.372554:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881272938368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.372568:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.372581:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b90 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.372608:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.372614:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.372616:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.372618:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.372643:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.372653:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 5 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.372662:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267674368:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.372715:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.372891:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30299 00000100:00100000:3.0:1746065138.372900:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1791:x1830881272938496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.372907:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.372913:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b97 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.372924:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.372927:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.372932:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.372934:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 84 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.372965:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.372974:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 84 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.372982:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065138.373019:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1791:x1830881272938496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 121us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.373024:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30299 00000100:00100000:2.0:1746065138.374189:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267674368:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.374206:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.374215:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065138.374237:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1795:x1830881272938368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1684us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.374243:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30298 00000100:00100000:0.0:1746065138.374962:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.375031:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272938624 00000100:00100000:2.0:1746065138.375036:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272938624 00010000:00010000:2.0:1746065138.375055:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.375074:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14270 00000100:00100000:2.0:1746065138.375095:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272938624:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.375104:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.375118:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.375128:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.375144:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fc18 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b89 expref: 6 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.375490:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.375492:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.375499:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.375506:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.375527:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.375536:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.375545:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267674624:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.375599:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.377441:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267674624:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065138.377445:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065138.377455:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.377483:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272938624:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2403us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.377490:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14270 00000100:00100000:1.0:1746065138.377680:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272938880 00000100:00100000:1.0:1746065138.377686:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272938880 00002000:00100000:1.0:1746065138.377720:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0380 x1830881272938880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.377729:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0380 with x1830881272938880 ext(0->4095) 00010000:00010000:1.0:1746065138.377735:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.377746:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.377752:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f0380 00000100:00100000:1.0:1746065138.377776:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2833 00000100:00100000:1.0:1746065138.377783:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881272938880:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.377889:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881272938880:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 105us (444us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.377894:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2833 00002000:00100000:1.0:1746065138.377900:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0380 x1830881272938880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.377907:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0380 with x1830881272938880 ext(0->4095) 00010000:00010000:1.0:1746065138.377911:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.377920:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.377926:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f0380 00000100:00100000:0.0:1746065138.379643:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.379696:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272939008 00000100:00100000:2.0:1746065138.379702:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272939008 00000100:00100000:0.0:1746065138.379707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.379738:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30300 00000100:00100000:2.0:1746065138.379743:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272939008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.379754:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.379766:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5b9e expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.379784:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.379788:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.379793:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272939136 00010000:00010000:2.0:1746065138.379794:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065138.379797:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.379798:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272939136 00010000:00010000:3.0:1746065138.379816:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.379825:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 83 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.379835:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14271 00010000:00010000:2.0:1746065138.379835:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.379840:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272939136:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.379842:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00010000:00010000:3.0:1746065138.379847:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.379861:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.379871:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.379887:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fc1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b90 expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.379889:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272939008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 138us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.379894:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30300 00010000:00010000:3.0:1746065138.379900:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.379901:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.379906:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.379912:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.379931:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 82 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.379952:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.379962:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267674880:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.380410:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.383450:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267674880:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.383467:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.383511:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272939136:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3669us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.383521:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14271 00000100:00100000:0.0:1746065138.383567:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.383593:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272939392 00000100:00100000:0.0:1746065138.383597:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272939392 00002000:00100000:0.0:1746065138.383626:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0000 x1830881272939392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.383635:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0000 with x1830881272939392 ext(0->4095) 00010000:00010000:0.0:1746065138.383642:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.383654:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.383660:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f0000 00000100:00100000:0.0:1746065138.383689:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2834 00000100:00100000:0.0:1746065138.383695:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272939392:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065138.383980:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272939392:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 284us (412us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065138.383986:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2834 00002000:00100000:0.0:1746065138.383991:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0000 x1830881272939392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.383997:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0000 with x1830881272939392 ext(0->4095) 00010000:00010000:0.0:1746065138.384001:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.384010:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 82 pid: 21550 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.384015:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f0000 00000100:00100000:0.0:1746065138.385435:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.385502:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.385583:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272939648 00000100:00100000:2.0:1746065138.385588:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272939648 00000100:00100000:2.0:1746065138.385613:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30301 00000100:00100000:2.0:1746065138.385618:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272939648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.385627:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.385639:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ba5 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.385655:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.385661:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.385667:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065138.385675:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.385701:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.385713:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.385721:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065138.385759:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1791:x1830881272939648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 140us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.385764:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30301 00000100:00100000:3.0:1746065138.385835:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272939520 00000100:00100000:3.0:1746065138.385840:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272939520 00010000:00010000:3.0:1746065138.385855:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.385883:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14272 00000100:00100000:3.0:1746065138.385889:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b403c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272939520:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.385896:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.385909:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.385918:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.385933:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fc26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b97 expref: 83 pid: 21550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.385959:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.385961:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.385966:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.385972:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.385991:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.386000:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.386010:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267675136:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.386062:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.388396:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.388469:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272939904 00000100:00100000:1.0:1746065138.388476:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272939904 00000100:00100000:3.0:1746065138.388490:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267675136:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.388504:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065138.388507:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3100 x1830881272939904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.388516:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3100 with x1830881272939904 ext(0->4095) 00010000:00010000:1.0:1746065138.388523:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.388533:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.388538:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3100 00000100:00100000:3.0:1746065138.388545:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b403c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272939520:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2655us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.388553:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14272 00000100:00100000:1.0:1746065138.388583:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2835 00000100:00100000:1.0:1746065138.388599:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272939904:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.388883:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272939904:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 292us (490us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.388889:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2835 00002000:00100000:1.0:1746065138.388907:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3100 x1830881272939904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.388913:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3100 with x1830881272939904 ext(0->4095) 00010000:00010000:1.0:1746065138.388918:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.388926:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.388963:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3100 00000100:00100000:0.0:1746065138.390335:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.390895:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272940032 00000100:00100000:3.0:1746065138.390901:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272940032 00010000:00010000:3.0:1746065138.390921:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.390999:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14273 00000100:00100000:3.0:1746065138.391006:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272940032:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.391016:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.391030:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.391041:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.391063:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5b9e expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.391716:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.391719:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.391726:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.391749:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.391797:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.391808:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267675264:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.393073:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.396396:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.396476:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267675264:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065138.396476:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272940288 00000100:00100000:1.0:1746065138.396483:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272940288 00010000:00010000:3.0:1746065138.396511:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065138.396517:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbc380 x1830881272940288/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.396525:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc380 with x1830881272940288 ext(0->4095) 00002000:00010000:1.0:1746065138.396528:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbc380 00000100:00100000:1.0:1746065138.396545:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13588 00000100:00100000:1.0:1746065138.396552:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272940288:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.396606:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272940032:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5583us (6254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.396627:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14273 00000100:00100000:1.0:1746065138.396653:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272940288:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 101us (263us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.396664:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13588 00002000:00100000:1.0:1746065138.396669:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbc380 x1830881272940288/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.396675:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc380 with x1830881272940288 ext(0->4095) 00002000:00010000:1.0:1746065138.396678:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbc380 00000100:00100000:0.0:1746065138.397968:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.398058:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272940416 00000100:00100000:2.0:1746065138.398061:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272940416 00000100:00100000:2.0:1746065138.398094:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30302 00000100:00100000:2.0:1746065138.398098:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272940416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.398106:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.398116:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5bac expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.398131:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.398135:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.398136:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.398138:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.398155:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.398165:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.398172:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267675392:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.398665:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.401169:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.401271:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267675392:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.401294:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.401310:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065138.401350:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272940416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3250us (3383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.401352:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272940544 00000100:00100000:2.0:1746065138.401357:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30302 00000100:00100000:3.0:1746065138.401358:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272940544 00010000:00010000:3.0:1746065138.401379:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.401398:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14274 00000100:00100000:3.0:1746065138.401403:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272940544:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.401414:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.401429:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.401443:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.401461:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fc34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ba5 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.401499:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.401501:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.401507:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.401514:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.401536:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.401545:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267675520:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.401591:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.403373:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267675520:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.403385:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.403420:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272940544:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2016us (2255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.403428:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14274 00000100:00100000:0.0:1746065138.403482:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.403617:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272940800 00000100:00100000:2.0:1746065138.403622:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272940800 00002000:00100000:2.0:1746065138.403650:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18e300 x1830881272940800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.403657:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18e300 with x1830881272940800 ext(0->4095) 00002000:00010000:2.0:1746065138.403661:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f18e300 00000100:00100000:2.0:1746065138.403675:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13589 00000100:00100000:2.0:1746065138.403681:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272940800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.405212:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272940800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1524us (1722us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.405228:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13589 00002000:00100000:2.0:1746065138.405236:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18e300 x1830881272940800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.405244:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18e300 with x1830881272940800 ext(0->4095) 00002000:00010000:2.0:1746065138.405248:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f18e300 00000100:00100000:0.0:1746065138.406530:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.406575:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.406620:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272940928 00000100:00100000:1.0:1746065138.406627:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272940928 00000100:00100000:2.0:1746065138.406638:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272941056 00000100:00100000:2.0:1746065138.406642:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272941056 00000100:00100000:1.0:1746065138.406662:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30303 00000100:00100000:1.0:1746065138.406667:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881272940928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:2.0:1746065138.406678:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30304 00010000:00010000:1.0:1746065138.406680:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065138.406684:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272941056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.406690:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.406693:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5bb3 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.406697:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5bba expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.406714:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.406721:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.406723:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.406726:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 84 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.406760:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.406764:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 84 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.406769:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.406772:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.406795:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 84 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.406805:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.406817:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00010000:00010000:2.0:1746065138.406924:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.406936:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.406963:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267675776:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.406978:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1795:x1830881272940928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 310us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.406984:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30303 00000100:00100000:2.0:1746065138.407014:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.408328:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267675776:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.408346:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 83 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.408356:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065138.408396:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1791:x1830881272941056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1711us (1819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.408402:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30304 00000100:00100000:0.0:1746065138.415214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.415317:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272941184 00000100:00100000:3.0:1746065138.415325:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272941184 00010000:00010000:3.0:1746065138.415358:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.415381:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14275 00000100:00100000:3.0:1746065138.415387:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272941184:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.415399:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.415415:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.415426:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.415444:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fc3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bac expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.415551:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.415554:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.415561:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.415570:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.415597:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.415606:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.415619:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267675904:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.416500:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.418124:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267675904:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.418138:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.418820:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272941184:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3431us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.418829:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14275 00000100:00100000:0.0:1746065138.419037:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.419127:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272941440 00000100:00100000:3.0:1746065138.419133:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272941440 00002000:00100000:3.0:1746065138.419163:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54a680 x1830881272941440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.419172:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a680 with x1830881272941440 ext(0->4095) 00010000:00010000:3.0:1746065138.419179:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.419189:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.419195:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54a680 00000100:00100000:3.0:1746065138.419221:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2836 00000100:00100000:3.0:1746065138.419227:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272941440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.419319:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272941440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 92us (282us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.419328:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2836 00002000:00100000:3.0:1746065138.419333:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54a680 x1830881272941440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.419339:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a680 with x1830881272941440 ext(0->4095) 00010000:00010000:3.0:1746065138.419344:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.419352:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.419358:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54a680 00000100:00100000:0.0:1746065138.422152:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.422236:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272941568 00000100:00100000:3.0:1746065138.422243:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272941568 00010000:00010000:3.0:1746065138.422268:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.422290:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14276 00000100:00100000:3.0:1746065138.422297:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2003:x1830881272941568:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.422308:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.422322:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.422333:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.422351:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fc49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bba expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.422375:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.422377:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.422384:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.422390:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.422414:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.422424:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267676032:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.422487:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.425429:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.425509:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267676032:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.425523:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.425556:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2003:x1830881272941568:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3259us (3409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.425565:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14276 00000100:00100000:1.0:1746065138.425639:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272941824 00000100:00100000:1.0:1746065138.425644:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272941824 00002000:00100000:1.0:1746065138.425670:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549180 x1830881272941824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.425678:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549180 with x1830881272941824 ext(0->4095) 00002000:00010000:1.0:1746065138.425681:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d549180 00000100:00100000:1.0:1746065138.425694:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13590 00000100:00100000:1.0:1746065138.425698:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272941824:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.425918:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272941824:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 218us (494us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.425925:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13590 00002000:00100000:1.0:1746065138.425929:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549180 x1830881272941824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.425937:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549180 with x1830881272941824 ext(0->4095) 00002000:00010000:1.0:1746065138.425950:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d549180 00000100:00100000:0.0:1746065138.428590:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.428651:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272941952 00000100:00100000:2.0:1746065138.428658:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272941952 00000100:00100000:2.0:1746065138.428695:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30305 00000100:00100000:2.0:1746065138.428701:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272941952:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.428713:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.428726:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5bc1 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.428747:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.428754:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.428755:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.428758:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.428785:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.428795:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.428805:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267676160:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.428861:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.430495:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267676160:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.430516:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.430527:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:2.0:1746065138.430552:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272941952:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1851us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.430559:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30305 00000100:00100000:0.0:1746065138.431325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.431559:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272942080 00000100:00100000:3.0:1746065138.431566:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272942080 00010000:00010000:3.0:1746065138.431591:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.431620:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14277 00000100:00100000:3.0:1746065138.431626:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272942080:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.431637:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.431652:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.431661:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.431678:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fc42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bb3 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.432264:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.432267:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.432274:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.432282:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.432306:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.432316:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267676288:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.432382:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.434805:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267676288:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.434821:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.434851:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272942080:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3225us (3527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.434861:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14277 00000100:00100000:0.0:1746065138.437307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.437464:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272942336 00000100:00100000:1.0:1746065138.437471:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272942336 00002000:00100000:1.0:1746065138.437505:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb94a80 x1830881272942336/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.437519:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb94a80 with x1830881272942336 ext(0->4095) 00002000:00010000:1.0:1746065138.437524:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb94a80 00000100:00100000:1.0:1746065138.437552:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13591 00000100:00100000:1.0:1746065138.437558:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272942336:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.437650:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272942336:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 92us (348us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.437656:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13591 00002000:00100000:1.0:1746065138.437660:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb94a80 x1830881272942336/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.437667:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb94a80 with x1830881272942336 ext(0->4095) 00002000:00010000:1.0:1746065138.437670:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb94a80 00000100:00100000:0.0:1746065138.438002:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.438143:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272942464 00000100:00100000:2.0:1746065138.438147:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272942464 00000100:00100000:2.0:1746065138.438169:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30306 00000100:00100000:2.0:1746065138.438174:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881272942464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.438182:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.438196:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5bc8 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.438215:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.438222:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.438224:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.438227:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.438248:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.438258:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.438267:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267676416:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.439356:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.440786:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.440863:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267676416:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.440884:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.440897:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065138.440927:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272942464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2753us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.440934:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30306 00000100:00100000:2.0:1746065138.440985:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272942592 00000100:00100000:2.0:1746065138.440989:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272942592 00000100:00100000:2.0:1746065138.441011:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30307 00000100:00100000:2.0:1746065138.441016:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272942592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.441028:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.441038:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5bcf expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.441051:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.441055:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.441060:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.441063:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 7 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.441100:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.441109:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 7 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.441116:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065138.441131:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1795:x1830881272942592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 115us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.441136:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30307 00000100:00100000:0.0:1746065138.441874:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.441955:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272942720 00000100:00100000:3.0:1746065138.441959:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272942720 00010000:00010000:3.0:1746065138.441978:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 7 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.441995:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14278 00000100:00100000:3.0:1746065138.442001:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881272942720:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.442009:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.442023:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 7 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.442032:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 7 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.442047:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fc50 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc1 expref: 7 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.442071:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.442072:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.442078:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.442102:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.442121:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.442131:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 81 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.442140:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267676672:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.442193:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.444888:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267676672:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.444903:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065138.444935:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.444955:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272942720:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2953us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.444963:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14278 00000100:00100000:2.0:1746065138.445156:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272942976 00000100:00100000:2.0:1746065138.445162:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272942976 00002000:00100000:2.0:1746065138.445193:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091c000 x1830881272942976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.445201:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091c000 with x1830881272942976 ext(0->4095) 00010000:00010000:2.0:1746065138.445207:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.445218:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.445223:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091c000 00000100:00100000:2.0:1746065138.445247:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2837 00000100:00100000:2.0:1746065138.445254:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272942976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.445657:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272942976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 403us (722us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.445664:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2837 00002000:00100000:2.0:1746065138.445669:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091c000 x1830881272942976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.445676:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091c000 with x1830881272942976 ext(0->4095) 00010000:00010000:2.0:1746065138.445680:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.445688:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.445693:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091c000 00000100:00100000:0.0:1746065138.446914:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.446967:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.447032:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272943232 00000100:00100000:3.0:1746065138.447038:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272943232 00010000:00010000:3.0:1746065138.447055:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.447072:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14279 00000100:00100000:2.0:1746065138.447072:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272943104 00000100:00100000:2.0:1746065138.447075:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272943104 00000100:00100000:3.0:1746065138.447077:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b403dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272943232:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.447105:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.447121:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.447129:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.447149:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bc8 expref: 83 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.447159:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.447161:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.447167:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.447173:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.447196:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.447205:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267676800:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.447321:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30308 00000100:00100000:2.0:1746065138.447328:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272943104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.447337:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.447346:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5bd6 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.447360:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.447365:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.447366:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.447368:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 83 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.447381:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.447389:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.447396:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267676928:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.447479:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.447873:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.450242:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267676800:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.450257:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.450289:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b403dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272943232:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3210us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.450297:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14279 00000100:00100000:2.0:1746065138.450364:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267676928:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.450380:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.450391:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065138.450409:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272943104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3082us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.450417:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30308 00000100:00100000:0.0:1746065138.450699:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.450823:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272943488 00000100:00100000:2.0:1746065138.450829:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272943488 00002000:00100000:2.0:1746065138.450853:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091ce00 x1830881272943488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.450861:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ce00 with x1830881272943488 ext(0->4095) 00010000:00010000:2.0:1746065138.450866:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.450876:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.450881:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091ce00 00000100:00100000:2.0:1746065138.451021:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2838 00000100:00100000:2.0:1746065138.451028:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272943488:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.451603:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272943488:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 574us (902us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.451608:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2838 00002000:00100000:2.0:1746065138.451614:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091ce00 x1830881272943488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.451621:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ce00 with x1830881272943488 ext(0->4095) 00010000:00010000:2.0:1746065138.451625:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.451638:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.451642:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091ce00 00000100:00100000:0.0:1746065138.454253:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.454802:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272943616 00000100:00100000:3.0:1746065138.454808:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272943616 00010000:00010000:3.0:1746065138.454833:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.454855:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14280 00000100:00100000:3.0:1746065138.454861:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272943616:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.454876:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.454892:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.454903:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.454920:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fc5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bcf expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.454948:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.454949:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.454955:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.454962:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.454987:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.454996:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267677056:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.456575:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.458747:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.459251:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267677056:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.459264:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.459880:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272943872 00000100:00100000:2.0:1746065138.459886:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272943872 00002000:00100000:2.0:1746065138.459916:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918700 x1830881272943872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.459924:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918700 with x1830881272943872 ext(0->4095) 00002000:00010000:2.0:1746065138.459927:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918700 00000100:00100000:2.0:1746065138.459953:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13592 00000100:00100000:2.0:1746065138.459958:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272943872:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.460563:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272943616:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5700us (6314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.460577:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14280 00000100:00100000:2.0:1746065138.460722:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272943872:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 763us (1979us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.460727:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13592 00002000:00100000:2.0:1746065138.460733:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918700 x1830881272943872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.460739:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918700 with x1830881272943872 ext(0->4095) 00002000:00010000:2.0:1746065138.460742:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918700 00000100:00100000:0.0:1746065138.462150:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.462221:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272944000 00000100:00100000:2.0:1746065138.462227:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272944000 00000100:00100000:2.0:1746065138.462478:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30309 00000100:00100000:2.0:1746065138.462486:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272944000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.462501:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.462513:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5bdd expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.462532:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.462539:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.462541:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.462544:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.462571:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.462581:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.462589:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267677184:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.462704:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.463765:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267677184:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.463781:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.463791:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065138.463814:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272944000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1329us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.463822:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30309 00000100:00100000:0.0:1746065138.464433:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.464506:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272944128 00000100:00100000:3.0:1746065138.464512:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272944128 00010000:00010000:3.0:1746065138.464531:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 82 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.464552:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14281 00000100:00100000:3.0:1746065138.464557:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272944128:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.464566:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.464579:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 82 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.464587:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 82 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.464603:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bd6 expref: 82 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.464625:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.464626:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.464632:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.464639:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.464661:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.464671:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267677312:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.464780:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.466410:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267677312:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.466423:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.466447:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272944128:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1890us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.466455:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14281 00000100:00100000:1.0:1746065138.467617:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.467653:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272944384 00000100:00100000:2.0:1746065138.467659:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272944384 00002000:00100000:2.0:1746065138.467687:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2a00 x1830881272944384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.467695:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2a00 with x1830881272944384 ext(0->4095) 00002000:00010000:2.0:1746065138.467699:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b2a00 00000100:00100000:2.0:1746065138.467718:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13593 00000100:00100000:2.0:1746065138.467724:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272944384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.467814:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272944384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (198us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.467820:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13593 00002000:00100000:2.0:1746065138.467824:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2a00 x1830881272944384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.467831:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2a00 with x1830881272944384 ext(0->4095) 00002000:00010000:2.0:1746065138.467833:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b2a00 00000100:00100000:0.0:1746065138.469046:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.469306:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272944512 00000100:00100000:2.0:1746065138.469310:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272944512 00000100:00100000:2.0:1746065138.469344:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30310 00000100:00100000:2.0:1746065138.469350:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272944512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.469359:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.469372:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5be4 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.469393:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.469399:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.469401:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.469404:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.469425:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.469434:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.469442:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267677440:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.469502:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.469893:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.470000:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272944640 00000100:00100000:1.0:1746065138.470004:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272944640 00000100:00100000:1.0:1746065138.470031:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30311 00000100:00100000:1.0:1746065138.470036:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1791:x1830881272944640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.470042:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.470049:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5beb expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.470060:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.470063:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.470072:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.470074:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.470116:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.470126:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.470134:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:1.0:1746065138.470156:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1791:x1830881272944640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 120us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.470161:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30311 00000100:00100000:2.0:1746065138.471418:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267677440:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.471434:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 83 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.471442:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065138.471464:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1795:x1830881272944512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2114us (2419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.471470:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30310 00000100:00100000:0.0:1746065138.471893:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.472030:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272944768 00000100:00100000:3.0:1746065138.472034:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272944768 00010000:00010000:3.0:1746065138.472052:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.472079:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14282 00000100:00100000:3.0:1746065138.472104:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272944768:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.472112:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.472126:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.472134:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.472150:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fc6c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bdd expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.472170:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.472172:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.472407:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.472415:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.472436:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.472445:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 82 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.472454:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267677696:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.472506:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.473977:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.474113:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267677696:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.474124:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.474158:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272944768:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2054us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.474165:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14282 00000100:00100000:2.0:1746065138.474289:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272945024 00000100:00100000:2.0:1746065138.474297:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272945024 00002000:00100000:2.0:1746065138.474322:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9180 x1830881272945024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.474331:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9180 with x1830881272945024 ext(0->4095) 00010000:00010000:2.0:1746065138.474337:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.474346:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.474351:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9180 00000100:00100000:2.0:1746065138.474373:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2839 00000100:00100000:2.0:1746065138.474378:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272945024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.474458:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272945024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 80us (483us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.474463:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2839 00002000:00100000:2.0:1746065138.474468:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9180 x1830881272945024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.474474:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9180 with x1830881272945024 ext(0->4095) 00010000:00010000:2.0:1746065138.474478:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.474486:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.474490:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9180 00000100:00100000:0.0:1746065138.476171:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.476404:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272945152 00000100:00100000:2.0:1746065138.476408:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272945152 00000100:00100000:2.0:1746065138.476441:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30312 00000100:00100000:2.0:1746065138.476446:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272945152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.476455:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.476466:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5bf2 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.476480:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.476484:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.476489:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065138.476492:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.476513:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.476522:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.476528:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065138.476554:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272945152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 108us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.476558:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30312 00000100:00100000:0.0:1746065138.476997:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.477032:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272945280 00000100:00100000:3.0:1746065138.477035:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272945280 00010000:00010000:3.0:1746065138.477050:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.477068:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14283 00000100:00100000:3.0:1746065138.477073:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881272945280:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.477105:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.477120:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.477130:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.477143:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5be4 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.477165:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.477167:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.477172:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.477178:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.477194:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.477204:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.477213:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267677952:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.477275:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.479668:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267677952:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.479682:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.479707:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272945280:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2634us (2710us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.479715:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14283 00000100:00100000:0.0:1746065138.480271:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.480601:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272945536 00000100:00100000:3.0:1746065138.480607:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272945536 00002000:00100000:3.0:1746065138.480633:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4ea680 x1830881272945536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.480642:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ea680 with x1830881272945536 ext(0->4095) 00010000:00010000:3.0:1746065138.480648:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.480658:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.480664:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4ea680 00000100:00100000:3.0:1746065138.480688:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2840 00000100:00100000:3.0:1746065138.480693:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272945536:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.480798:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272945536:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 103us (527us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.480803:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2840 00002000:00100000:3.0:1746065138.480807:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4ea680 x1830881272945536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.480813:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ea680 with x1830881272945536 ext(0->4095) 00010000:00010000:3.0:1746065138.480817:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.480825:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.480829:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4ea680 00000100:00100000:0.0:1746065138.482701:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.483393:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.483497:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272945664 00000100:00100000:3.0:1746065138.483503:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272945664 00000100:00100000:3.0:1746065138.483530:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30313 00000100:00100000:3.0:1746065138.483536:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272945664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.483547:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.483558:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5bf9 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.483576:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.483581:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.483585:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065138.483588:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 83 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.483613:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.483623:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 83 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.483632:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065138.483659:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1791:x1830881272945664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 123us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.483664:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30313 00000100:00100000:3.0:1746065138.483682:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272945792 00000100:00100000:3.0:1746065138.483685:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272945792 00010000:00010000:3.0:1746065138.483695:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.483711:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14284 00000100:00100000:3.0:1746065138.483715:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2002:x1830881272945792:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.483721:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.483733:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.484171:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.484184:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fc7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5beb expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.484203:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.484204:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.484209:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.484215:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.484236:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.484245:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.484256:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267678208:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.484310:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.486813:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.487077:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267678208:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.487112:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.487145:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2002:x1830881272945792:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3429us (3752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.487153:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14284 00000100:00100000:2.0:1746065138.487392:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272946048 00000100:00100000:2.0:1746065138.487398:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272946048 00002000:00100000:2.0:1746065138.487429:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f729f80 x1830881272946048/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.487437:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729f80 with x1830881272946048 ext(0->4095) 00010000:00010000:2.0:1746065138.487442:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.487454:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.487459:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f729f80 00000100:00100000:2.0:1746065138.487482:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2841 00000100:00100000:2.0:1746065138.487488:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272946048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.488392:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272946048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 902us (1581us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.488399:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2841 00002000:00100000:2.0:1746065138.488404:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f729f80 x1830881272946048/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.488411:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729f80 with x1830881272946048 ext(0->4095) 00010000:00010000:2.0:1746065138.488415:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.488424:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.488430:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f729f80 00000100:00100000:0.0:1746065138.491045:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.491130:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272946176 00000100:00100000:3.0:1746065138.491137:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272946176 00010000:00010000:3.0:1746065138.491159:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.491193:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14285 00000100:00100000:3.0:1746065138.491199:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272946176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.491208:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.491223:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.491233:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.491251:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fc81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf2 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.491273:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.491275:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.491281:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.491287:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.491311:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.491321:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267678336:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.491385:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.493021:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.493164:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272946432 00000100:00100000:2.0:1746065138.493168:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272946432 00000100:00100000:3.0:1746065138.493170:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267678336:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.493182:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746065138.493194:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72aa00 x1830881272946432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.493203:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72aa00 with x1830881272946432 ext(0->4095) 00002000:00010000:2.0:1746065138.493206:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72aa00 00000100:00100000:3.0:1746065138.493207:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272946176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2008us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.493213:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14285 00000100:00100000:2.0:1746065138.493229:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13594 00000100:00100000:2.0:1746065138.493235:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272946432:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.493333:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272946432:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (313us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.493339:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13594 00002000:00100000:2.0:1746065138.493345:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72aa00 x1830881272946432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.493351:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72aa00 with x1830881272946432 ext(0->4095) 00002000:00010000:2.0:1746065138.493354:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72aa00 00000100:00100000:0.0:1746065138.494892:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.494964:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272946560 00000100:00100000:2.0:1746065138.494968:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272946560 00000100:00100000:2.0:1746065138.494998:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30314 00000100:00100000:2.0:1746065138.495003:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272946560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.495012:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.495023:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c00 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.495041:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.495052:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.495054:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.495057:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.495077:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.495145:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 81 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.495154:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267678464:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.495329:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.496463:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267678464:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.496479:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.496489:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065138.497193:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272946560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2187us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.497199:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30314 00000100:00100000:1.0:1746065138.497468:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.497522:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272946688 00000100:00100000:3.0:1746065138.497527:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272946688 00010000:00010000:3.0:1746065138.497547:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.497580:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14286 00000100:00100000:3.0:1746065138.497585:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b403e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272946688:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.497595:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.497608:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.497617:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.497631:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fc88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5bf9 expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.497741:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.497743:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.497750:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.497759:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.497782:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.497792:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267678592:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.497843:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.499044:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267678592:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.499055:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.499111:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b403e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2005:x1830881272946688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1525us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.499118:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14286 00000100:00100000:0.0:1746065138.500246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.500371:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272946944 00000100:00100000:3.0:1746065138.500377:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272946944 00002000:00100000:3.0:1746065138.500405:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72a680 x1830881272946944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.500414:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a680 with x1830881272946944 ext(0->4095) 00002000:00010000:3.0:1746065138.500418:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72a680 00000100:00100000:3.0:1746065138.500574:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13595 00000100:00100000:3.0:1746065138.500581:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272946944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.500677:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272946944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 97us (432us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.500682:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13595 00002000:00100000:3.0:1746065138.500687:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72a680 x1830881272946944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.500693:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a680 with x1830881272946944 ext(0->4095) 00002000:00010000:3.0:1746065138.500696:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72a680 00000100:00100000:0.0:1746065138.502711:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.503289:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272947072 00000100:00100000:2.0:1746065138.503296:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272947072 00000100:00100000:2.0:1746065138.503337:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30315 00000100:00100000:2.0:1746065138.503343:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272947072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.503357:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.503370:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c07 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.503390:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.503396:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.503398:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.503401:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.503424:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.503434:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.503443:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267678720:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.503514:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.504172:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.504221:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272947200 00000100:00100000:3.0:1746065138.504224:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272947200 00000100:00100000:3.0:1746065138.504241:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30316 00000100:00100000:3.0:1746065138.504245:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1791:x1830881272947200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.504254:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.504260:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c0e expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.504269:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.504272:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.504277:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.504279:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 84 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.504294:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.504302:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 84 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.504309:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065138.504327:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1791:x1830881272947200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.504332:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30316 00000100:00100000:2.0:1746065138.505658:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267678720:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.505986:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 83 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.505996:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:2.0:1746065138.506036:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1795:x1830881272947072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2693us (3328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.506040:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.506046:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30315 00000100:00100000:3.0:1746065138.506462:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272947328 00000100:00100000:3.0:1746065138.506467:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272947328 00010000:00010000:3.0:1746065138.506487:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.506517:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14287 00000100:00100000:3.0:1746065138.506523:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272947328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.506530:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.506544:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.506553:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.506569:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fc8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c00 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.506594:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.506596:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.506602:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.506609:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.506630:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.506639:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 82 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.506649:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267678976:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.506710:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.509654:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.509837:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267678976:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.509853:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.509899:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272947328:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3375us (3859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.509908:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14287 00000100:00100000:0.0:1746065138.510182:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272947584 00000100:00100000:0.0:1746065138.510187:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272947584 00002000:00100000:0.0:1746065138.510216:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbce00 x1830881272947584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.510225:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbce00 with x1830881272947584 ext(0->4095) 00010000:00010000:0.0:1746065138.510232:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.510242:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.510248:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbce00 00000100:00100000:0.0:1746065138.510272:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2842 00000100:00100000:0.0:1746065138.510280:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272947584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065138.510657:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272947584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 377us (1008us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065138.510663:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2842 00002000:00100000:0.0:1746065138.510667:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbce00 x1830881272947584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.510674:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbce00 with x1830881272947584 ext(0->4095) 00010000:00010000:0.0:1746065138.510679:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.510687:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.510692:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbce00 00000100:00100000:0.0:1746065138.513626:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.513695:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272947840 00000100:00100000:2.0:1746065138.513702:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272947840 00000100:00100000:2.0:1746065138.513748:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30317 00000100:00100000:2.0:1746065138.513755:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272947840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.513770:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.513784:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c15 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.513805:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.513809:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.513814:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065138.513817:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.513843:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.513853:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.513861:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065138.513899:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272947840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.513907:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30317 00000100:00100000:0.0:1746065138.514642:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.514816:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272947712 00000100:00100000:3.0:1746065138.514821:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272947712 00010000:00010000:3.0:1746065138.514839:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.514870:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14288 00000100:00100000:3.0:1746065138.514875:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2003:x1830881272947712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.514883:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.514897:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.514907:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.514921:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fc96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c07 expref: 83 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.514951:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.514953:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.514958:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.514964:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.514982:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.514991:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.515000:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267679232:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.516042:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.519161:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267679232:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.519177:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.519212:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2003:x1830881272947712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4336us (4570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.519220:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14288 00000100:00100000:0.0:1746065138.519809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.520127:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272948096 00000100:00100000:3.0:1746065138.520134:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272948096 00002000:00100000:3.0:1746065138.520163:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0380 x1830881272948096/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.520430:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0380 with x1830881272948096 ext(0->4095) 00010000:00010000:3.0:1746065138.520438:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.520450:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.520456:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a0380 00000100:00100000:3.0:1746065138.520501:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2843 00000100:00100000:3.0:1746065138.520509:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272948096:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.520914:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272948096:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 405us (1104us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.520920:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2843 00002000:00100000:3.0:1746065138.520926:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0380 x1830881272948096/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.520933:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0380 with x1830881272948096 ext(0->4095) 00010000:00010000:3.0:1746065138.521040:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.521052:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.521058:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a0380 00000100:00100000:0.0:1746065138.524041:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.524145:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.524222:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272948352 00000100:00100000:3.0:1746065138.524230:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272948352 00010000:00010000:3.0:1746065138.524256:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.524280:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14289 00000100:00100000:3.0:1746065138.524287:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2002:x1830881272948352:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.524297:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.524312:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.524326:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.524343:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fc9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c0e expref: 82 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.524455:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272948224 00000100:00100000:1.0:1746065138.524459:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272948224 00010000:00010000:3.0:1746065138.524774:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.524776:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.524782:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.524790:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.524817:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.524827:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267679360:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.524892:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.524979:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30318 00000100:00100000:1.0:1746065138.524986:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272948224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.524996:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.525004:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c1c expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.525019:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.525028:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.525029:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.525031:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.525045:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.525054:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.525061:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267679488:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.526344:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.528034:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267679360:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.528050:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.528103:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2002:x1830881272948352:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3816us (3957us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.528112:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14289 00000100:00100000:0.0:1746065138.531073:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.531533:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272948608 00000100:00100000:3.0:1746065138.531541:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272948608 00002000:00100000:3.0:1746065138.531582:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1f100 x1830881272948608/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.531592:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f100 with x1830881272948608 ext(0->4095) 00010000:00010000:3.0:1746065138.531600:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.531619:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.531626:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1f100 00000100:00100000:1.0:1746065138.531745:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267679488:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.531765:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.531779:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:3.0:1746065138.532011:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2844 00000100:00100000:3.0:1746065138.532018:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272948608:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.532358:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272948224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7371us (8322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.532364:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30318 00000100:00100000:3.0:1746065138.533061:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272948608:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1041us (1993us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.533068:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2844 00002000:00100000:3.0:1746065138.533075:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1f100 x1830881272948608/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.533105:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f100 with x1830881272948608 ext(0->4095) 00010000:00010000:3.0:1746065138.533111:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.533122:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.533128:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1f100 00000100:00100000:0.0:1746065138.540632:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.541766:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272948736 00000100:00100000:3.0:1746065138.541775:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272948736 00010000:00010000:3.0:1746065138.541807:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.541845:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14290 00000100:00100000:3.0:1746065138.541853:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272948736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.541866:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.541883:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.541895:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.541914:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fca4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c15 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.541952:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.541954:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.541961:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.541967:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.541994:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.542012:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267679616:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.542487:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.544654:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267679616:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.544669:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.544700:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272948736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2848us (4075us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.544708:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14290 00000100:00100000:0.0:1746065138.545023:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.545571:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272948992 00000100:00100000:3.0:1746065138.545576:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272948992 00002000:00100000:3.0:1746065138.545605:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130693b80 x1830881272948992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.545614:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130693b80 with x1830881272948992 ext(0->4095) 00002000:00010000:3.0:1746065138.545618:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130693b80 00000100:00100000:3.0:1746065138.545643:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13596 00000100:00100000:3.0:1746065138.545649:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272948992:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.546489:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272948992:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 838us (1465us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.546495:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13596 00002000:00100000:3.0:1746065138.546501:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130693b80 x1830881272948992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.546508:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130693b80 with x1830881272948992 ext(0->4095) 00002000:00010000:3.0:1746065138.546510:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130693b80 00000100:00100000:0.0:1746065138.548214:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.548417:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272949120 00000100:00100000:1.0:1746065138.548422:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272949120 00000100:00100000:1.0:1746065138.548735:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30319 00000100:00100000:1.0:1746065138.548743:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272949120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.548757:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.548771:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c23 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.548792:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.548798:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.548800:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.548802:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.548826:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.548836:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.548846:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267679744:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.549787:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.551778:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267679744:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.551801:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.551814:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065138.551842:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272949120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3101us (3631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.551853:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30319 00000100:00100000:0.0:1746065138.552711:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.552982:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272949248 00000100:00100000:3.0:1746065138.552988:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272949248 00010000:00010000:3.0:1746065138.553010:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.553028:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14291 00000100:00100000:3.0:1746065138.553033:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272949248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.553044:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.553058:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.553068:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.553104:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fcab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c1c expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.553125:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.553126:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.553132:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.553140:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.553163:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.553177:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267679872:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.553221:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.555738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.555961:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272949376 00000100:00100000:1.0:1746065138.555971:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272949376 00000100:00100000:1.0:1746065138.556015:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30320 00000100:00100000:1.0:1746065138.556021:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272949376:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.556034:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.556049:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c2a expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.556071:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.556077:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.556078:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.556100:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.556123:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.556132:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.556142:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267680000:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.556862:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.557162:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267679872:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.557173:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.557206:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272949248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4172us (4496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.557214:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14291 00000100:00100000:0.0:1746065138.557450:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.558174:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272949632 00000100:00100000:3.0:1746065138.558179:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272949632 00002000:00100000:3.0:1746065138.558201:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253f480 x1830881272949632/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.558209:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253f480 with x1830881272949632 ext(0->4095) 00010000:00010000:3.0:1746065138.558215:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.558225:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.558231:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253f480 00000100:00100000:3.0:1746065138.558475:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2845 00000100:00100000:3.0:1746065138.558481:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272949632:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.558729:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272949632:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 247us (1278us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.558738:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2845 00002000:00100000:3.0:1746065138.558743:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253f480 x1830881272949632/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.558750:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253f480 with x1830881272949632 ext(0->4095) 00010000:00010000:3.0:1746065138.558754:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.558763:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.558769:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253f480 00000100:00100000:0.0:1746065138.559012:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267680000:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065138.559027:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.559037:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:0.0:1746065138.559063:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881272949376:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3042us (3330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.559069:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30320 00000100:00100000:0.0:1746065138.561689:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.561894:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.561961:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272949760 00000100:00100000:2.0:1746065138.561967:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272949760 00000100:00100000:2.0:1746065138.562002:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30321 00000100:00100000:2.0:1746065138.562008:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881272949760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.562021:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.562032:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c31 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.562052:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.562056:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.562061:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.562065:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.562107:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.562117:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.562123:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065138.562150:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1795:x1830881272949760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 142us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.562154:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30321 00000100:00100000:3.0:1746065138.562300:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272949888 00000100:00100000:3.0:1746065138.562304:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272949888 00010000:00010000:3.0:1746065138.562320:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.562335:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14292 00000100:00100000:3.0:1746065138.562339:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272949888:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.562347:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.562361:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.562369:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.562383:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcb2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c23 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.562407:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.562409:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.562413:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.562419:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.562437:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.562446:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.562455:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267680256:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.562501:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.565255:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.565530:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267680256:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.565543:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.565584:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272949888:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3243us (3688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.565592:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14292 00000100:00100000:1.0:1746065138.565817:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272950144 00000100:00100000:1.0:1746065138.565821:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272950144 00002000:00100000:1.0:1746065138.565848:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130778e00 x1830881272950144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.565856:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130778e00 with x1830881272950144 ext(0->4095) 00010000:00010000:1.0:1746065138.565862:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.565871:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.565877:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130778e00 00000100:00100000:1.0:1746065138.565896:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2846 00000100:00100000:1.0:1746065138.565901:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272950144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.566004:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272950144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 103us (754us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.566009:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2846 00002000:00100000:1.0:1746065138.566013:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130778e00 x1830881272950144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.566020:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130778e00 with x1830881272950144 ext(0->4095) 00010000:00010000:1.0:1746065138.566024:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.566032:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.566036:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130778e00 00000100:00100000:0.0:1746065138.568758:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.568842:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272950272 00000100:00100000:3.0:1746065138.568849:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272950272 00010000:00010000:3.0:1746065138.568872:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.568906:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14293 00000100:00100000:3.0:1746065138.568912:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5947850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272950272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.568921:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.568935:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.568957:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.568972:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0ee00/0x392ae0376f87fcb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c2a expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.568996:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.568997:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.569003:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.569009:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.569032:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.569041:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267680384:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.569126:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.570779:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267680384:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065138.570780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065138.570790:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.570820:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272950528 00000100:00100000:2.0:1746065138.570827:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272950528 00002000:00100000:2.0:1746065138.570853:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077aa00 x1830881272950528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.570861:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077aa00 with x1830881272950528 ext(0->4095) 00000100:00100000:3.0:1746065138.570863:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5947850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272950272:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1951us (2169us total) trans 0 rc 0/0 00002000:00010000:2.0:1746065138.570864:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077aa00 00000100:00100000:3.0:1746065138.570869:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14293 00000100:00100000:2.0:1746065138.570886:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13597 00000100:00100000:2.0:1746065138.570891:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272950528:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.570982:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272950528:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 91us (203us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.570988:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13597 00002000:00100000:2.0:1746065138.570992:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077aa00 x1830881272950528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.570999:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077aa00 with x1830881272950528 ext(0->4095) 00002000:00010000:2.0:1746065138.571001:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077aa00 00000100:00100000:0.0:1746065138.571843:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.571948:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272950656 00000100:00100000:2.0:1746065138.571955:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272950656 00000100:00100000:2.0:1746065138.571983:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30322 00000100:00100000:2.0:1746065138.571988:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272950656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.571995:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.572005:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c38 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.572020:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.572029:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.572030:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.572033:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.572050:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.572059:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 81 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.572067:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267680512:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.572149:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.573380:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267680512:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.573395:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.573408:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065138.573444:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272950656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1455us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.573450:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30322 00000100:00100000:1.0:1746065138.573491:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.573568:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272950784 00000100:00100000:3.0:1746065138.573571:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272950784 00010000:00010000:3.0:1746065138.573585:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.573608:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14294 00000100:00100000:3.0:1746065138.573612:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881272950784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.573619:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.573631:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.573639:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.573653:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c31 expref: 82 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.573661:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.573663:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.573668:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.573674:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.573694:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.573702:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267680640:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.573756:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.575226:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.575463:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267680640:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.575473:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.575507:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881272950784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1894us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.575514:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14294 00000100:00100000:2.0:1746065138.575570:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272951040 00000100:00100000:2.0:1746065138.575574:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272951040 00002000:00100000:2.0:1746065138.575594:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f980000 x1830881272951040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.575608:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980000 with x1830881272951040 ext(0->4095) 00002000:00010000:2.0:1746065138.575612:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f980000 00000100:00100000:2.0:1746065138.575633:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13598 00000100:00100000:2.0:1746065138.575638:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272951040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.575726:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272951040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 88us (502us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.575731:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13598 00002000:00100000:2.0:1746065138.575735:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f980000 x1830881272951040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.575742:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980000 with x1830881272951040 ext(0->4095) 00002000:00010000:2.0:1746065138.575744:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f980000 00000100:00100000:0.0:1746065138.576803:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.576866:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272951168 00000100:00100000:2.0:1746065138.576871:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272951168 00000100:00100000:2.0:1746065138.576895:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30323 00000100:00100000:2.0:1746065138.576900:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1795:x1830881272951168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.576907:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.576919:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c3f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.576950:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.576957:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.576958:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.576961:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.576979:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.576989:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.576998:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267680768:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.577051:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.578118:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267680768:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.578134:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 82 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.578143:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065138.578172:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881272951168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1271us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.578177:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30323 00000100:00100000:0.0:1746065138.578243:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.578416:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272951296 00000100:00100000:3.0:1746065138.578420:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272951296 00010000:00010000:3.0:1746065138.578436:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.578453:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14295 00000100:00100000:3.0:1746065138.578458:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272951296:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.578466:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.578479:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.578487:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.578502:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fcc7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c38 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.578512:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.578514:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.578519:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.578525:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.578543:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.578552:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267680896:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.578812:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.580424:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.580490:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267680896:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.580502:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.580524:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272951296:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2065us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.580530:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14295 00000100:00100000:2.0:1746065138.580654:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272951552 00000100:00100000:2.0:1746065138.580658:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272951552 00002000:00100000:2.0:1746065138.580681:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f982a00 x1830881272951552/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.580689:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982a00 with x1830881272951552 ext(0->4095) 00002000:00010000:2.0:1746065138.580692:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f982a00 00000100:00100000:2.0:1746065138.580717:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13599 00000100:00100000:2.0:1746065138.580722:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272951552:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.580829:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272951552:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 107us (407us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.580835:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13599 00002000:00100000:2.0:1746065138.580840:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f982a00 x1830881272951552/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.580847:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982a00 with x1830881272951552 ext(0->4095) 00002000:00010000:2.0:1746065138.580849:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f982a00 00000100:00100000:0.0:1746065138.582570:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.582641:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272951680 00000100:00100000:2.0:1746065138.582645:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272951680 00000100:00100000:2.0:1746065138.582670:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30324 00000100:00100000:2.0:1746065138.582675:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272951680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.582684:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.582694:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c46 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.582711:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.582717:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.582718:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.582721:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.582739:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 81 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.582751:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 81 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.582760:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267681024:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.582817:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.584115:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267681024:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.584132:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.584142:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065138.584175:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272951680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1499us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.584180:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30324 00000100:00100000:0.0:1746065138.584488:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.584588:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272951808 00000100:00100000:3.0:1746065138.584593:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272951808 00002000:00100000:3.0:1746065138.584618:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f980380 x1830881272951808/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.584624:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980380 with x1830881272951808 ext(0->7) 00010000:00010000:3.0:1746065138.584643:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 82 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.584657:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 82 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.584663:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f980380 00000100:00100000:3.0:1746065138.584689:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2847 00000100:00100000:3.0:1746065138.584695:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881272951808:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065138.585587:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2005:x1830881272951808:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 891us (1097us total) trans 4294972104 rc 0/0 00000100:00100000:0.0:1746065138.585593:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2847 00002000:00100000:0.0:1746065138.585598:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f980380 x1830881272951808/t4294972104(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.585604:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980380 with x1830881272951808 ext(0->7) 00010000:00010000:0.0:1746065138.585609:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.585617:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.585622:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f980380 00000100:00100000:0.0:1746065138.587715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.587769:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272951936 00000100:00100000:3.0:1746065138.587775:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272951936 00010000:00010000:3.0:1746065138.587796:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.587827:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14296 00000100:00100000:3.0:1746065138.587833:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2004:x1830881272951936:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.587843:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.587854:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.587863:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.587879:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fcce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c3f expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.587903:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.587905:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.587912:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.587922:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.587960:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.587970:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267681152:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.588237:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.589251:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267681152:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.589265:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.589292:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881272951936:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1458us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.589298:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14296 00000100:00100000:0.0:1746065138.589525:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.589582:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272952192 00000100:00100000:2.0:1746065138.589586:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272952192 00002000:00100000:2.0:1746065138.589609:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75c00 x1830881272952192/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.589617:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75c00 with x1830881272952192 ext(0->4095) 00002000:00010000:2.0:1746065138.589620:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea75c00 00000100:00100000:2.0:1746065138.589637:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13600 00000100:00100000:2.0:1746065138.590609:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272952192:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.590698:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272952192:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1055us (1174us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.590707:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13600 00002000:00100000:2.0:1746065138.590712:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75c00 x1830881272952192/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.590718:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75c00 with x1830881272952192 ext(0->4095) 00002000:00010000:2.0:1746065138.590721:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea75c00 00000100:00100000:0.0:1746065138.593221:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.593302:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272952320 00000100:00100000:2.0:1746065138.593308:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272952320 00000100:00100000:2.0:1746065138.593342:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30325 00000100:00100000:2.0:1746065138.593348:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1795:x1830881272952320:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.593360:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.593373:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c4d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.593397:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.593404:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.593405:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.593408:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.593432:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.593442:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.593458:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267681280:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.593532:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.594694:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267681280:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.594709:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.594719:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065138.594753:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1795:x1830881272952320:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1405us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.594761:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30325 00000100:00100000:0.0:1746065138.594841:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.594903:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272952576 00000100:00100000:2.0:1746065138.594906:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272952576 00000100:00100000:0.0:1746065138.594915:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.594929:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30326 00000100:00100000:2.0:1746065138.594934:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1791:x1830881272952576:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.594951:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.594957:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c54 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.594968:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.594972:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.594976:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.594979:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.595014:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272952448 00000100:00100000:3.0:1746065138.595018:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272952448 00010000:00010000:3.0:1746065138.595036:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.595054:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14297 00000100:00100000:3.0:1746065138.595059:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272952448:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.595059:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.595067:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.595068:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.595075:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00010000:00010000:3.0:1746065138.595097:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.595108:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:1791:x1830881272952576:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 173us (267us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065138.595111:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.595113:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30326 00010000:00010000:3.0:1746065138.595126:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcd5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c46 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.595182:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.595184:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.595190:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.595196:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.595217:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.595225:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.595232:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267681536:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.595357:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.596875:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267681536:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.596886:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.596921:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881272952448:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1861us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.596930:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14297 00000100:00100000:0.0:1746065138.597047:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.597105:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272952832 00000100:00100000:2.0:1746065138.597110:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272952832 00002000:00100000:2.0:1746065138.597204:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff6d80 x1830881272952832/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.597213:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6d80 with x1830881272952832 ext(0->4095) 00010000:00010000:2.0:1746065138.597218:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 85 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.597242:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 85 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.597248:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff6d80 00000100:00100000:2.0:1746065138.597272:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2848 00000100:00100000:2.0:1746065138.597277:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:2003:x1830881272952832:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746065138.597380:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:2003:x1830881272952832:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 102us (332us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.597386:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2848 00002000:00100000:2.0:1746065138.597391:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff6d80 x1830881272952832/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.597397:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6d80 with x1830881272952832 ext(0->4095) 00010000:00010000:2.0:1746065138.597401:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 85 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.597410:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 85 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.597415:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff6d80 00000100:00100000:0.0:1746065138.598671:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.598704:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.598711:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272952960 00000100:00100000:2.0:1746065138.598715:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272952960 00000100:00100000:2.0:1746065138.598736:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30327 00000100:00100000:2.0:1746065138.598742:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272952960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:3.0:1746065138.598744:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272953088 00000100:00100000:3.0:1746065138.598748:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272953088 00010000:00010000:2.0:1746065138.598751:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.598762:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 85 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.598762:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c5b expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.598778:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746065138.598779:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14298 00010000:00010000:2.0:1746065138.598782:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.598785:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:2005:x1830881272953088:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.598787:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065138.598790:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.598791:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.598803:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 85 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.598811:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 85 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.598823:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.598827:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f87fcdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c4d expref: 85 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.598833:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.598840:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.598841:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.598845:0:9560:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.598851:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.598859:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065138.598864:0:9560:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 84 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.598872:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.598884:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267681792:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.598893:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2005:x1830881272953088:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 108us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.598950:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.599035:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14298 00000100:00100000:0.0:1746065138.600479:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.600526:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267681792:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.600537:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:3.0:1746065138.600557:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272953344 00000100:00100000:3.0:1746065138.600561:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272953344 00000100:00100000:2.0:1746065138.600562:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272952960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1820us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.600571:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30327 00002000:00100000:3.0:1746065138.600585:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b800 x1830881272953344/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.600599:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b800 with x1830881272953344 ext(0->4095) 00010000:00010000:3.0:1746065138.600604:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.600619:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.600624:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017b800 00000100:00100000:3.0:1746065138.600643:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2849 00000100:00100000:3.0:1746065138.600649:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2004:x1830881272953344:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.600739:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2004:x1830881272953344:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (262us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.600744:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2849 00002000:00100000:3.0:1746065138.600749:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b800 x1830881272953344/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.600755:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b800 with x1830881272953344 ext(0->4095) 00010000:00010000:3.0:1746065138.600759:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.600767:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 84 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.600772:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017b800 00000100:00100000:0.0:1746065138.603306:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.603353:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.603358:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272953472 00000100:00100000:2.0:1746065138.603365:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272953472 00000100:00100000:1.0:1746065138.603429:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30328 00000100:00100000:1.0:1746065138.603439:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1791:x1830881272953472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:3.0:1746065138.603445:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272953600 00000100:00100000:3.0:1746065138.603449:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272953600 00010000:00010000:1.0:1746065138.603450:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.603464:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c62 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.603465:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 85 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.603481:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14299 00010000:00010000:1.0:1746065138.603483:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746065138.603485:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2005:x1830881272953600:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.603488:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.603491:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.603494:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065138.603497:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.603505:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 86 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.603513:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 86 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.603525:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.603526:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fce3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c54 expref: 86 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.603534:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.603539:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.603540:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.603544:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.603610:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.603620:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00010000:00010000:3.0:1746065138.603627:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.603636:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.603644:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267682048:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065138.603664:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:1791:x1830881272953472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 226us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.603669:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30328 00000100:00100000:3.0:1746065138.603692:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.605015:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267682048:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.605026:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.605062:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2005:x1830881272953600:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1575us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.605069:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14299 00000100:00100000:0.0:1746065138.605833:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.605901:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272953856 00000100:00100000:3.0:1746065138.605906:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272953856 00002000:00100000:3.0:1746065138.605930:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0000 x1830881272953856/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.605953:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0000 with x1830881272953856 ext(0->4095) 00010000:00010000:3.0:1746065138.605959:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.605969:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.605974:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0000 00000100:00100000:3.0:1746065138.605998:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2850 00000100:00100000:3.0:1746065138.606004:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272953856:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.606099:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272953856:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 95us (267us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.606108:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2850 00002000:00100000:3.0:1746065138.606112:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0000 x1830881272953856/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.606118:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0000 with x1830881272953856 ext(0->4095) 00010000:00010000:3.0:1746065138.606122:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.606130:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.606134:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0000 00000100:00100000:0.0:1746065138.607635:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.607686:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272953984 00000100:00100000:3.0:1746065138.607690:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272953984 00010000:00010000:3.0:1746065138.607702:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.607723:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14300 00000100:00100000:3.0:1746065138.607726:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5947450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272953984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.607735:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.607743:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.607749:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.607762:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fcea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c5b expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.607780:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.607781:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.607785:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.607790:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.607807:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.607814:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267682176:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.607849:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.609427:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267682176:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.609440:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.609476:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5947450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272953984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1748us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.609484:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14300 00000100:00100000:0.0:1746065138.609558:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.609647:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272954240 00000100:00100000:3.0:1746065138.609652:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272954240 00002000:00100000:3.0:1746065138.609672:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c3100 x1830881272954240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.609680:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3100 with x1830881272954240 ext(0->4095) 00002000:00010000:3.0:1746065138.609684:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c3100 00000100:00100000:3.0:1746065138.609709:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13601 00000100:00100000:3.0:1746065138.609715:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2005:x1830881272954240:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.609798:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2005:x1830881272954240:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 82us (240us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.609803:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13601 00002000:00100000:3.0:1746065138.609808:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c3100 x1830881272954240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.609815:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3100 with x1830881272954240 ext(0->4095) 00002000:00010000:3.0:1746065138.609818:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c3100 00000100:00100000:0.0:1746065138.611296:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.611469:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272954368 00000100:00100000:1.0:1746065138.611474:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272954368 00000100:00100000:1.0:1746065138.611508:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30329 00000100:00100000:1.0:1746065138.611514:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272954368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.611523:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.611534:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c69 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.611555:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.611561:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.611563:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.611565:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.611585:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.611594:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.611603:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267682304:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.612018:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.612878:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267682304:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.612893:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.612902:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065138.612923:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272954368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1409us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.612929:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30329 00000100:00100000:0.0:1746065138.613346:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.613412:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272954496 00000100:00100000:3.0:1746065138.613417:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272954496 00010000:00010000:3.0:1746065138.613434:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 84 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.613449:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14301 00000100:00100000:3.0:1746065138.613453:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2005:x1830881272954496:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.613461:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.613474:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 84 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.613483:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 84 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.613498:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fcf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c62 expref: 84 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.613521:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.613523:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.613529:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.613535:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.613555:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.613563:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267682432:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.613610:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.615027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.615101:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272954752 00000100:00100000:1.0:1746065138.615105:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272954752 00000100:00100000:3.0:1746065138.615117:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267682432:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.615127:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065138.615132:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091a680 x1830881272954752/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.615140:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091a680 with x1830881272954752 ext(0->4095) 00002000:00010000:1.0:1746065138.615144:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091a680 00000100:00100000:3.0:1746065138.615150:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881272954496:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1696us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.615157:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14301 00000100:00100000:1.0:1746065138.615312:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13602 00000100:00100000:1.0:1746065138.615319:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272954752:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.615409:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272954752:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (384us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.615414:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13602 00002000:00100000:1.0:1746065138.615419:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091a680 x1830881272954752/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.615426:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091a680 with x1830881272954752 ext(0->4095) 00002000:00010000:1.0:1746065138.615428:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091a680 00000100:00100000:0.0:1746065138.616719:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.616783:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272954880 00000100:00100000:1.0:1746065138.616787:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272954880 00000100:00100000:1.0:1746065138.616812:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30330 00000100:00100000:1.0:1746065138.616817:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1795:x1830881272954880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.616825:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.616835:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c70 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.616857:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.616863:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.616865:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.616867:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.616885:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.616894:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.616902:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267682560:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.617319:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.617861:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267682560:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.617876:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.617887:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065138.617908:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1795:x1830881272954880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1091us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.617914:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30330 00000100:00100000:0.0:1746065138.618589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.618649:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272955008 00000100:00100000:3.0:1746065138.618653:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272955008 00010000:00010000:3.0:1746065138.618672:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.618690:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14302 00000100:00100000:3.0:1746065138.618696:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272955008:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.618704:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.618719:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.618733:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.618749:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fcf8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c69 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.618773:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.618775:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.618780:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.618787:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.618808:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.618817:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267682688:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.618867:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.620032:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267682688:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.620042:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.620617:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272955008:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1919us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.620624:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14302 00000100:00100000:0.0:1746065138.620970:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.621060:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272955264 00000100:00100000:3.0:1746065138.621064:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272955264 00002000:00100000:3.0:1746065138.621103:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9500 x1830881272955264/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.621112:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9500 with x1830881272955264 ext(0->4095) 00002000:00010000:3.0:1746065138.621116:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4e9500 00000100:00100000:1.0:1746065138.621169:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13603 00000100:00100000:1.0:1746065138.621177:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2004:x1830881272955264:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.621308:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2004:x1830881272955264:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 131us (347us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.621314:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13603 00002000:00100000:1.0:1746065138.621319:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9500 x1830881272955264/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.621324:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9500 with x1830881272955264 ext(0->4095) 00002000:00010000:1.0:1746065138.621326:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4e9500 00000100:00100000:0.0:1746065138.631788:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.631861:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272955392 00000100:00100000:2.0:1746065138.631868:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272955392 00000100:00100000:2.0:1746065138.631916:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30331 00000100:00100000:2.0:1746065138.631923:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272955392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.631948:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.631962:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c77 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.631989:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.631996:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.631998:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.632001:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.632025:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.632036:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 83 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.632046:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267682816:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.632674:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.634533:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267682816:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.634558:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.634571:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065138.634925:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272955392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3001us (3143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.634932:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30331 00000100:00100000:0.0:1746065138.635874:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.635924:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.635951:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272955520 00000100:00100000:1.0:1746065138.635956:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272955520 00002000:00100000:1.0:1746065138.635986:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4e9c00 x1830881272955520/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.635994:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9c00 with x1830881272955520 ext(0->7) 00010000:00010000:1.0:1746065138.636001:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 84 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.636012:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 84 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.636017:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9c00 00000100:00100000:1.0:1746065138.636048:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2851 00000100:00100000:1.0:1746065138.636053:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:2004:x1830881272955520:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746065138.636263:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272955648 00000100:00100000:2.0:1746065138.636267:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272955648 00000100:00100000:2.0:1746065138.636290:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30332 00000100:00100000:2.0:1746065138.636295:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:1791:x1830881272955648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.636302:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.636312:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c7e expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.636337:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.636341:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.636347:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065138.636350:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.636373:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.636383:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.636390:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065138.636417:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:1791:x1830881272955648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 122us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.636422:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30332 00000100:00100000:0.0:1746065138.637610:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272955520:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1552us (1733us total) trans 4294972105 rc 0/0 00000100:00100000:0.0:1746065138.637618:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2851 00002000:00100000:0.0:1746065138.637624:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4e9c00 x1830881272955520/t4294972105(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.637631:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9c00 with x1830881272955520 ext(0->7) 00010000:00010000:0.0:1746065138.637636:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.637647:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.637652:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9c00 00000100:00100000:0.0:1746065138.639569:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.639683:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272955776 00000100:00100000:3.0:1746065138.639690:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272955776 00010000:00010000:3.0:1746065138.639716:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.639749:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14303 00000100:00100000:3.0:1746065138.639756:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272955776:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.639767:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.639781:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.639790:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.639809:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fcff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c70 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.639835:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.639836:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.639842:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.639849:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.639874:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.639883:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.639955:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267683072:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.640183:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.641500:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267683072:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.641515:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.641542:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272955776:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1786us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.641550:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14303 00000100:00100000:0.0:1746065138.642021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.642248:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272956032 00000100:00100000:2.0:1746065138.642255:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272956032 00002000:00100000:2.0:1746065138.642282:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3800 x1830881272956032/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.642291:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3800 with x1830881272956032 ext(0->4095) 00010000:00010000:2.0:1746065138.642297:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.642309:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.642314:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3800 00000100:00100000:2.0:1746065138.642328:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2852 00000100:00100000:2.0:1746065138.642333:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272956032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.642431:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272956032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (410us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.642436:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2852 00002000:00100000:2.0:1746065138.642441:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3800 x1830881272956032/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.642452:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3800 with x1830881272956032 ext(0->4095) 00010000:00010000:2.0:1746065138.642457:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.642464:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.642469:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3800 00000100:00100000:0.0:1746065138.644333:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.644904:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272956160 00000100:00100000:3.0:1746065138.644910:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272956160 00010000:00010000:3.0:1746065138.644954:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.644988:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14304 00000100:00100000:3.0:1746065138.644995:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272956160:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.645006:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.645021:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.645032:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.645051:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd06 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c77 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.645063:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.645064:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.645071:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.645113:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.645141:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.645152:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267683200:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.645225:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.646873:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267683200:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.646888:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.647188:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272956160:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2192us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.647196:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14304 00000100:00100000:0.0:1746065138.647589:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.647667:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272956416 00000100:00100000:2.0:1746065138.647672:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272956416 00002000:00100000:2.0:1746065138.647700:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f2680 x1830881272956416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.647709:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2680 with x1830881272956416 ext(0->4095) 00002000:00010000:2.0:1746065138.647713:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f2680 00000100:00100000:2.0:1746065138.647727:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13604 00000100:00100000:2.0:1746065138.647732:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272956416:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.647985:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272956416:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 251us (396us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.647991:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13604 00002000:00100000:2.0:1746065138.647996:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f2680 x1830881272956416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.648003:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2680 with x1830881272956416 ext(0->4095) 00002000:00010000:2.0:1746065138.648005:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f2680 00000100:00100000:0.0:1746065138.649227:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.649278:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272956544 00000100:00100000:2.0:1746065138.649283:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272956544 00000100:00100000:2.0:1746065138.649319:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30333 00000100:00100000:2.0:1746065138.649325:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272956544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.649334:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.649346:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c85 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.649367:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.649373:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.649375:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.649378:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.649400:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.649410:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 85 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.649419:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267683328:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.649546:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.650864:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267683328:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.650882:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.650895:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065138.650922:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272956544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1597us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.650928:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30333 00000100:00100000:0.0:1746065138.651120:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.651190:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272956672 00000100:00100000:3.0:1746065138.651197:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272956672 00010000:00010000:3.0:1746065138.651217:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.651244:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14305 00000100:00100000:3.0:1746065138.651249:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272956672:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.651258:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.651272:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.651281:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.651351:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c7e expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.651369:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.651371:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.651376:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.651382:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.651402:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.651411:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267683456:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.651445:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.652712:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267683456:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.652724:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.652754:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:2004:x1830881272956672:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1505us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.652761:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14305 00000100:00100000:0.0:1746065138.653408:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.653506:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272956928 00000100:00100000:2.0:1746065138.653511:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272956928 00002000:00100000:2.0:1746065138.653539:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18ce00 x1830881272956928/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.653548:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18ce00 with x1830881272956928 ext(0->4095) 00002000:00010000:2.0:1746065138.653552:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f18ce00 00000100:00100000:2.0:1746065138.653577:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13605 00000100:00100000:2.0:1746065138.653583:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272956928:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.653683:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272956928:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 100us (275us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.653689:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13605 00002000:00100000:2.0:1746065138.653694:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18ce00 x1830881272956928/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.653701:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18ce00 with x1830881272956928 ext(0->4095) 00002000:00010000:2.0:1746065138.653703:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f18ce00 00000100:00100000:0.0:1746065138.656188:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.656316:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272957056 00000100:00100000:2.0:1746065138.656323:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272957056 00000100:00100000:2.0:1746065138.656369:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30334 00000100:00100000:2.0:1746065138.656376:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:1795:x1830881272957056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.656391:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.656404:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c8c expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.656431:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.656438:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.656440:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.656443:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.656467:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.656478:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.656488:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267683584:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.656551:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.657749:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.657877:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267683584:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.657894:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.657907:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065138.657930:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:1795:x1830881272957056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1555us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.657949:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30334 00000100:00100000:2.0:1746065138.657966:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272957184 00000100:00100000:2.0:1746065138.657970:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272957184 00000100:00100000:2.0:1746065138.657987:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30335 00000100:00100000:2.0:1746065138.657991:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:1791:x1830881272957184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.657999:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.658006:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c93 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.658018:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.658021:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.658026:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.658029:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.658045:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.658052:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.658058:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:2.0:1746065138.658073:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1791:x1830881272957184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 81us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.658077:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30335 00000100:00100000:0.0:1746065138.658641:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.658674:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272957312 00000100:00100000:3.0:1746065138.658678:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272957312 00010000:00010000:3.0:1746065138.658694:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.658721:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14306 00000100:00100000:3.0:1746065138.658729:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272957312:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.658735:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.658748:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.658756:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.658766:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c85 expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.658782:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.658783:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.658787:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.658791:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.658804:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.658810:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.658816:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267683840:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.658859:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.659926:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267683840:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.659952:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.660260:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272957312:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1532us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.660267:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14306 00000100:00100000:0.0:1746065138.660307:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.660343:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272957568 00000100:00100000:2.0:1746065138.660348:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272957568 00002000:00100000:2.0:1746065138.660372:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548e00 x1830881272957568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.660386:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548e00 with x1830881272957568 ext(0->4095) 00010000:00010000:2.0:1746065138.660390:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.660400:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.660405:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548e00 00000100:00100000:2.0:1746065138.660433:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2853 00000100:00100000:2.0:1746065138.660439:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272957568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.660717:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272957568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 277us (409us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.660723:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2853 00002000:00100000:2.0:1746065138.660728:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548e00 x1830881272957568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.660735:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548e00 with x1830881272957568 ext(0->4095) 00010000:00010000:2.0:1746065138.660739:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.660747:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.660752:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548e00 00000100:00100000:0.0:1746065138.661626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.661712:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272957696 00000100:00100000:2.0:1746065138.661716:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272957696 00000100:00100000:2.0:1746065138.661791:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30336 00000100:00100000:2.0:1746065138.661797:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272957696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.661806:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.661815:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5c9a expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.661831:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.661839:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.661844:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065138.661847:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.661868:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.661877:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.661888:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065138.661922:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272957696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 124us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.661926:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30336 00000100:00100000:1.0:1746065138.662047:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.662177:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272957824 00000100:00100000:3.0:1746065138.662180:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272957824 00010000:00010000:3.0:1746065138.662193:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.662257:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14307 00000100:00100000:3.0:1746065138.662263:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5947050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272957824:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.662270:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.662282:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.662291:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.662310:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c8c expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.662355:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.662357:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.662363:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.662370:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.662386:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 86 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.662395:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.662404:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267684096:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.662448:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.663469:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267684096:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.663479:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.663557:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5947050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2005:x1830881272957824:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1292us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.663564:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14307 00000100:00100000:0.0:1746065138.663867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.663914:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272958080 00000100:00100000:2.0:1746065138.663918:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272958080 00002000:00100000:2.0:1746065138.663948:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548700 x1830881272958080/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.663961:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548700 with x1830881272958080 ext(0->4095) 00010000:00010000:2.0:1746065138.663966:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.663976:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.663981:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548700 00000100:00100000:2.0:1746065138.664006:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2854 00000100:00100000:2.0:1746065138.664011:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2005:x1830881272958080:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.664104:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2005:x1830881272958080:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 92us (237us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.664108:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2854 00002000:00100000:2.0:1746065138.664113:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548700 x1830881272958080/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.664120:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548700 with x1830881272958080 ext(0->4095) 00010000:00010000:2.0:1746065138.664124:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.664133:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.664138:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548700 00000100:00100000:0.0:1746065138.665061:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.665122:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272958208 00000100:00100000:2.0:1746065138.665127:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272958208 00000100:00100000:0.0:1746065138.665144:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.665147:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30337 00000100:00100000:2.0:1746065138.665152:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:1791:x1830881272958208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.665161:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.665170:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ca1 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.665185:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.665190:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.665194:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065138.665197:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.665217:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.665225:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.665232:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065138.665252:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1791:x1830881272958208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.665256:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30337 00000100:00100000:0.0:1746065138.665410:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272958336 00000100:00100000:0.0:1746065138.665414:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272958336 00010000:00010000:0.0:1746065138.665429:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065138.665458:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14308 00000100:00100000:0.0:1746065138.665463:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272958336:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065138.665470:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065138.665481:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.665489:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.665501:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c93 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.665522:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.665524:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.665528:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.665535:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.665556:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.665565:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 5 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065138.665573:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c91500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267684352:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065138.665621:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.666823:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c91500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267684352:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.666835:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.666862:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272958336:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1398us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.666879:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14308 00000100:00100000:0.0:1746065138.667046:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.667108:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272958592 00000100:00100000:2.0:1746065138.667113:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272958592 00002000:00100000:2.0:1746065138.667136:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90700 x1830881272958592/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.667144:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90700 with x1830881272958592 ext(0->4095) 00010000:00010000:2.0:1746065138.667149:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.667158:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.667163:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c90700 00000100:00100000:2.0:1746065138.667183:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2855 00000100:00100000:2.0:1746065138.667189:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272958592:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.667279:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272958592:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 89us (232us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.667283:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2855 00002000:00100000:2.0:1746065138.667288:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90700 x1830881272958592/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.667294:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90700 with x1830881272958592 ext(0->4095) 00010000:00010000:2.0:1746065138.667299:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.667311:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.667317:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c90700 00000100:00100000:0.0:1746065138.669354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.669541:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272958720 00000100:00100000:2.0:1746065138.669549:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272958720 00010000:00010000:2.0:1746065138.669576:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.669601:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14309 00000100:00100000:2.0:1746065138.669608:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272958720:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.669618:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.669633:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.669643:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.669661:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fd29 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5c9a expref: 6 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.669691:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.669693:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.669700:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.669711:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.669735:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.669745:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267684480:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.669811:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.671599:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.671677:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272958976 00000100:00100000:2.0:1746065138.671679:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267684480:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.671683:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272958976 00010000:00010000:2.0:1746065138.671692:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065138.671712:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90000 x1830881272958976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746065138.671716:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272958720:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2110us (2370us total) trans 0 rc 0/0 00002000:00100000:3.0:1746065138.671720:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90000 with x1830881272958976 ext(0->4095) 00002000:00010000:3.0:1746065138.671724:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90000 00000100:00100000:2.0:1746065138.671724:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14309 00000100:00100000:3.0:1746065138.671779:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13606 00000100:00100000:3.0:1746065138.671786:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272958976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.671932:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272958976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 146us (337us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.671950:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13606 00002000:00100000:3.0:1746065138.671955:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90000 x1830881272958976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.671962:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90000 with x1830881272958976 ext(0->4095) 00002000:00010000:3.0:1746065138.671965:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90000 00000100:00100000:0.0:1746065138.673132:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.673176:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272959104 00000100:00100000:2.0:1746065138.673181:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272959104 00000100:00100000:2.0:1746065138.673209:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30338 00000100:00100000:2.0:1746065138.673215:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272959104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.673225:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.673238:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ca8 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.673256:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.673262:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.673264:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.673267:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.673287:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 85 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.673297:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 85 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.673306:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267684608:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.673402:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.674653:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267684608:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.674670:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.674680:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065138.674715:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272959104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1500us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.674722:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30338 00000100:00100000:0.0:1746065138.675262:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.675310:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272959232 00000100:00100000:3.0:1746065138.675316:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272959232 00010000:00010000:3.0:1746065138.675337:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.675365:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14310 00000100:00100000:3.0:1746065138.675372:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272959232:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.675382:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.675394:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.675408:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.675425:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca1 expref: 86 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.675450:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.675452:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.675458:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.675498:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.675522:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.675532:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267684736:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.675586:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.676443:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267684736:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.676454:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.676483:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:2004:x1830881272959232:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1111us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.676490:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14310 00000100:00100000:0.0:1746065138.677108:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.677164:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272959488 00000100:00100000:3.0:1746065138.677167:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272959488 00002000:00100000:3.0:1746065138.677188:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084700 x1830881272959488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.677194:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084700 with x1830881272959488 ext(0->4095) 00002000:00010000:3.0:1746065138.677197:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f084700 00000100:00100000:3.0:1746065138.677206:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13607 00000100:00100000:3.0:1746065138.677210:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272959488:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.677272:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272959488:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 62us (191us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.677276:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13607 00002000:00100000:3.0:1746065138.677279:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084700 x1830881272959488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.677283:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084700 with x1830881272959488 ext(0->4095) 00002000:00010000:3.0:1746065138.677285:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f084700 00000100:00100000:0.0:1746065138.678155:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.678213:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272959616 00000100:00100000:2.0:1746065138.678218:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272959616 00000100:00100000:2.0:1746065138.678240:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30339 00000100:00100000:2.0:1746065138.678245:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+85:1795:x1830881272959616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.678254:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.678265:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5caf expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.678297:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.678304:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.678305:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.678308:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 86 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.678330:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.678340:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.678348:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267684864:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.678415:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.679677:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267684864:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.679695:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 86 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.679705:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:2.0:1746065138.679739:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:1795:x1830881272959616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1493us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.679745:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30339 00000100:00100000:0.0:1746065138.680139:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.680183:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272959744 00000100:00100000:3.0:1746065138.680187:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272959744 00010000:00010000:3.0:1746065138.680205:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.680225:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14311 00000100:00100000:3.0:1746065138.680231:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272959744:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.680239:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.680252:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.680261:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.680278:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87fd37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ca8 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.680288:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.680289:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.680294:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.680301:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.680322:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.680330:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267684992:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.680391:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.681597:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267684992:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.681610:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.681643:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272959744:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1411us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.681650:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14311 00000100:00100000:0.0:1746065138.682587:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.682672:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272960000 00000100:00100000:1.0:1746065138.682678:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272960000 00002000:00100000:1.0:1746065138.682709:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cb100 x1830881272960000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.682717:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb100 with x1830881272960000 ext(0->4095) 00002000:00010000:1.0:1746065138.682721:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cb100 00000100:00100000:1.0:1746065138.682824:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13608 00000100:00100000:1.0:1746065138.682831:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2005:x1830881272960000:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.682973:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2005:x1830881272960000:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 142us (386us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.682979:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13608 00002000:00100000:1.0:1746065138.682984:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cb100 x1830881272960000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.682990:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb100 with x1830881272960000 ext(0->4095) 00002000:00010000:1.0:1746065138.682993:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cb100 00000100:00100000:0.0:1746065138.684711:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.684757:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272960128 00000100:00100000:2.0:1746065138.684763:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272960128 00000100:00100000:2.0:1746065138.684798:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30340 00000100:00100000:2.0:1746065138.684803:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272960128:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.684814:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.684825:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5cb6 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.684844:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.684849:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.684850:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.684852:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.684871:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 85 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.684878:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 85 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.684885:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267685120:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.685140:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.686459:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267685120:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.686479:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.686490:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065138.686516:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272960128:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1713us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.686522:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30340 00000100:00100000:0.0:1746065138.688408:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.688495:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272960256 00000100:00100000:1.0:1746065138.688503:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272960256 00002000:00100000:1.0:1746065138.688536:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012f72b480 x1830881272960256/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.688546:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72b480 with x1830881272960256 ext(0->7) 00010000:00010000:1.0:1746065138.688553:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 86 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.688564:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 86 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.688571:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72b480 00000100:00100000:1.0:1746065138.688597:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2856 00000100:00100000:1.0:1746065138.688603:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+86:2004:x1830881272960256:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746065138.689411:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272960256:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 807us (1008us total) trans 4294972106 rc 0/0 00000100:00100000:1.0:1746065138.689417:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2856 00002000:00100000:1.0:1746065138.689423:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012f72b480 x1830881272960256/t4294972106(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.689429:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72b480 with x1830881272960256 ext(0->7) 00010000:00010000:1.0:1746065138.689433:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.689441:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.689446:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72b480 00000100:00100000:0.0:1746065138.693574:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.694108:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272960384 00000100:00100000:3.0:1746065138.694115:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272960384 00010000:00010000:3.0:1746065138.694233:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.694274:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14312 00000100:00100000:3.0:1746065138.694281:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272960384:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.694293:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.694309:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.694320:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.694338:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fd3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5caf expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.694364:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.694366:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.694374:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.694380:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.694406:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.694415:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267685248:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.694477:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.696704:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.696759:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272960640 00000100:00100000:1.0:1746065138.696766:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272960640 00000100:00100000:3.0:1746065138.696791:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267685248:192.168.202.8@tcp:105: 00002000:00100000:1.0:1746065138.696798:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d651f80 x1830881272960640/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1746065138.696805:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065138.696805:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651f80 with x1830881272960640 ext(0->4095) 00002000:00010000:1.0:1746065138.696809:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d651f80 00000100:00100000:3.0:1746065138.696834:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272960384:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2554us (3266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.696842:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14312 00000100:00100000:1.0:1746065138.696983:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13609 00000100:00100000:1.0:1746065138.696990:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272960640:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065138.697799:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272960640:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 808us (1099us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.697807:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13609 00002000:00100000:1.0:1746065138.697812:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d651f80 x1830881272960640/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.697818:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651f80 with x1830881272960640 ext(0->4095) 00002000:00010000:1.0:1746065138.697820:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d651f80 00000100:00100000:0.0:1746065138.698231:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.698266:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272960768 00000100:00100000:2.0:1746065138.698271:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272960768 00000100:00100000:2.0:1746065138.698294:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30341 00000100:00100000:2.0:1746065138.698300:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1791:x1830881272960768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.698309:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.698321:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5cbd expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.698341:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.698347:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.698348:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.698351:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.698372:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.698381:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 5 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.698391:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267685376:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.698497:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.699355:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.699373:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267685376:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.699388:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.699402:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:1.0:1746065138.699416:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272960896 00000100:00100000:1.0:1746065138.699420:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272960896 00000100:00100000:2.0:1746065138.699423:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1791:x1830881272960768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1124us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.699428:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30341 00000100:00100000:2.0:1746065138.699440:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30342 00000100:00100000:2.0:1746065138.699445:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:1795:x1830881272960896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.699451:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.699457:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5cc4 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.699468:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.699471:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 89 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.699476:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.699478:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 89 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.699493:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 89 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.699501:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 89 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.699513:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065138.699527:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1795:x1830881272960896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 82us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.699532:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30342 00000100:00100000:0.0:1746065138.699765:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.699799:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272961024 00000100:00100000:3.0:1746065138.699802:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272961024 00010000:00010000:3.0:1746065138.699817:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.699832:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14313 00000100:00100000:3.0:1746065138.699836:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272961024:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.699843:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.699854:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.699863:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.699876:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fd45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cb6 expref: 6 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.699883:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.699885:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.699889:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.699895:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.699912:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.699925:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.699934:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267685632:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.700005:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.701756:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.701849:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267685632:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.701863:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.701901:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272961024:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2064us (2136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.701909:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14313 00000100:00100000:1.0:1746065138.701994:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272961280 00000100:00100000:1.0:1746065138.701999:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272961280 00002000:00100000:1.0:1746065138.702024:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1880 x1830881272961280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.702032:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1880 with x1830881272961280 ext(0->4095) 00010000:00010000:1.0:1746065138.702038:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.702048:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.702053:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1880 00000100:00100000:1.0:1746065138.702078:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2857 00000100:00100000:1.0:1746065138.702105:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272961280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.702525:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272961280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 419us (770us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.702531:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2857 00002000:00100000:1.0:1746065138.702537:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1880 x1830881272961280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.702545:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1880 with x1830881272961280 ext(0->4095) 00010000:00010000:1.0:1746065138.702549:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.702558:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.702563:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1880 00000100:00100000:0.0:1746065138.704807:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.704884:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272961408 00000100:00100000:3.0:1746065138.704890:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272961408 00010000:00010000:3.0:1746065138.704913:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.704934:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14314 00000100:00100000:3.0:1746065138.704954:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5946c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272961408:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.704965:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.704979:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.704989:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.705006:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cbd expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.705031:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.705033:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.705039:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.705045:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.705068:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.705077:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267685760:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.705314:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.706453:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267685760:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.706465:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.706502:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5946c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272961408:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1547us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.707058:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14314 00000100:00100000:0.0:1746065138.707801:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.707911:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272961664 00000100:00100000:1.0:1746065138.707918:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272961664 00002000:00100000:1.0:1746065138.708213:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a0e00 x1830881272961664/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.708222:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0e00 with x1830881272961664 ext(0->4095) 00002000:00010000:1.0:1746065138.708226:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a0e00 00000100:00100000:1.0:1746065138.708243:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13610 00000100:00100000:1.0:1746065138.708249:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2003:x1830881272961664:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065138.708438:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2003:x1830881272961664:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 189us (638us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.708444:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13610 00002000:00100000:1.0:1746065138.708449:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a0e00 x1830881272961664/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.708457:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0e00 with x1830881272961664 ext(0->4095) 00002000:00010000:1.0:1746065138.708460:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a0e00 00000100:00100000:0.0:1746065138.709989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.710040:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272961792 00000100:00100000:3.0:1746065138.710046:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272961792 00000100:00100000:3.0:1746065138.710107:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30343 00000100:00100000:3.0:1746065138.710115:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272961792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.710126:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.710139:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ccb expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.710158:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 87 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.710164:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.710166:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.710169:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.710191:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 87 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.710201:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 87 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.710210:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267685888:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.710273:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.711559:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267685888:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.711581:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.711591:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065138.711619:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272961792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1505us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.711633:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30343 00000100:00100000:0.0:1746065138.712046:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.712370:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272961920 00000100:00100000:3.0:1746065138.712374:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272961920 00010000:00010000:3.0:1746065138.712392:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.712420:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14315 00000100:00100000:3.0:1746065138.712426:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272961920:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.712433:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.712448:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.712456:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.712473:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fd53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cc4 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.712494:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.712495:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.712500:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.712508:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.712527:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.712536:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267686016:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.712582:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.714640:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.714792:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272962176 00000100:00100000:2.0:1746065138.714799:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272962176 00000100:00100000:3.0:1746065138.714810:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267686016:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.714823:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746065138.714831:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549d880 x1830881272962176/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.714839:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d880 with x1830881272962176 ext(0->4095) 00002000:00010000:2.0:1746065138.714842:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549d880 00000100:00100000:3.0:1746065138.714850:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272961920:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2424us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.714859:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14315 00000100:00100000:2.0:1746065138.714870:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13611 00000100:00100000:2.0:1746065138.714876:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272962176:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.715048:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272962176:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 171us (418us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.715053:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13611 00002000:00100000:2.0:1746065138.715058:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549d880 x1830881272962176/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.715064:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d880 with x1830881272962176 ext(0->4095) 00002000:00010000:2.0:1746065138.715067:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549d880 00000100:00100000:0.0:1746065138.716692:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.716765:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272962304 00000100:00100000:3.0:1746065138.716770:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272962304 00000100:00100000:3.0:1746065138.716803:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30344 00000100:00100000:3.0:1746065138.716808:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1795:x1830881272962304:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.716816:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.716827:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5cd2 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.716844:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.716849:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.716850:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.716852:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.716868:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.716878:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.716887:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267686144:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.716998:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.717667:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.717706:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272962432 00000100:00100000:2.0:1746065138.717711:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272962432 00000100:00100000:2.0:1746065138.717743:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30345 00000100:00100000:2.0:1746065138.717749:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1791:x1830881272962432:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.717757:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.717765:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5cd9 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.717778:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.717782:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.717787:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.717980:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 90 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.718003:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.718015:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 90 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.718023:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065138.718061:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:1791:x1830881272962432:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 312us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.718067:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30345 00000100:00100000:3.0:1746065138.718904:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267686144:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.718919:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 89 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.718927:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065138.718969:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1795:x1830881272962304:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2160us (2279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.718974:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30344 00000100:00100000:0.0:1746065138.720128:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.720172:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272962560 00000100:00100000:3.0:1746065138.720178:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272962560 00010000:00010000:3.0:1746065138.720198:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.720216:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14316 00000100:00100000:3.0:1746065138.720222:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272962560:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.720230:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.720243:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.720257:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.720273:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fd5a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ccb expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.720290:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.720291:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.720296:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.720302:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.720323:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.720331:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.720339:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267686400:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.720388:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.721772:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267686400:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.721786:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.721808:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272962560:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1587us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.721818:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14316 00000100:00100000:0.0:1746065138.722144:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.722361:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272962816 00000100:00100000:2.0:1746065138.722366:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272962816 00002000:00100000:2.0:1746065138.722481:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253fb80 x1830881272962816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.722489:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253fb80 with x1830881272962816 ext(0->4095) 00010000:00010000:2.0:1746065138.722495:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.722505:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.722511:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253fb80 00000100:00100000:2.0:1746065138.722841:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2858 00000100:00100000:2.0:1746065138.722847:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272962816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.723214:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272962816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 366us (1069us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.723220:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2858 00002000:00100000:2.0:1746065138.723225:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253fb80 x1830881272962816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.723232:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253fb80 with x1830881272962816 ext(0->4095) 00010000:00010000:2.0:1746065138.723236:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.723244:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.723248:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253fb80 00000100:00100000:0.0:1746065138.725246:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.725310:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.725444:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272963072 00000100:00100000:3.0:1746065138.725451:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272963072 00000100:00100000:2.0:1746065138.725451:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272962944 00000100:00100000:2.0:1746065138.725459:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272962944 00010000:00010000:2.0:1746065138.725475:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.725481:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30346 00000100:00100000:3.0:1746065138.725487:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272963072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.725497:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.725509:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ce0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.725528:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.725532:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 89 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.725537:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065138.725541:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.725566:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 89 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.725576:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.725583:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065138.725610:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272963072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 123us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.725615:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30346 00000100:00100000:2.0:1746065138.725659:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14317 00000100:00100000:2.0:1746065138.725665:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2002:x1830881272962944:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.725673:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.725687:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.725798:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.725813:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fd61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd2 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.725836:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.725838:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.725843:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.725849:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.725868:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.725877:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.725891:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267686656:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.726038:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.729336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.729377:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267686656:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.729394:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.729428:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2002:x1830881272962944:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3763us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.729437:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14317 00000100:00100000:3.0:1746065138.729534:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272963328 00000100:00100000:3.0:1746065138.729540:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272963328 00002000:00100000:3.0:1746065138.729569:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938000 x1830881272963328/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.729578:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938000 with x1830881272963328 ext(0->4095) 00010000:00010000:3.0:1746065138.729585:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.729596:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.729603:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938000 00000100:00100000:3.0:1746065138.729630:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2859 00000100:00100000:3.0:1746065138.729635:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272963328:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.729948:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272963328:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 300us (611us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.729955:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2859 00002000:00100000:3.0:1746065138.729960:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938000 x1830881272963328/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.729967:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938000 with x1830881272963328 ext(0->4095) 00010000:00010000:3.0:1746065138.729972:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.729981:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.729990:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938000 00000100:00100000:0.0:1746065138.733387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.733435:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.733492:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272963584 00000100:00100000:2.0:1746065138.733499:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272963584 00010000:00010000:2.0:1746065138.733526:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.733558:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14318 00000100:00100000:2.0:1746065138.733564:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272963584:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.733573:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.733586:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.733595:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.733612:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fd68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cd9 expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.733623:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.733626:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.733631:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.733635:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272963456 00010000:00010000:2.0:1746065138.733639:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.733640:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272963456 00010000:00010000:2.0:1746065138.733661:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.733662:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30347 00000100:00100000:3.0:1746065138.733667:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:1791:x1830881272963456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:2.0:1746065138.733671:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267686784:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.733678:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.733687:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ce7 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.733704:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.733710:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.733711:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.733714:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 89 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.733716:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f600 going to sleep for 11 seconds 00010000:00010000:3.0:1746065138.733730:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.733738:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.733746:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267686912:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.733767:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.735013:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267686784:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.735026:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.735050:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272963584:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1486us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.735057:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14318 00000100:00100000:3.0:1746065138.735127:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267686912:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.735143:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.735152:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065138.735171:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:1791:x1830881272963456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1503us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.735176:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30347 00000100:00100000:0.0:1746065138.735503:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.735663:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272963840 00000100:00100000:3.0:1746065138.735667:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272963840 00002000:00100000:3.0:1746065138.735690:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c323800 x1830881272963840/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.735699:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323800 with x1830881272963840 ext(0->4095) 00010000:00010000:3.0:1746065138.735704:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.735713:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.735718:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c323800 00000100:00100000:3.0:1746065138.735746:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2860 00000100:00100000:3.0:1746065138.735751:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272963840:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.736392:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272963840:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 639us (887us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.736398:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2860 00002000:00100000:3.0:1746065138.736452:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c323800 x1830881272963840/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.736463:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323800 with x1830881272963840 ext(0->4095) 00010000:00010000:3.0:1746065138.736468:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.736477:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065138.736482:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c323800 00000100:00100000:0.0:1746065138.739464:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.739729:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272963968 00000100:00100000:3.0:1746065138.739737:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272963968 00010000:00010000:3.0:1746065138.739764:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.739799:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14319 00000100:00100000:3.0:1746065138.739806:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272963968:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.739817:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.739832:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.739843:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.739861:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87fd6f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce0 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.739887:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.739889:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.739897:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 87 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.739904:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 87 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.739931:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 87 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.739956:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267687040:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.740868:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.742194:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267687040:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.742208:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.742249:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272963968:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2442us (2792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.742261:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14319 00000100:00100000:0.0:1746065138.743203:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.743274:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272964224 00000100:00100000:3.0:1746065138.743280:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272964224 00002000:00100000:3.0:1746065138.743309:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c321180 x1830881272964224/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.743317:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321180 with x1830881272964224 ext(0->4095) 00002000:00010000:3.0:1746065138.743321:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c321180 00000100:00100000:3.0:1746065138.743351:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13612 00000100:00100000:3.0:1746065138.743357:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272964224:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.743453:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272964224:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (251us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.743460:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13612 00002000:00100000:3.0:1746065138.743465:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c321180 x1830881272964224/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.743472:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321180 with x1830881272964224 ext(0->4095) 00002000:00010000:3.0:1746065138.743474:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c321180 00000100:00100000:0.0:1746065138.744825:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.744952:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272964352 00000100:00100000:3.0:1746065138.744956:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272964352 00000100:00100000:3.0:1746065138.744988:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30348 00000100:00100000:3.0:1746065138.744994:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272964352:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.745004:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.745016:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5cee expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.745036:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 87 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.745044:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.745045:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.745049:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.745073:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 87 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.745107:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 87 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.745121:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267687168:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.745713:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.746693:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.746770:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267687168:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.746786:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.746797:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065138.746829:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272964352:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1835us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.746835:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30348 00000100:00100000:2.0:1746065138.747447:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272964480 00000100:00100000:2.0:1746065138.747453:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272964480 00010000:00010000:2.0:1746065138.747476:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.747506:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14320 00000100:00100000:2.0:1746065138.747511:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2005:x1830881272964480:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.747521:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.747539:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.747553:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.747571:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ce7 expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.747584:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.747585:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.747591:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.747598:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.747621:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.747630:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267687296:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.747681:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.749950:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267687296:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.749966:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.750005:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272964480:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2493us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.750013:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14320 00000100:00100000:0.0:1746065138.750334:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.750396:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272964736 00000100:00100000:2.0:1746065138.750401:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272964736 00002000:00100000:2.0:1746065138.750429:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5ea680 x1830881272964736/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.750438:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5ea680 with x1830881272964736 ext(0->4095) 00002000:00010000:2.0:1746065138.750442:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5ea680 00000100:00100000:2.0:1746065138.750469:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13613 00000100:00100000:2.0:1746065138.750475:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272964736:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.750891:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272964736:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 416us (557us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.750897:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13613 00002000:00100000:2.0:1746065138.750901:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5ea680 x1830881272964736/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.750908:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5ea680 with x1830881272964736 ext(0->4095) 00002000:00010000:2.0:1746065138.750911:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5ea680 00000100:00100000:0.0:1746065138.752925:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.753171:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272964864 00000100:00100000:3.0:1746065138.753177:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272964864 00000100:00100000:3.0:1746065138.753212:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30349 00000100:00100000:3.0:1746065138.753217:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1795:x1830881272964864:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.753229:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.753242:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5cf5 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.753260:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.753265:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.753267:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.753270:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.753296:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.753306:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.753315:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267687424:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.753389:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.753657:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.753691:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272964992 00000100:00100000:2.0:1746065138.753695:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272964992 00000100:00100000:2.0:1746065138.753719:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30350 00000100:00100000:2.0:1746065138.753725:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1791:x1830881272964992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.753731:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.753736:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5cfc expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.753746:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.753750:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.753759:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.753761:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 90 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.753778:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.753788:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 90 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.753796:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:2.0:1746065138.753828:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:1791:x1830881272964992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 103us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.753833:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30350 00000100:00100000:3.0:1746065138.754985:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267687424:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.754999:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 89 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.755007:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:0.0:1746065138.755011:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.755166:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1795:x1830881272964864:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1948us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.755171:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30349 00000100:00100000:2.0:1746065138.755219:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272965120 00000100:00100000:2.0:1746065138.755223:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272965120 00010000:00010000:2.0:1746065138.755384:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.755411:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14321 00000100:00100000:2.0:1746065138.755417:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5946850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272965120:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.755424:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.755442:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.755451:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.755467:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f87fd7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cee expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.755565:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.755567:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.755572:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.755579:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.755599:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.755608:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.755617:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267687680:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.755811:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.757682:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267687680:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.757697:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.757878:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5946850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272965120:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2459us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.757887:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14321 00000100:00100000:0.0:1746065138.758045:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.758114:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272965376 00000100:00100000:2.0:1746065138.758120:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272965376 00002000:00100000:2.0:1746065138.758144:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297a300 x1830881272965376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.758152:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297a300 with x1830881272965376 ext(0->4095) 00010000:00010000:2.0:1746065138.758158:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.758167:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.758173:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007297a300 00000100:00100000:2.0:1746065138.758192:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2861 00000100:00100000:2.0:1746065138.758197:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272965376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.758283:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272965376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 86us (239us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.758288:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2861 00002000:00100000:2.0:1746065138.758292:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297a300 x1830881272965376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.758298:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297a300 with x1830881272965376 ext(0->4095) 00010000:00010000:2.0:1746065138.758302:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.758309:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.758314:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007297a300 00000100:00100000:0.0:1746065138.760651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.760725:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272965504 00000100:00100000:3.0:1746065138.760731:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272965504 00000100:00100000:3.0:1746065138.760775:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30351 00000100:00100000:3.0:1746065138.760782:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272965504:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.760799:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.760812:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d03 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.760832:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.760838:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.760843:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065138.760846:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.760871:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.760881:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.760888:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065138.760923:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272965504:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.760928:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30351 00000100:00100000:0.0:1746065138.761041:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.761892:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272965632 00000100:00100000:3.0:1746065138.761896:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272965632 00010000:00010000:3.0:1746065138.761914:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.761954:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14322 00000100:00100000:3.0:1746065138.761960:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2003:x1830881272965632:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.761967:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.761980:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.761993:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.762008:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f87fd84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cf5 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.762032:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.762034:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.762040:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.762051:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.762068:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.762078:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.762186:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267687936:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.762229:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.766971:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.767105:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272965888 00000100:00100000:2.0:1746065138.767112:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272965888 00002000:00100000:2.0:1746065138.767149:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e2a00 x1830881272965888/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.767158:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2a00 with x1830881272965888 ext(0->4095) 00010000:00010000:2.0:1746065138.767165:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.767178:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.767184:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e2a00 00000100:00100000:2.0:1746065138.767201:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2862 00000100:00100000:2.0:1746065138.767207:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272965888:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.767307:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272965888:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 101us (344us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.767313:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2862 00002000:00100000:2.0:1746065138.767317:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e2a00 x1830881272965888/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.767324:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2a00 with x1830881272965888 ext(0->4095) 00010000:00010000:2.0:1746065138.767328:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.767335:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.767344:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e2a00 00000100:00100000:3.0:1746065138.767631:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267687936:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.767647:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.767677:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2003:x1830881272965632:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5717us (6636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.767688:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14322 00000100:00100000:0.0:1746065138.769360:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.769401:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.769471:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272966016 00000100:00100000:3.0:1746065138.769476:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272966016 00000100:00100000:3.0:1746065138.769509:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30352 00000100:00100000:3.0:1746065138.769515:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:1791:x1830881272966016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.769528:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.769540:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d0a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.769581:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272966144 00000100:00100000:2.0:1746065138.769584:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272966144 00010000:00010000:2.0:1746065138.769597:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.769624:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14323 00000100:00100000:2.0:1746065138.769629:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2005:x1830881272966144:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.769636:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.769649:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.769659:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.769675:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f87fd8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5cfc expref: 89 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.769689:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.769690:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.769696:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.769702:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.769731:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.769741:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267688064:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.769783:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.769788:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.769789:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.769792:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 89 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.769854:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.769864:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.769871:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267688192:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.769917:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.770275:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.771230:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267688192:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.771249:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 89 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.771260:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065138.771283:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1791:x1830881272966016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1768us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.771290:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30352 00000100:00100000:0.0:1746065138.773121:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.773140:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272966400 00000100:00100000:0.0:1746065138.773145:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272966400 00000100:00100000:2.0:1746065138.773203:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267688064:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.773217:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.773254:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2005:x1830881272966144:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3624us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.773262:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14323 00002000:00100000:0.0:1746065138.773326:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788700 x1830881272966400/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.773334:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788700 with x1830881272966400 ext(0->4095) 00010000:00010000:0.0:1746065138.773341:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.773351:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.773356:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b788700 00000100:00100000:0.0:1746065138.773369:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2863 00000100:00100000:0.0:1746065138.773375:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272966400:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746065138.773486:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272966400:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 110us (404us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065138.773492:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2863 00002000:00100000:0.0:1746065138.773497:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788700 x1830881272966400/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.773508:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788700 with x1830881272966400 ext(0->4095) 00010000:00010000:0.0:1746065138.773513:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.773521:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.773530:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b788700 00000100:00100000:0.0:1746065138.774860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.775257:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272966528 00000100:00100000:2.0:1746065138.775263:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272966528 00010000:00010000:2.0:1746065138.775280:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.775305:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14324 00000100:00100000:2.0:1746065138.775311:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272966528:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.775320:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.775332:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.775341:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.775359:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fd92 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d03 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.775438:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.775441:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.775447:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 87 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.775454:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 87 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.775479:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 87 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.775488:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267688320:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.775551:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.776634:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267688320:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.776644:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.776670:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272966528:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1359us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.776676:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14324 00000100:00100000:0.0:1746065138.776905:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.776952:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272966784 00000100:00100000:2.0:1746065138.776955:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272966784 00002000:00100000:2.0:1746065138.777019:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788000 x1830881272966784/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.777027:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788000 with x1830881272966784 ext(0->4095) 00002000:00010000:2.0:1746065138.777030:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788000 00000100:00100000:2.0:1746065138.777043:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13614 00000100:00100000:2.0:1746065138.777049:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272966784:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.777157:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272966784:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 107us (251us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.777163:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13614 00002000:00100000:2.0:1746065138.777168:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788000 x1830881272966784/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.777175:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788000 with x1830881272966784 ext(0->4095) 00002000:00010000:2.0:1746065138.777182:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788000 00000100:00100000:0.0:1746065138.780251:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.780472:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272966912 00000100:00100000:3.0:1746065138.780481:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272966912 00000100:00100000:3.0:1746065138.781189:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30353 00000100:00100000:3.0:1746065138.781198:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272966912:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.781212:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.781225:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d11 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.781249:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 87 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.781256:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.781258:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.781261:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.781286:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 87 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.781300:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 87 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.781311:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267688448:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.782297:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.783925:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267688448:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.783956:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.783969:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065138.784013:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272966912:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2816us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.784020:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30353 00000100:00100000:0.0:1746065138.784175:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.785570:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272967040 00000100:00100000:2.0:1746065138.785577:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272967040 00010000:00010000:2.0:1746065138.785603:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.785637:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14325 00000100:00100000:2.0:1746065138.785643:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272967040:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.785653:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.785668:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.785678:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.785696:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fd99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d0a expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.785709:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.785716:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.785722:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.785729:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.785754:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.785765:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267688576:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.785826:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.788831:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.788888:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272967168 00000100:00100000:3.0:1746065138.788894:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272967168 00000100:00100000:2.0:1746065138.788922:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267688576:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.788946:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30354 00000100:00100000:3.0:1746065138.788953:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:1791:x1830881272967168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.788954:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065138.788966:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.788978:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d18 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.788994:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272967040:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3345us (4813us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065138.789000:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.789002:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14325 00010000:00010000:3.0:1746065138.789007:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.789008:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.789011:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.789043:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.789057:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.789074:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267688704:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065138.789116:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.789133:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272967424 00000100:00100000:3.0:1746065138.789134:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.789136:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272967424 00002000:00100000:0.0:1746065138.789156:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f1180 x1830881272967424/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.789164:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f1180 with x1830881272967424 ext(0->4095) 00010000:00010000:0.0:1746065138.789168:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.789177:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.789183:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f1180 00000100:00100000:0.0:1746065138.789194:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2864 00000100:00100000:0.0:1746065138.789199:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272967424:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065138.789367:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272967424:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 165us (248us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065138.789373:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2864 00002000:00100000:0.0:1746065138.789378:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f1180 x1830881272967424/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.789385:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f1180 with x1830881272967424 ext(0->4095) 00010000:00010000:0.0:1746065138.789389:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065138.789397:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065138.789401:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f1180 00000100:00100000:0.0:1746065138.791931:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.791992:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272967552 00000100:00100000:1.0:1746065138.791998:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272967552 00000100:00100000:1.0:1746065138.792039:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30355 00000100:00100000:1.0:1746065138.792046:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1795:x1830881272967552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.792059:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.792071:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d1f expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.792116:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.792121:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.792125:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.792129:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 90 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.792130:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267688704:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.792145:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.792150:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.792153:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00010000:00010000:1.0:1746065138.792158:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 90 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.792163:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065138.792463:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:1795:x1830881272967552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 135us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.792471:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30355 00000100:00100000:3.0:1746065138.792478:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:1791:x1830881272967168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3525us (3654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.792483:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30354 00000100:00100000:0.0:1746065138.792762:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.792835:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272967680 00000100:00100000:2.0:1746065138.792839:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272967680 00010000:00010000:2.0:1746065138.792854:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.792880:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14326 00000100:00100000:2.0:1746065138.792884:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272967680:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.792892:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.792905:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.793362:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.793381:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fda0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d11 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.793393:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.793395:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.793399:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.793405:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.793425:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.793434:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.793443:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267688960:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.793713:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.795357:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267688960:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.795372:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.795409:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272967680:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2523us (2646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.795419:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14326 00000100:00100000:0.0:1746065138.795471:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.795706:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272967936 00000100:00100000:2.0:1746065138.795711:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272967936 00002000:00100000:2.0:1746065138.795737:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf8700 x1830881272967936/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.795746:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf8700 with x1830881272967936 ext(0->4095) 00010000:00010000:2.0:1746065138.795752:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.795763:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.795768:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009faf8700 00000100:00100000:2.0:1746065138.795790:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2865 00000100:00100000:2.0:1746065138.795796:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2005:x1830881272967936:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.795889:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2005:x1830881272967936:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 93us (417us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.795894:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2865 00002000:00100000:2.0:1746065138.795899:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf8700 x1830881272967936/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.795907:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf8700 with x1830881272967936 ext(0->4095) 00010000:00010000:2.0:1746065138.795911:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.795924:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.795929:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009faf8700 00000100:00100000:0.0:1746065138.800863:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.801120:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272968064 00000100:00100000:2.0:1746065138.801127:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272968064 00010000:00010000:2.0:1746065138.801157:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.801339:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14327 00000100:00100000:2.0:1746065138.801347:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272968064:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.801359:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.801373:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.801383:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.801401:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fda7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d18 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.801427:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.801429:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.801435:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.801447:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.801478:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.801488:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267689088:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.801556:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.803762:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267689088:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.803780:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.803828:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272968064:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2480us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.803837:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14327 00000100:00100000:0.0:1746065138.804450:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.804472:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272968320 00000100:00100000:0.0:1746065138.804477:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272968320 00002000:00100000:0.0:1746065138.804502:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2d80 x1830881272968320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.804510:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2d80 with x1830881272968320 ext(0->4095) 00002000:00010000:0.0:1746065138.804514:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b2d80 00000100:00100000:0.0:1746065138.804537:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13615 00000100:00100000:0.0:1746065138.804543:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272968320:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065138.804636:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272968320:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (187us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065138.804642:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13615 00002000:00100000:0.0:1746065138.804647:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2d80 x1830881272968320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.804653:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2d80 with x1830881272968320 ext(0->4095) 00002000:00010000:0.0:1746065138.804656:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b2d80 00000100:00100000:0.0:1746065138.806445:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.806493:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272968448 00000100:00100000:3.0:1746065138.806498:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272968448 00000100:00100000:3.0:1746065138.806810:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30356 00000100:00100000:3.0:1746065138.806816:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272968448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.806828:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.806840:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d26 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.806859:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.806866:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.806867:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.806870:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.806892:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.806901:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.806910:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267689216:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.808107:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.809684:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267689216:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.809707:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.809725:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:0.0:1746065138.809741:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.809800:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272968576 00000100:00100000:2.0:1746065138.809805:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272968576 00010000:00010000:2.0:1746065138.809827:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.809834:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272968448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2952us (3328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.809841:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30356 00000100:00100000:2.0:1746065138.809848:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14328 00000100:00100000:2.0:1746065138.809853:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5946450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2005:x1830881272968576:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.809863:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.809877:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.809886:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.809902:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d1f expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.809913:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.809914:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.809919:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.809926:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.809956:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.809964:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267689344:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.810008:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.812414:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267689344:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.812430:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.812476:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5946450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272968576:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2621us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.812484:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14328 00000100:00100000:0.0:1746065138.813239:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.813337:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272968832 00000100:00100000:2.0:1746065138.813342:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272968832 00002000:00100000:2.0:1746065138.813368:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc39880 x1830881272968832/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.813382:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39880 with x1830881272968832 ext(0->4095) 00002000:00010000:2.0:1746065138.813385:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc39880 00000100:00100000:2.0:1746065138.813432:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13616 00000100:00100000:2.0:1746065138.813439:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272968832:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065138.813684:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272968832:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 245us (445us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.813689:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13616 00002000:00100000:2.0:1746065138.813694:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc39880 x1830881272968832/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.813700:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39880 with x1830881272968832 ext(0->4095) 00002000:00010000:2.0:1746065138.813703:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc39880 00000100:00100000:0.0:1746065138.814865:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.814916:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272968960 00000100:00100000:3.0:1746065138.814921:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272968960 00000100:00100000:3.0:1746065138.814967:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30357 00000100:00100000:3.0:1746065138.814973:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1791:x1830881272968960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.814985:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.814997:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d2d expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.815016:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.815022:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.815023:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.815027:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.815053:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.815062:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.815072:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267689472:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.815880:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.816283:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.816352:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272969088 00000100:00100000:1.0:1746065138.816356:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272969088 00000100:00100000:1.0:1746065138.816387:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30358 00000100:00100000:1.0:1746065138.816392:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1795:x1830881272969088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.816399:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.816407:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d34 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.816420:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.816424:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.816428:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.816431:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 90 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.816448:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.816458:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 90 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.816465:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065138.816489:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:1795:x1830881272969088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 97us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.816495:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30358 00000100:00100000:3.0:1746065138.817700:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267689472:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.817912:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 89 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.817922:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065138.817963:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1791:x1830881272968960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2989us (3099us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.817972:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30357 00000100:00100000:0.0:1746065138.818269:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.818337:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272969216 00000100:00100000:2.0:1746065138.818342:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272969216 00010000:00010000:2.0:1746065138.818361:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.818390:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14329 00000100:00100000:2.0:1746065138.818395:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272969216:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.818404:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.818423:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.818432:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.818450:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fdb5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d26 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.818473:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.818474:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.818479:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.818486:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.818508:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.818518:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.818526:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267689728:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.818575:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.819796:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267689728:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.819808:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.820261:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272969216:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1864us (1990us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.820269:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14329 00000100:00100000:0.0:1746065138.820438:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.820492:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272969472 00000100:00100000:2.0:1746065138.820498:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272969472 00002000:00100000:2.0:1746065138.820520:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76680 x1830881272969472/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.820527:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76680 with x1830881272969472 ext(0->4095) 00010000:00010000:2.0:1746065138.820533:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.820543:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.820549:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76680 00000100:00100000:2.0:1746065138.820573:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2866 00000100:00100000:2.0:1746065138.820579:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272969472:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.821624:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272969472:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1042us (1184us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.821631:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2866 00002000:00100000:2.0:1746065138.821638:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76680 x1830881272969472/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.821646:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76680 with x1830881272969472 ext(0->4095) 00010000:00010000:2.0:1746065138.821651:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.821662:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.821667:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76680 00000100:00100000:0.0:1746065138.824110:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.824370:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272969600 00000100:00100000:2.0:1746065138.824378:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272969600 00010000:00010000:2.0:1746065138.824406:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.824441:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14330 00000100:00100000:2.0:1746065138.824448:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2005:x1830881272969600:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.824459:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.824475:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.824486:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.824505:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fdbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d2d expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.824530:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.824532:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.824538:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.824546:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.824707:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.824723:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267689856:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.824796:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.828388:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267689856:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.828407:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.828454:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2005:x1830881272969600:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4006us (4379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.828463:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14330 00000100:00100000:0.0:1746065138.829094:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.829157:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272969856 00000100:00100000:2.0:1746065138.829163:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272969856 00002000:00100000:2.0:1746065138.829193:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0e00 x1830881272969856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.829201:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0e00 with x1830881272969856 ext(0->4095) 00002000:00010000:2.0:1746065138.829205:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a0e00 00000100:00100000:2.0:1746065138.829233:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13617 00000100:00100000:2.0:1746065138.829239:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2002:x1830881272969856:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746065138.829342:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2002:x1830881272969856:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 103us (264us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.829348:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13617 00002000:00100000:2.0:1746065138.829354:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0e00 x1830881272969856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.829360:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0e00 with x1830881272969856 ext(0->4095) 00002000:00010000:2.0:1746065138.829362:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a0e00 00000100:00100000:0.0:1746065138.830801:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.831070:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272969984 00000100:00100000:3.0:1746065138.831075:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272969984 00000100:00100000:3.0:1746065138.831141:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30359 00000100:00100000:3.0:1746065138.831147:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272969984:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.831157:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.831171:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d3b expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.831191:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.831197:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.831199:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.831202:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.831226:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.831236:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.831247:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267689984:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.831313:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.832665:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267689984:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.832686:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.832695:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065138.832719:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272969984:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1572us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.832725:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30359 00000100:00100000:0.0:1746065138.834323:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.834661:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272970112 00000100:00100000:2.0:1746065138.834667:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272970112 00010000:00010000:2.0:1746065138.834690:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.835161:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14331 00000100:00100000:2.0:1746065138.835168:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272970112:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.835178:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.835194:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.835205:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.835224:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fdc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d34 expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.835244:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.835246:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.835252:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.835259:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.835284:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.835299:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267690112:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.835366:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.838687:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.838789:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267690112:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.838804:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.838838:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2004:x1830881272970112:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3670us (4517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.838846:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14331 00000100:00100000:1.0:1746065138.839413:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272970368 00000100:00100000:1.0:1746065138.839419:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272970368 00002000:00100000:1.0:1746065138.839456:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b100 x1830881272970368/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.839471:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b100 with x1830881272970368 ext(0->4095) 00002000:00010000:1.0:1746065138.839474:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077b100 00000100:00100000:1.0:1746065138.839501:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13618 00000100:00100000:1.0:1746065138.839508:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272970368:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.839595:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272970368:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 87us (916us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.839601:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13618 00002000:00100000:1.0:1746065138.839605:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b100 x1830881272970368/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.839612:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b100 with x1830881272970368 ext(0->4095) 00002000:00010000:1.0:1746065138.839615:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077b100 00000100:00100000:0.0:1746065138.839969:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.840058:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272970496 00000100:00100000:3.0:1746065138.840062:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272970496 00000100:00100000:3.0:1746065138.840100:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30360 00000100:00100000:3.0:1746065138.840106:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1791:x1830881272970496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.840114:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.840126:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d42 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.840145:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.840151:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.840153:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.840156:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.840176:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.840186:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.840196:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267690240:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.840237:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.842857:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.842916:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272970624 00000100:00100000:2.0:1746065138.842922:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272970624 00000100:00100000:1.0:1746065138.843034:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30361 00000100:00100000:1.0:1746065138.843041:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1795:x1830881272970624:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.843053:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.843064:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d49 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.843104:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.843108:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.843112:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.843115:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 90 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.843144:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.843153:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 90 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.843160:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00000100:00100000:1.0:1746065138.843189:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:1795:x1830881272970624:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 149us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.843193:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30361 00000100:00100000:3.0:1746065138.844017:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267690240:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.844037:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 89 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.844046:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065138.844095:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1791:x1830881272970496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3973us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.844102:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30360 00000100:00100000:0.0:1746065138.844465:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.844534:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272970752 00000100:00100000:2.0:1746065138.844538:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272970752 00010000:00010000:2.0:1746065138.844555:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.844587:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14332 00000100:00100000:2.0:1746065138.844592:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272970752:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.844601:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.844615:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.844625:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.844641:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fdca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d3b expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.844666:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.844668:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.844673:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.844679:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.844700:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.844709:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.844719:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267690496:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.845727:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.848368:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267690496:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.848386:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.848432:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272970752:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3838us (3966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.848441:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14332 00000100:00100000:0.0:1746065138.850398:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.850591:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272971008 00000100:00100000:2.0:1746065138.850607:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272971008 00002000:00100000:2.0:1746065138.851706:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93bb80 x1830881272971008/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.851723:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93bb80 with x1830881272971008 ext(0->4095) 00010000:00010000:2.0:1746065138.851732:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.851744:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.851750:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f93bb80 00000100:00100000:2.0:1746065138.851989:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2867 00000100:00100000:2.0:1746065138.851997:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272971008:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.852133:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272971008:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 137us (1740us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.852139:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2867 00002000:00100000:2.0:1746065138.852145:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93bb80 x1830881272971008/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.852151:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93bb80 with x1830881272971008 ext(0->4095) 00010000:00010000:2.0:1746065138.852155:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.852163:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065138.852168:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f93bb80 00000100:00100000:0.0:1746065138.855216:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.855308:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272971136 00000100:00100000:2.0:1746065138.855315:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272971136 00010000:00010000:2.0:1746065138.855340:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065138.855632:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14333 00000100:00100000:2.0:1746065138.855640:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2005:x1830881272971136:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.855652:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.855667:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.855678:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.855695:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87fdd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d42 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.855709:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.855711:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.855717:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.855724:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.855750:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.855761:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267690624:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.856323:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.858577:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267690624:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.858593:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.858641:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2005:x1830881272971136:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3001us (3429us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.858649:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14333 00000100:00100000:2.0:1746065138.858965:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.859008:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272971392 00000100:00100000:1.0:1746065138.859017:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272971392 00002000:00100000:1.0:1746065138.859052:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859c00 x1830881272971392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.859062:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859c00 with x1830881272971392 ext(0->4095) 00002000:00010000:1.0:1746065138.859065:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093859c00 00000100:00100000:2.0:1746065138.859162:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13619 00000100:00100000:2.0:1746065138.859169:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272971392:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.859269:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272971392:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (304us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.859275:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13619 00002000:00100000:2.0:1746065138.859279:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859c00 x1830881272971392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.859287:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859c00 with x1830881272971392 ext(0->4095) 00002000:00010000:2.0:1746065138.859290:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093859c00 00000100:00100000:0.0:1746065138.861668:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.861901:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272971520 00000100:00100000:3.0:1746065138.861908:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272971520 00000100:00100000:3.0:1746065138.862031:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30362 00000100:00100000:3.0:1746065138.862037:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272971520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.862048:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.862060:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d50 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.862111:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.862122:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.862123:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.862127:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.862155:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.862166:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 87 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.862176:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267690752:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.862343:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.864957:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.865038:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272971648 00000100:00100000:2.0:1746065138.865045:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272971648 00010000:00010000:2.0:1746065138.865073:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.865078:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267690752:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.865118:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.865131:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065138.865165:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272971520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3128us (3503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.865171:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30362 00000100:00100000:2.0:1746065138.865397:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14334 00000100:00100000:2.0:1746065138.865404:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2005:x1830881272971648:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.865415:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.865431:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.865441:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.865458:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fdd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d49 expref: 88 pid: 9558 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065138.865481:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.865482:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.865488:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.865495:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.865518:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.865527:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093859f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267690880:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.865578:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.867017:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093859f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267690880:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.867033:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.867055:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272971648:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1652us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.867063:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14334 00000100:00100000:0.0:1746065138.868136:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.868644:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.868733:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272971904 00000100:00100000:1.0:1746065138.868742:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272971904 00002000:00100000:1.0:1746065138.868775:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e8380 x1830881272971904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.868784:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e8380 with x1830881272971904 ext(0->4095) 00002000:00010000:1.0:1746065138.868788:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5e8380 00000100:00100000:1.0:1746065138.868813:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13620 00000100:00100000:1.0:1746065138.868819:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272971904:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.868945:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272971904:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 117us (802us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.868951:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13620 00002000:00100000:1.0:1746065138.868955:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e8380 x1830881272971904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.868962:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e8380 with x1830881272971904 ext(0->4095) 00002000:00010000:1.0:1746065138.868964:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5e8380 00000100:00100000:3.0:1746065138.868992:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272972032 00000100:00100000:3.0:1746065138.868996:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272972032 00000100:00100000:3.0:1746065138.869029:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30363 00000100:00100000:3.0:1746065138.869034:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1791:x1830881272972032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.869043:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.869055:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d57 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.869073:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.869368:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.869372:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.869376:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.869399:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.869409:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 5 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.869420:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267691008:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.869489:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.870473:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.870523:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272972160 00000100:00100000:2.0:1746065138.870529:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272972160 00000100:00100000:2.0:1746065138.870566:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30364 00000100:00100000:2.0:1746065138.870573:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1795:x1830881272972160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065138.870581:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.870590:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d5e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.870605:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.870609:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.870613:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267691008:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065138.870615:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065138.870617:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 90 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.870630:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.870636:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 90 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.870640:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00010000:00010000:2.0:1746065138.870646:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 90 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.870653:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:3.0:1746065138.870667:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:1791:x1830881272972032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1632us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.870671:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:1795:x1830881272972160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 99us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.870673:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30363 00000100:00100000:2.0:1746065138.870676:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30364 00000100:00100000:0.0:1746065138.870798:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.870876:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272972288 00000100:00100000:3.0:1746065138.870880:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272972288 00010000:00010000:3.0:1746065138.870892:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.871038:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14335 00000100:00100000:3.0:1746065138.871044:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5946050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272972288:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.871052:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.871066:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.871076:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.871118:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fddf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d50 expref: 6 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.871133:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.871134:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.871138:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.871144:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.871160:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 88 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.871169:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 88 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.871182:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267691264:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.871550:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.872734:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.873038:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267691264:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.873050:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.873098:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272972544 00000100:00100000:1.0:1746065138.873103:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272972544 00000100:00100000:3.0:1746065138.873104:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5946050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272972288:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2059us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.873111:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14335 00002000:00100000:1.0:1746065138.873129:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64000 x1830881272972544/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.873137:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64000 with x1830881272972544 ext(0->4095) 00010000:00010000:1.0:1746065138.873143:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.873153:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.873159:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64000 00000100:00100000:1.0:1746065138.873172:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2868 00000100:00100000:1.0:1746065138.873177:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272972544:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.873598:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272972544:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 419us (865us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.873604:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2868 00002000:00100000:1.0:1746065138.873611:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64000 x1830881272972544/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.873617:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64000 with x1830881272972544 ext(0->4095) 00010000:00010000:1.0:1746065138.873623:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065138.873631:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065138.873635:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64000 00000100:00100000:0.0:1746065138.874970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.875125:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272972672 00000100:00100000:3.0:1746065138.875130:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272972672 00010000:00010000:3.0:1746065138.875150:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.875179:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14336 00000100:00100000:3.0:1746065138.875185:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272972672:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.875193:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.875204:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.875214:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.875233:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fde6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d57 expref: 89 pid: 9635 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.875251:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.875253:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.875258:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.875264:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.875288:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 88 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.875297:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267691392:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.875350:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.877061:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267691392:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.877076:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.877242:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272972672:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2055us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.877250:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14336 00000100:00100000:0.0:1746065138.877676:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.877761:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272972928 00000100:00100000:1.0:1746065138.877766:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272972928 00002000:00100000:1.0:1746065138.877791:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a07100 x1830881272972928/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.877798:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a07100 with x1830881272972928 ext(0->4095) 00002000:00010000:1.0:1746065138.877802:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a07100 00000100:00100000:1.0:1746065138.877843:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13621 00000100:00100000:1.0:1746065138.877849:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272972928:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.877954:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272972928:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 87us (260us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.877960:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13621 00002000:00100000:1.0:1746065138.877965:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a07100 x1830881272972928/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.877972:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a07100 with x1830881272972928 ext(0->4095) 00002000:00010000:1.0:1746065138.877974:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a07100 00000100:00100000:0.0:1746065138.879440:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.879482:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272973056 00000100:00100000:1.0:1746065138.879486:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272973056 00000100:00100000:1.0:1746065138.879519:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30365 00000100:00100000:1.0:1746065138.879524:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272973056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.879533:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.879544:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d65 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.879565:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 87 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.879602:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.879603:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.879607:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.879629:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 87 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.879639:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 87 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065138.879648:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267691520:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.879708:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.880513:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267691520:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.880528:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.880543:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065138.880565:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272973056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1040us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.880571:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30365 00000100:00100000:0.0:1746065138.880918:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.880973:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272973184 00000100:00100000:3.0:1746065138.880977:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272973184 00010000:00010000:3.0:1746065138.880994:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065138.881024:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14337 00000100:00100000:3.0:1746065138.881030:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2005:x1830881272973184:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.881038:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.881053:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.881066:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.881107:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87fded lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d5e expref: 88 pid: 9560 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065138.881119:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.881121:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.881126:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.881132:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.881151:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.881159:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267691648:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.881192:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.882532:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267691648:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.882544:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.882575:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:2005:x1830881272973184:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1545us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.882582:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14337 00000100:00100000:0.0:1746065138.882716:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.882780:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272973440 00000100:00100000:1.0:1746065138.882785:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272973440 00002000:00100000:1.0:1746065138.882812:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbe300 x1830881272973440/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.882820:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbe300 with x1830881272973440 ext(0->4095) 00002000:00010000:1.0:1746065138.882824:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbe300 00000100:00100000:1.0:1746065138.882846:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13622 00000100:00100000:1.0:1746065138.882851:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272973440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.882953:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272973440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 101us (237us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.882957:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13622 00002000:00100000:1.0:1746065138.882962:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbe300 x1830881272973440/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.882968:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbe300 with x1830881272973440 ext(0->4095) 00002000:00010000:1.0:1746065138.882970:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbe300 00000100:00100000:0.0:1746065138.885311:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.885462:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272973568 00000100:00100000:1.0:1746065138.885468:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272973568 00000100:00100000:1.0:1746065138.885509:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30366 00000100:00100000:1.0:1746065138.885516:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+87:1795:x1830881272973568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.885528:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.885542:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d6c expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.885563:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.885570:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.885572:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.885575:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.885596:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.885606:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.885616:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267691776:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.885680:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.886681:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267691776:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.886697:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 88 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.886708:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065138.886737:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:1795:x1830881272973568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1221us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.886746:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30366 00000100:00100000:2.0:1746065138.886916:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.886983:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272973696 00000100:00100000:3.0:1746065138.886987:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272973696 00010000:00010000:3.0:1746065138.887005:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.887034:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14338 00000100:00100000:3.0:1746065138.887040:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272973696:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.887048:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.887063:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.887072:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.887354:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fdf4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d65 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.887373:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.887375:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.887380:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.887391:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.887414:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.887423:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267691904:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.887685:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.888973:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267691904:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.888985:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.889021:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272973696:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1980us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.889029:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14338 00000100:00100000:2.0:1746065138.889338:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.889409:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272973952 00000100:00100000:0.0:1746065138.889414:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272973952 00002000:00100000:0.0:1746065138.889441:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385bb80 x1830881272973952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.889449:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385bb80 with x1830881272973952 ext(0->4095) 00002000:00010000:0.0:1746065138.889452:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009385bb80 00000100:00100000:0.0:1746065138.889605:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13623 00000100:00100000:0.0:1746065138.889613:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272973952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065138.889697:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272973952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 85us (359us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065138.889703:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13623 00002000:00100000:0.0:1746065138.889708:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385bb80 x1830881272973952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.889714:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385bb80 with x1830881272973952 ext(0->4095) 00002000:00010000:0.0:1746065138.889717:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009385bb80 00000100:00100000:0.0:1746065138.891226:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.891883:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272974080 00000100:00100000:1.0:1746065138.891890:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272974080 00000100:00100000:1.0:1746065138.891989:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30367 00000100:00100000:1.0:1746065138.891996:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272974080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.892007:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.892020:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d73 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.892043:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.892050:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.892051:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.892054:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.892078:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 87 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.892109:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 87 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.892120:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267692032:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.892575:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.893796:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267692032:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.893816:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.893827:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:1.0:1746065138.893852:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272974080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1857us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.893859:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30367 00000100:00100000:0.0:1746065138.894498:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.894636:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272974208 00000100:00100000:3.0:1746065138.894640:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272974208 00002000:00100000:3.0:1746065138.894667:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012d36c700 x1830881272974208/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.894675:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36c700 with x1830881272974208 ext(0->7) 00010000:00010000:3.0:1746065138.894680:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 88 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.894691:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 88 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065138.894696:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36c700 00000100:00100000:3.0:1746065138.894708:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2869 00000100:00100000:3.0:1746065138.894713:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+88:2004:x1830881272974208:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065138.895564:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:2004:x1830881272974208:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 849us (1065us total) trans 4294972107 rc 0/0 00000100:00100000:0.0:1746065138.895570:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2869 00002000:00100000:0.0:1746065138.895574:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012d36c700 x1830881272974208/t4294972107(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.895579:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36c700 with x1830881272974208 ext(0->7) 00010000:00010000:0.0:1746065138.895582:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 90 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065138.895588:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 90 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065138.895592:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36c700 00000100:00100000:0.0:1746065138.899161:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.899461:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272974336 00000100:00100000:3.0:1746065138.899468:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272974336 00010000:00010000:3.0:1746065138.899499:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 90 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.899529:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14339 00000100:00100000:3.0:1746065138.899536:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:2004:x1830881272974336:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.899549:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065138.899606:0:8359:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1746065137 -> 1746065138 00002000:00010000:3.0:1746065138.899609:0:8359:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1746065137 -> 1746065138 00010000:00010000:3.0:1746065138.899615:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 90 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.899626:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 90 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.899644:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fdfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d6c expref: 90 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.899660:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.899661:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.899668:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.899676:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.899703:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.899718:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267692160:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.899789:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.900981:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267692160:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.900993:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.901024:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:2004:x1830881272974336:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1488us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.901031:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14339 00000100:00100000:0.0:1746065138.901702:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.901777:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272974592 00000100:00100000:2.0:1746065138.901782:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272974592 00002000:00100000:2.0:1746065138.901810:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36ce00 x1830881272974592/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.901818:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36ce00 with x1830881272974592 ext(0->4095) 00002000:00010000:2.0:1746065138.901822:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36ce00 00000100:00100000:2.0:1746065138.901835:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13624 00000100:00100000:2.0:1746065138.901840:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272974592:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.902135:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272974592:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 294us (433us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.902141:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13624 00002000:00100000:2.0:1746065138.902146:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36ce00 x1830881272974592/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.902153:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36ce00 with x1830881272974592 ext(0->4095) 00002000:00010000:2.0:1746065138.902155:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36ce00 00000100:00100000:0.0:1746065138.903540:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.903592:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272974720 00000100:00100000:1.0:1746065138.903597:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272974720 00000100:00100000:1.0:1746065138.903668:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30368 00000100:00100000:1.0:1746065138.903675:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+89:1795:x1830881272974720:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.903685:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.903697:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d7a expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.903716:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.903721:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.903722:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.903725:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 90 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.903743:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.903750:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.903757:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267692288:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.903814:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.905108:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267692288:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.905126:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 90 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.905135:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065138.905160:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:1795:x1830881272974720:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1487us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.905166:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30368 00000100:00100000:0.0:1746065138.906864:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.907005:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272974848 00000100:00100000:3.0:1746065138.907012:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272974848 00010000:00010000:3.0:1746065138.907035:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.907229:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14340 00000100:00100000:2.0:1746065138.907237:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272974848:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.907248:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.907266:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.907278:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.907297:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe02 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d73 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.907316:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.907318:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.907323:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 89 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.907330:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 89 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.907356:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 89 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.907364:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267692416:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.907426:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.910041:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.910110:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272975104 00000100:00100000:3.0:1746065138.910116:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272975104 00002000:00100000:3.0:1746065138.910144:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36d880 x1830881272975104/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.910151:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36d880 with x1830881272975104 ext(0->4095) 00002000:00010000:3.0:1746065138.910154:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36d880 00000100:00100000:3.0:1746065138.910176:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13625 00000100:00100000:3.0:1746065138.910185:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:2002:x1830881272975104:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746065138.910279:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267692416:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.910294:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.910303:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:2002:x1830881272975104:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 118us (266us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.910309:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13625 00002000:00100000:3.0:1746065138.910314:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36d880 x1830881272975104/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746065138.910316:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272974848:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3081us (3457us total) trans 0 rc 0/0 00002000:00100000:3.0:1746065138.910321:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36d880 with x1830881272975104 ext(0->4095) 00000100:00100000:2.0:1746065138.910322:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14340 00002000:00010000:3.0:1746065138.910324:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36d880 00000100:00100000:0.0:1746065138.911538:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.911613:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272975232 00000100:00100000:1.0:1746065138.911618:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272975232 00000100:00100000:1.0:1746065138.911653:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30369 00000100:00100000:1.0:1746065138.911658:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272975232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.911668:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.911680:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d81 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.911699:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 89 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.911705:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.911706:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.911709:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.911734:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 89 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.911744:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 89 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.911754:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267692544:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.911803:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.913308:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267692544:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.913327:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.913339:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065138.913364:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272975232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1705us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.913370:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30369 00000100:00100000:0.0:1746065138.914067:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.914167:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272975360 00000100:00100000:3.0:1746065138.914173:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272975360 00002000:00100000:3.0:1746065138.914204:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012d36df80 x1830881272975360/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.914218:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36df80 with x1830881272975360 ext(0->7) 00010000:00010000:3.0:1746065138.914225:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 90 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.914236:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 90 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065138.914242:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36df80 00000100:00100000:3.0:1746065138.914261:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2870 00000100:00100000:3.0:1746065138.914268:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+90:2004:x1830881272975360:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065138.914821:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+92:2004:x1830881272975360:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 552us (753us total) trans 4294972108 rc 0/0 00000100:00100000:0.0:1746065138.914827:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2870 00002000:00100000:0.0:1746065138.914833:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012d36df80 x1830881272975360/t4294972108(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.914840:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36df80 with x1830881272975360 ext(0->7) 00010000:00010000:0.0:1746065138.914844:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 92 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065138.914854:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 92 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065138.914857:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36df80 00000100:00100000:0.0:1746065138.915618:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.915684:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272975488 00000100:00100000:2.0:1746065138.915689:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272975488 00010000:00010000:2.0:1746065138.915707:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 92 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.916484:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14341 00000100:00100000:2.0:1746065138.916491:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+92:2003:x1830881272975488:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.916503:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.916515:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 92 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.916525:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 92 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.916540:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87fe09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d7a expref: 92 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.916558:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.916560:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.916567:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.916574:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.916598:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.916607:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267692672:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.916665:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.917915:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267692672:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065138.917917:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065138.917927:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.917968:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+91:2003:x1830881272975488:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1477us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.917978:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14341 00000100:00100000:1.0:1746065138.917988:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272975744 00000100:00100000:1.0:1746065138.917994:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272975744 00002000:00100000:1.0:1746065138.918019:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36e680 x1830881272975744/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.918026:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36e680 with x1830881272975744 ext(0->4095) 00002000:00010000:1.0:1746065138.918030:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36e680 00000100:00100000:1.0:1746065138.918056:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13626 00000100:00100000:1.0:1746065138.918062:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272975744:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065138.918181:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272975744:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 119us (265us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.918187:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13626 00002000:00100000:1.0:1746065138.918192:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36e680 x1830881272975744/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.918202:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36e680 with x1830881272975744 ext(0->4095) 00002000:00010000:1.0:1746065138.918204:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36e680 00000100:00100000:0.0:1746065138.919765:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.919838:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272975872 00000100:00100000:1.0:1746065138.919843:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272975872 00000100:00100000:1.0:1746065138.919877:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30370 00000100:00100000:1.0:1746065138.919883:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+91:1795:x1830881272975872:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.919892:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.919905:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d88 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.919926:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.919932:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.919949:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.919952:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 92 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.919974:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.919987:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.919996:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267692800:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.920057:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.920796:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267692800:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.920813:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 92 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.920824:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065138.920845:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+92:1795:x1830881272975872:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 962us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.920851:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30370 00000100:00100000:0.0:1746065138.921894:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.921950:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272976000 00000100:00100000:2.0:1746065138.921956:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272976000 00010000:00010000:2.0:1746065138.921977:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.922007:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14342 00000100:00100000:2.0:1746065138.922013:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5945c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272976000:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.922022:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.922037:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.922047:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.922064:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe10 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d81 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.922073:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.922075:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.922105:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 91 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.922114:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 91 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.922135:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 91 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.922145:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267692928:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.922200:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.925023:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267692928:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.925038:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.925065:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5945c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272976000:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3052us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.925073:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14342 00000100:00100000:0.0:1746065138.925395:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.925448:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272976256 00000100:00100000:1.0:1746065138.925454:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272976256 00002000:00100000:1.0:1746065138.925484:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36ed80 x1830881272976256/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.925493:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36ed80 with x1830881272976256 ext(0->4095) 00002000:00010000:1.0:1746065138.925496:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36ed80 00000100:00100000:1.0:1746065138.925516:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13627 00000100:00100000:1.0:1746065138.925522:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+92:2002:x1830881272976256:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065138.925621:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+92:2002:x1830881272976256:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 99us (226us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.925629:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13627 00002000:00100000:1.0:1746065138.925634:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36ed80 x1830881272976256/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.925641:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36ed80 with x1830881272976256 ext(0->4095) 00002000:00010000:1.0:1746065138.925643:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36ed80 00000100:00100000:0.0:1746065138.926755:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.926829:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272976384 00000100:00100000:1.0:1746065138.926833:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272976384 00000100:00100000:1.0:1746065138.926865:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30371 00000100:00100000:1.0:1746065138.926870:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272976384:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.926879:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.926891:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d8f expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.926910:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 91 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.926916:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.926918:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.926921:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.926952:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 91 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.927014:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 91 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.927033:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267693056:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.927114:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.928714:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267693056:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.928733:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.928744:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:1.0:1746065138.928782:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272976384:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1911us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.928788:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30371 00000100:00100000:0.0:1746065138.929178:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.929270:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272976512 00000100:00100000:1.0:1746065138.929275:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272976512 00002000:00100000:1.0:1746065138.929300:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012d36f100 x1830881272976512/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.929309:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36f100 with x1830881272976512 ext(0->7) 00010000:00010000:1.0:1746065138.929314:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 92 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065138.929323:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 92 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065138.929329:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36f100 00000100:00100000:1.0:1746065138.929341:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2871 00000100:00100000:1.0:1746065138.929346:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+92:2005:x1830881272976512:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065138.930046:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272976512:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 698us (867us total) trans 4294972109 rc 0/0 00000100:00100000:0.0:1746065138.930053:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2871 00002000:00100000:0.0:1746065138.930058:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012d36f100 x1830881272976512/t4294972109(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 496/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065138.930065:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36f100 with x1830881272976512 ext(0->7) 00010000:00010000:0.0:1746065138.930070:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065138.930108:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065138.930115:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36f100 00000100:00100000:0.0:1746065138.931468:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.931569:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272976640 00000100:00100000:2.0:1746065138.931574:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272976640 00010000:00010000:2.0:1746065138.931594:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.931627:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14343 00000100:00100000:2.0:1746065138.931634:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272976640:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.931642:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.931654:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.931664:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.931681:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f87fe17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d88 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.931704:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.931707:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.931713:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.931720:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.931745:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.931754:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267693184:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.931818:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.933745:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267693184:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.933760:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.933798:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:2005:x1830881272976640:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2165us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.933806:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14343 00000100:00100000:0.0:1746065138.933836:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.934044:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272976896 00000100:00100000:1.0:1746065138.934051:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272976896 00002000:00100000:1.0:1746065138.934075:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36f800 x1830881272976896/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.934116:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36f800 with x1830881272976896 ext(0->4095) 00002000:00010000:1.0:1746065138.934120:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36f800 00000100:00100000:1.0:1746065138.934133:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13628 00000100:00100000:1.0:1746065138.934138:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272976896:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.934221:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272976896:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 83us (387us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.934226:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13628 00002000:00100000:1.0:1746065138.934230:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36f800 x1830881272976896/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.934236:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36f800 with x1830881272976896 ext(0->4095) 00002000:00010000:1.0:1746065138.934238:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36f800 00000100:00100000:0.0:1746065138.935603:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.935675:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272977024 00000100:00100000:1.0:1746065138.935679:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272977024 00000100:00100000:1.0:1746065138.935720:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30372 00000100:00100000:1.0:1746065138.935726:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:1795:x1830881272977024:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.935736:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.935752:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d96 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.935773:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.935781:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.935783:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.935786:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.935808:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.935818:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.935829:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267693312:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.936508:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.937181:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.937742:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272977152 00000100:00100000:3.0:1746065138.937748:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272977152 00000100:00100000:3.0:1746065138.937784:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30373 00000100:00100000:3.0:1746065138.937790:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1791:x1830881272977152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.937800:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.937810:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5d9d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.937825:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.937828:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 96 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.937832:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.937835:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 96 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.937860:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 96 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.937870:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 96 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.937879:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065138.937910:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:1791:x1830881272977152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 120us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.937915:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30373 00000100:00100000:1.0:1746065138.938396:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267693312:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.938409:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 95 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.938418:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065138.938433:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1795:x1830881272977024:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2708us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.938438:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30372 00000100:00100000:0.0:1746065138.938558:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.938574:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272977280 00000100:00100000:2.0:1746065138.938577:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272977280 00010000:00010000:2.0:1746065138.938590:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.938621:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14344 00000100:00100000:2.0:1746065138.938626:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272977280:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.938633:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.938647:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.938660:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.938675:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe1e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d8f expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.938696:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.938697:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.938702:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.938708:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.938726:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.938736:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.938745:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267693568:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.938778:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.940134:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.940179:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272977536 00000100:00100000:3.0:1746065138.940184:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272977536 00002000:00100000:3.0:1746065138.940206:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36d180 x1830881272977536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.940214:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36d180 with x1830881272977536 ext(0->4095) 00010000:00010000:3.0:1746065138.940220:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.940230:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065138.940234:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36d180 00000100:00100000:3.0:1746065138.940250:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2872 00000100:00100000:2.0:1746065138.940253:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267693568:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.940254:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2002:x1830881272977536:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00010000:00010000:2.0:1746065138.940263:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.940293:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272977280:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1665us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.940305:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14344 00000100:00100000:3.0:1746065138.940339:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2002:x1830881272977536:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 84us (207us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.940345:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2872 00002000:00100000:3.0:1746065138.940350:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36d180 x1830881272977536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.940356:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36d180 with x1830881272977536 ext(0->4095) 00010000:00010000:3.0:1746065138.940359:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.940368:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065138.940373:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36d180 00000100:00100000:0.0:1746065138.941899:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.941960:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272977664 00000100:00100000:1.0:1746065138.941965:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272977664 00000100:00100000:0.0:1746065138.941980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.941998:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30374 00000100:00100000:1.0:1746065138.942004:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272977664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.942016:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.942028:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5da4 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.942044:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746065138.942048:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272977792 00010000:00010000:1.0:1746065138.942049:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.942052:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272977792 00010000:00010000:1.0:1746065138.942054:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065138.942057:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.942064:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065138.942095:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.942100:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14345 00000100:00100000:2.0:1746065138.942105:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2005:x1830881272977792:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.942106:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.942112:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.942113:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00010000:00010000:2.0:1746065138.942124:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.942132:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.942136:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272977664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 132us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.942140:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30374 00010000:00010000:2.0:1746065138.942147:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d96 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.942155:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.942157:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.942161:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.942167:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.942183:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.942192:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.942199:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267693824:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.942567:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.942896:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267693824:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.942906:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.942932:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272977792:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 827us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.942964:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14345 00000100:00100000:0.0:1746065138.943888:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.944030:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272978048 00000100:00100000:3.0:1746065138.944076:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272978048 00002000:00100000:3.0:1746065138.944136:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36ca80 x1830881272978048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.944145:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36ca80 with x1830881272978048 ext(0->4095) 00010000:00010000:3.0:1746065138.944150:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.944163:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065138.944168:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36ca80 00000100:00100000:3.0:1746065138.944181:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2873 00000100:00100000:3.0:1746065138.944187:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272978048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.944285:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272978048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 97us (397us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.944290:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2873 00002000:00100000:3.0:1746065138.944295:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36ca80 x1830881272978048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.944301:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36ca80 with x1830881272978048 ext(0->4095) 00010000:00010000:3.0:1746065138.944305:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.944385:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065138.944392:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36ca80 00000100:00100000:0.0:1746065138.945614:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.945682:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.945736:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272978304 00000100:00100000:1.0:1746065138.945741:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272978304 00000100:00100000:2.0:1746065138.945763:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272978176 00000100:00100000:2.0:1746065138.945767:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272978176 00000100:00100000:1.0:1746065138.945779:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30375 00010000:00010000:2.0:1746065138.945783:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.945786:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1791:x1830881272978304:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.945795:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065138.945802:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14346 00010000:00010000:1.0:1746065138.945806:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5dab expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.945807:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2003:x1830881272978176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.945815:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.945824:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.945829:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.945834:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065138.945837:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 96 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.946023:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.946033:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065138.946046:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.946048:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87fe2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5d9d expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065138.946058:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 95 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.946059:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.946060:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.946065:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.946072:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.946101:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fe00, rc 0) 00010000:00010000:2.0:1746065138.946113:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.946123:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.946128:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1791:x1830881272978304:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 343us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.946133:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267694080:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065138.946133:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30375 00000100:00100000:2.0:1746065138.946178:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.947624:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.947711:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267694080:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.947723:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.947748:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2003:x1830881272978176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1941us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.947756:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14346 00000100:00100000:2.0:1746065138.948283:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272978560 00000100:00100000:2.0:1746065138.948288:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272978560 00002000:00100000:2.0:1746065138.948313:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3ea00 x1830881272978560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.948321:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3ea00 with x1830881272978560 ext(0->4095) 00010000:00010000:2.0:1746065138.948327:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.948337:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065138.948348:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3ea00 00000100:00100000:2.0:1746065138.948374:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2874 00000100:00100000:2.0:1746065138.948380:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272978560:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065138.948505:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272978560:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 124us (883us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.948510:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2874 00002000:00100000:2.0:1746065138.948515:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3ea00 x1830881272978560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.948520:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3ea00 with x1830881272978560 ext(0->4095) 00010000:00010000:2.0:1746065138.948523:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.948529:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065138.948533:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3ea00 00000100:00100000:3.0:1746065138.950804:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.950928:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272978688 00000100:00100000:2.0:1746065138.950943:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272978688 00010000:00010000:2.0:1746065138.950966:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.951104:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14347 00000100:00100000:2.0:1746065138.951111:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272978688:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.951122:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.951136:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.951146:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.951163:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f87fe33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5da4 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.951391:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.951394:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.951401:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.951408:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.951434:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.951444:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267694208:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.951695:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.953351:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267694208:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.953365:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.953530:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272978688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2418us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.953539:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14347 00000100:00100000:0.0:1746065138.955381:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.955504:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272978944 00000100:00100000:2.0:1746065138.955512:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272978944 00002000:00100000:2.0:1746065138.955545:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017a300 x1830881272978944/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.955553:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017a300 with x1830881272978944 ext(0->4095) 00002000:00010000:2.0:1746065138.955557:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017a300 00000100:00100000:2.0:1746065138.955584:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13629 00000100:00100000:2.0:1746065138.955591:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2002:x1830881272978944:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746065138.955697:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2002:x1830881272978944:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 107us (320us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065138.955703:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13629 00002000:00100000:2.0:1746065138.955708:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017a300 x1830881272978944/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.955715:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017a300 with x1830881272978944 ext(0->4095) 00002000:00010000:2.0:1746065138.955717:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017a300 00000100:00100000:0.0:1746065138.956813:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.956957:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272979072 00000100:00100000:1.0:1746065138.956962:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272979072 00000100:00100000:1.0:1746065138.957173:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30376 00000100:00100000:1.0:1746065138.957179:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272979072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.957190:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.957202:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5db2 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.957227:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.957233:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.957234:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.957237:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.957261:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.957271:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 93 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.957281:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267694336:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.957356:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.958636:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267694336:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065138.958654:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.958665:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065138.958701:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272979072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1522us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.958707:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30376 00000100:00100000:1.0:1746065138.959209:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065138.959221:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267694464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746065138.959249:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.959427:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.959529:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272979200 00000100:00100000:3.0:1746065138.959534:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272979200 00010000:00010000:3.0:1746065138.959552:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.959585:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14348 00000100:00100000:3.0:1746065138.959590:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2004:x1830881272979200:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.959600:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.959615:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.959624:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.959641:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fe00/0x392ae0376f87fe3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dab expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.959653:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.959654:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.959659:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.959665:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.959684:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.959692:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267694592:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.959880:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.960038:0:8373:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267694464 00000100:00100000:2.0:1746065138.960042:0:8373:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267694464 00000100:00100000:2.0:1746065138.960072:0:8373:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1746065138.960076:0:8373:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267694464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746065138.960169:0:8373:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446187008 avail 1316724736 00000100:00100000:2.0:1746065138.960245:0:8373:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267694464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.960250:0:8373:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1746065138.960310:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267694464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746065138.961259:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267694592:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.961269:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.961295:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:2004:x1830881272979200:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1704us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.961304:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14348 00000100:00100000:0.0:1746065138.961638:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.961747:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272979456 00000100:00100000:3.0:1746065138.961751:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272979456 00002000:00100000:3.0:1746065138.961772:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0700 x1830881272979456/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.961780:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0700 with x1830881272979456 ext(0->4095) 00002000:00010000:3.0:1746065138.961783:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f0700 00000100:00100000:3.0:1746065138.961808:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13630 00000100:00100000:3.0:1746065138.961813:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272979456:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.962244:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272979456:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 430us (606us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.962250:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13630 00002000:00100000:3.0:1746065138.962258:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0700 x1830881272979456/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.962265:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0700 with x1830881272979456 ext(0->4095) 00002000:00010000:3.0:1746065138.962267:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f0700 00000100:00100000:0.0:1746065138.963710:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.963756:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272979584 00000100:00100000:1.0:1746065138.963762:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272979584 00000100:00100000:1.0:1746065138.963793:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30377 00000100:00100000:1.0:1746065138.963798:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:1795:x1830881272979584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.963807:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.963819:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5db9 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.963837:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.963844:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.963845:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.963848:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.963870:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.963880:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065138.963889:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267694720:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065138.963954:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.965238:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.965272:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272979712 00000100:00100000:3.0:1746065138.965277:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272979712 00000100:00100000:3.0:1746065138.965295:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30378 00000100:00100000:3.0:1746065138.965300:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1791:x1830881272979712:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.965307:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.965394:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5dc0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.965420:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267694720:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.965539:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.965547:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 96 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.965553:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.965555:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 96 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.965574:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 96 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.965583:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 96 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.965592:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065138.965624:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:1791:x1830881272979712:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 323us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.965629:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30378 00010000:00010000:1.0:1746065138.965670:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 95 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.965677:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:1.0:1746065138.965692:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1795:x1830881272979584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1894us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.965696:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30377 00000100:00100000:0.0:1746065138.966572:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.966642:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272979840 00000100:00100000:3.0:1746065138.966646:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272979840 00010000:00010000:3.0:1746065138.966662:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.966930:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14349 00000100:00100000:3.0:1746065138.966950:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5945850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272979840:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.966959:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.966974:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.966983:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.966997:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db2 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.967022:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.967023:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.967028:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.967034:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.967052:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.967062:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.967071:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267694976:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.967511:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.969114:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267694976:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065138.969117:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065138.969128:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.969155:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5945850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272979840:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2206us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.969163:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14349 00000100:00100000:2.0:1746065138.969239:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272980096 00000100:00100000:2.0:1746065138.969244:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272980096 00002000:00100000:2.0:1746065138.969273:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1f800 x1830881272980096/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065138.969282:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f800 with x1830881272980096 ext(0->4095) 00010000:00010000:2.0:1746065138.969288:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.969298:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065138.969303:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1f800 00000100:00100000:1.0:1746065138.969352:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2875 00000100:00100000:1.0:1746065138.969360:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2005:x1830881272980096:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065138.969458:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2005:x1830881272980096:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 99us (343us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.969464:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2875 00002000:00100000:1.0:1746065138.969469:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1f800 x1830881272980096/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.969476:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f800 with x1830881272980096 ext(0->4095) 00010000:00010000:1.0:1746065138.969481:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065138.969490:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065138.969495:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1f800 00000100:00100000:0.0:1746065138.971778:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.972175:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272980224 00000100:00100000:1.0:1746065138.972182:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272980224 00000100:00100000:0.0:1746065138.972229:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.972261:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30379 00000100:00100000:1.0:1746065138.972268:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272980224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:2.0:1746065138.972274:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272980352 00000100:00100000:2.0:1746065138.972278:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272980352 00010000:00010000:1.0:1746065138.972281:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065138.972295:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065138.972298:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5dc7 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.972316:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.972321:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.972325:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14350 00010000:00010000:1.0:1746065138.972327:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:2.0:1746065138.972330:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2005:x1830881272980352:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.972330:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.972337:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.972351:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065138.972357:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.972360:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065138.972377:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.972385:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065138.972416:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272980224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 149us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.972421:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30379 00010000:00010000:2.0:1746065138.972555:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fe48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5db9 expref: 95 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.972573:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.972575:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.972580:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.972587:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.972676:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.972686:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.972697:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267695232:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.972766:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.974366:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267695232:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.974380:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.974428:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272980352:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2097us (2199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.974436:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14350 00000100:00100000:0.0:1746065138.974625:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.974662:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272980608 00000100:00100000:3.0:1746065138.974666:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272980608 00002000:00100000:3.0:1746065138.974691:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ca80 x1830881272980608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.974699:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ca80 with x1830881272980608 ext(0->4095) 00010000:00010000:3.0:1746065138.974704:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.974715:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065138.974721:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ca80 00000100:00100000:3.0:1746065138.974746:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2876 00000100:00100000:3.0:1746065138.974751:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272980608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.974833:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272980608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 82us (209us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.974836:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2876 00002000:00100000:3.0:1746065138.974839:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ca80 x1830881272980608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.974844:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ca80 with x1830881272980608 ext(0->4095) 00010000:00010000:3.0:1746065138.974847:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.974855:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065138.974858:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ca80 00000100:00100000:0.0:1746065138.976672:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065138.976741:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.976855:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272980736 00000100:00100000:1.0:1746065138.976861:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272980736 00000100:00100000:1.0:1746065138.976900:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30380 00000100:00100000:1.0:1746065138.976906:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:1791:x1830881272980736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065138.976917:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.976929:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5dce expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.976959:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.976964:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.976969:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065138.976972:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 95 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.977001:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.977011:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 95 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.977018:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065138.977056:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1791:x1830881272980736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 150us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.977060:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30380 00000100:00100000:2.0:1746065138.977279:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272980864 00000100:00100000:2.0:1746065138.977283:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272980864 00010000:00010000:2.0:1746065138.977299:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.977328:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14351 00000100:00100000:2.0:1746065138.977334:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2003:x1830881272980864:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.977344:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.977359:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.977368:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.977383:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87fe4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc0 expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.977394:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.977396:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.977401:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.977407:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.977425:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.977435:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.977443:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267695488:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.977538:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.979374:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267695488:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.979389:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.979428:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2003:x1830881272980864:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2093us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.979435:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14351 00000100:00100000:0.0:1746065138.980184:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065138.980280:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272981120 00000100:00100000:1.0:1746065138.980286:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272981120 00002000:00100000:1.0:1746065138.980320:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728380 x1830881272981120/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.980329:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728380 with x1830881272981120 ext(0->4095) 00010000:00010000:1.0:1746065138.980336:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065138.980348:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065138.980354:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f728380 00000100:00100000:1.0:1746065138.980379:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2877 00000100:00100000:1.0:1746065138.980385:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272981120:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065138.980499:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272981120:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 110us (312us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065138.980504:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2877 00002000:00100000:1.0:1746065138.980510:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728380 x1830881272981120/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065138.980516:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728380 with x1830881272981120 ext(0->4095) 00010000:00010000:1.0:1746065138.980521:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065138.980529:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065138.980534:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f728380 00000100:00100000:0.0:1746065138.983425:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.983550:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272981248 00000100:00100000:2.0:1746065138.983558:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272981248 00010000:00010000:2.0:1746065138.983583:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065138.983618:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14352 00000100:00100000:2.0:1746065138.983625:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272981248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.983636:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065138.983651:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.983662:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.983683:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f87fe56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dc7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.983703:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.983705:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.983711:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.983718:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.983745:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.983756:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267695616:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.984313:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065138.985656:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267695616:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.985672:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.985700:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272981248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2075us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.985708:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14352 00000100:00100000:0.0:1746065138.986763:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.986889:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272981504 00000100:00100000:3.0:1746065138.986895:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272981504 00002000:00100000:3.0:1746065138.986926:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c323b80 x1830881272981504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.986947:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323b80 with x1830881272981504 ext(0->4095) 00002000:00010000:3.0:1746065138.986952:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c323b80 00000100:00100000:3.0:1746065138.986975:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13631 00000100:00100000:3.0:1746065138.986982:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2004:x1830881272981504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.987101:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2004:x1830881272981504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 119us (339us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.987106:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13631 00002000:00100000:3.0:1746065138.987111:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c323b80 x1830881272981504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.987117:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323b80 with x1830881272981504 ext(0->4095) 00002000:00010000:3.0:1746065138.987119:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c323b80 00000100:00100000:0.0:1746065138.988359:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.988431:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272981632 00000100:00100000:3.0:1746065138.988435:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272981632 00000100:00100000:3.0:1746065138.988471:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30381 00000100:00100000:3.0:1746065138.988481:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272981632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.988496:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.988509:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5dd5 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.988529:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.988535:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.988537:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.988540:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.988562:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.988571:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 93 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.988581:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267695744:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.988653:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.989706:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267695744:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065138.989723:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.989733:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065138.989762:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272981632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1282us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.989771:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30381 00000100:00100000:0.0:1746065138.989870:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.989946:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272981760 00000100:00100000:3.0:1746065138.989951:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272981760 00010000:00010000:3.0:1746065138.989967:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.989985:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14353 00000100:00100000:3.0:1746065138.989990:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2004:x1830881272981760:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065138.989998:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.990012:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.990021:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.990044:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87fe5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dce expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.990068:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.990069:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.990074:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.990109:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.990130:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065138.990165:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267695872:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065138.990216:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065138.991193:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267695872:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065138.991202:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065138.991223:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:2004:x1830881272981760:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1232us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065138.991229:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14353 00000100:00100000:0.0:1746065138.992011:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.992070:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272982016 00000100:00100000:3.0:1746065138.992075:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272982016 00002000:00100000:3.0:1746065138.992116:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04000 x1830881272982016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.992128:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04000 with x1830881272982016 ext(0->4095) 00002000:00010000:3.0:1746065138.992132:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04000 00000100:00100000:3.0:1746065138.992239:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13632 00000100:00100000:3.0:1746065138.992246:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272982016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065138.992438:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272982016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 192us (427us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.992444:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13632 00002000:00100000:3.0:1746065138.992449:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04000 x1830881272982016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.992455:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04000 with x1830881272982016 ext(0->4095) 00002000:00010000:3.0:1746065138.992457:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04000 00000100:00100000:0.0:1746065138.993649:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.993719:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272982144 00000100:00100000:3.0:1746065138.993724:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272982144 00000100:00100000:3.0:1746065138.993751:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30382 00000100:00100000:3.0:1746065138.993756:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:1795:x1830881272982144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.993766:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.993778:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ddc expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.993795:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.993801:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.993802:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065138.993805:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.993825:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.993835:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.993844:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267696000:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065138.993906:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.996421:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065138.996479:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272982272 00000100:00100000:2.0:1746065138.996485:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272982272 00010000:00010000:2.0:1746065138.996507:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.996512:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267696000:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.996528:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14354 00010000:00010000:3.0:1746065138.996531:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.996533:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272982272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065138.996542:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065138.996549:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00010000:00010000:2.0:1746065138.996555:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.996564:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.996580:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87fe64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dd5 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.996592:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:1795:x1830881272982144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2835us (2944us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065138.996593:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065138.996594:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065138.996599:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30382 00010000:00010000:2.0:1746065138.996599:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.996606:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065138.996627:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065138.996637:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267696128:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065138.996682:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.997701:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.997877:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272982400 00000100:00100000:3.0:1746065138.997881:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272982400 00000100:00100000:3.0:1746065138.997913:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30383 00000100:00100000:3.0:1746065138.997919:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:1791:x1830881272982400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065138.998077:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065138.998112:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5de3 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.998130:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.998136:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.998137:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065138.998140:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.998157:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.998166:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065138.998179:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267696256:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065138.998425:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267696128:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065138.998436:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065138.998456:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272982272:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1923us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.998463:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14354 00000100:00100000:3.0:1746065138.998786:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.999176:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065138.999265:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272982656 00000100:00100000:3.0:1746065138.999269:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272982656 00002000:00100000:3.0:1746065138.999292:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc11500 x1830881272982656/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065138.999301:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc11500 with x1830881272982656 ext(0->4095) 00010000:00010000:3.0:1746065138.999307:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065138.999317:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065138.999323:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc11500 00000100:00100000:3.0:1746065138.999346:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2878 00000100:00100000:3.0:1746065138.999352:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:2005:x1830881272982656:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065138.999443:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:2005:x1830881272982656:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 90us (266us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065138.999448:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2878 00002000:00100000:3.0:1746065138.999453:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc11500 x1830881272982656/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746065138.999456:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267696256:192.168.202.8@tcp:104: 00002000:00100000:3.0:1746065138.999460:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc11500 with x1830881272982656 ext(0->4095) 00010000:00010000:3.0:1746065138.999464:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065138.999470:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 96 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065138.999473:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065138.999479:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc11500 00010000:00010000:2.0:1746065138.999480:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:2.0:1746065138.999501:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1791:x1830881272982400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1583us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065138.999510:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30383 00000100:00100000:0.0:1746065139.001167:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.001219:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.001293:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272982912 00000100:00100000:3.0:1746065139.001297:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272982912 00010000:00010000:3.0:1746065139.001314:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.001337:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14355 00000100:00100000:3.0:1746065139.001343:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2004:x1830881272982912:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.001352:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.001364:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.001373:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.001391:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87fe6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ddc expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.001457:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.001459:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.001466:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.001477:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.001499:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.001500:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272982784 00000100:00100000:2.0:1746065139.001504:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272982784 00000100:00100000:3.0:1746065139.001508:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267696384:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.001529:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30384 00000100:00100000:2.0:1746065139.001535:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272982784:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.001543:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.001551:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5dea expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.001565:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00010000:00010000:2.0:1746065139.001565:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.001570:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.001571:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.001573:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.001587:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.001596:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.001603:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267696512:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.001622:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.002405:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267696512:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.002407:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267696384:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.002417:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065139.002422:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.002430:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:3.0:1746065139.002441:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2004:x1830881272982912:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1098us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.002447:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272982784:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 913us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.002448:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14355 00000100:00100000:2.0:1746065139.002453:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30384 00000100:00100000:0.0:1746065139.002799:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.002872:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272983168 00000100:00100000:3.0:1746065139.002880:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272983168 00002000:00100000:3.0:1746065139.002900:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b30700 x1830881272983168/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.002908:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b30700 with x1830881272983168 ext(0->4095) 00010000:00010000:3.0:1746065139.002913:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.002922:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.002927:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b30700 00000100:00100000:3.0:1746065139.002959:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2879 00000100:00100000:3.0:1746065139.002965:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272983168:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.003045:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272983168:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 80us (246us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.003051:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2879 00002000:00100000:3.0:1746065139.003055:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b30700 x1830881272983168/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.003062:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b30700 with x1830881272983168 ext(0->4095) 00010000:00010000:3.0:1746065139.003066:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.003074:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.003100:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b30700 00000100:00100000:0.0:1746065139.004117:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.004167:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272983296 00000100:00100000:2.0:1746065139.004171:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272983296 00000100:00100000:2.0:1746065139.004192:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30385 00000100:00100000:2.0:1746065139.004198:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:1791:x1830881272983296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.004206:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.004216:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5df1 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.004221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065139.004230:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.004236:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.004241:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065139.004244:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.004270:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.004278:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272983424 00010000:00010000:2.0:1746065139.004279:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.004281:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272983424 00010000:00010000:2.0:1746065139.004290:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00010000:00010000:3.0:1746065139.004294:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.004317:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:1791:x1830881272983296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 119us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.004321:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14356 00000100:00100000:2.0:1746065139.004322:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30385 00000100:00100000:3.0:1746065139.004326:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5945450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:2002:x1830881272983424:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.004333:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.004343:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.004356:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.004370:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87fe72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5de3 expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.004378:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.004380:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.004384:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.004391:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.004407:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.004416:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.004425:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267696768:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.004475:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.005651:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267696768:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.005667:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.005696:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5945450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2002:x1830881272983424:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1369us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.005705:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14356 00000100:00100000:0.0:1746065139.005746:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.005830:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272983680 00000100:00100000:2.0:1746065139.005835:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272983680 00002000:00100000:2.0:1746065139.005855:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b30e00 x1830881272983680/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.005864:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b30e00 with x1830881272983680 ext(0->4095) 00010000:00010000:2.0:1746065139.005869:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.005879:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.005884:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b30e00 00000100:00100000:2.0:1746065139.005906:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2880 00000100:00100000:2.0:1746065139.005912:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272983680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.006016:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272983680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 104us (270us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.006021:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2880 00002000:00100000:2.0:1746065139.006026:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b30e00 x1830881272983680/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.006039:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b30e00 with x1830881272983680 ext(0->4095) 00010000:00010000:2.0:1746065139.006043:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.006051:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.006056:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b30e00 00000100:00100000:0.0:1746065139.007235:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.007334:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272983808 00000100:00100000:3.0:1746065139.007338:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272983808 00010000:00010000:3.0:1746065139.007355:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.007381:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14357 00000100:00100000:3.0:1746065139.007386:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272983808:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.007393:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.007404:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.007413:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.007429:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fe79 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dea expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.007444:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.007446:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.007450:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.007458:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.007477:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.007485:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267696896:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.007543:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.008719:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267696896:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.008731:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.008766:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272983808:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1380us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.008773:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14357 00000100:00100000:0.0:1746065139.009557:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.009630:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272984064 00000100:00100000:2.0:1746065139.009635:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272984064 00002000:00100000:2.0:1746065139.009661:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b31500 x1830881272984064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.009670:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b31500 with x1830881272984064 ext(0->4095) 00002000:00010000:2.0:1746065139.009674:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b31500 00000100:00100000:2.0:1746065139.009749:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13633 00000100:00100000:2.0:1746065139.009756:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272984064:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.010050:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272984064:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 293us (493us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.010056:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13633 00002000:00100000:2.0:1746065139.010061:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b31500 x1830881272984064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.010068:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b31500 with x1830881272984064 ext(0->4095) 00002000:00010000:2.0:1746065139.010071:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b31500 00000100:00100000:0.0:1746065139.012609:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.012785:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272984192 00000100:00100000:2.0:1746065139.012792:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272984192 00000100:00100000:2.0:1746065139.012823:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30386 00000100:00100000:2.0:1746065139.012829:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272984192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.012842:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.013127:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5df8 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.013150:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.013158:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.013159:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.013162:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.013184:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.013195:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 93 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.013205:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267697024:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.013280:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.016372:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267697024:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065139.016379:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065139.016392:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.016406:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065139.016437:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272984192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3608us (3835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.016444:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30386 00000100:00100000:3.0:1746065139.016462:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272984320 00000100:00100000:3.0:1746065139.016467:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272984320 00010000:00010000:3.0:1746065139.016489:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.016632:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14358 00000100:00100000:3.0:1746065139.016639:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272984320:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.016649:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.016663:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.016674:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.016691:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df1 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.016704:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.016706:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.016712:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.016718:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.016740:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.016749:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267697152:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.016798:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.018609:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.018639:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267697152:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.018650:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.018653:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272984576 00000100:00100000:2.0:1746065139.018658:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272984576 00002000:00100000:2.0:1746065139.018684:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b31f80 x1830881272984576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065139.018688:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:2005:x1830881272984320:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2048us (2309us total) trans 0 rc 0/0 00002000:00100000:2.0:1746065139.018693:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b31f80 with x1830881272984576 ext(0->4095) 00000100:00100000:3.0:1746065139.018694:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14358 00002000:00010000:2.0:1746065139.018696:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b31f80 00000100:00100000:2.0:1746065139.018713:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13634 00000100:00100000:2.0:1746065139.018720:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272984576:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.018809:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272984576:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 89us (202us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.018814:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13634 00002000:00100000:2.0:1746065139.018818:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b31f80 x1830881272984576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.018824:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b31f80 with x1830881272984576 ext(0->4095) 00002000:00010000:2.0:1746065139.018827:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b31f80 00000100:00100000:0.0:1746065139.019626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.019690:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272984704 00000100:00100000:2.0:1746065139.019693:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272984704 00000100:00100000:2.0:1746065139.019711:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30387 00000100:00100000:2.0:1746065139.019716:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:1791:x1830881272984704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.019724:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.019734:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5dff expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.019755:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.019761:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.019762:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.019765:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.019782:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.019792:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.019806:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267697280:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.020099:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.020225:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.020283:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272984832 00000100:00100000:2.0:1746065139.020287:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272984832 00000100:00100000:2.0:1746065139.020306:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30388 00000100:00100000:2.0:1746065139.020310:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1795:x1830881272984832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.020316:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.020323:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e06 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.020333:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.020336:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 96 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.020341:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.020344:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 96 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.020360:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 96 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.020368:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 96 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.020376:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065139.020397:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:1795:x1830881272984832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 86us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.020402:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30388 00000100:00100000:2.0:1746065139.021013:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267697280:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.021025:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.021032:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065139.021059:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1791:x1830881272984704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1342us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.021064:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30387 00000100:00100000:0.0:1746065139.021590:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.021650:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272984960 00000100:00100000:3.0:1746065139.021653:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272984960 00010000:00010000:3.0:1746065139.021665:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.021686:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14359 00000100:00100000:3.0:1746065139.021690:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272984960:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.021695:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.021706:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.021715:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.021726:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fe87 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5df8 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.021743:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.021744:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.021748:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.021752:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.021765:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.021771:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.021777:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267697536:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.021812:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.023110:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267697536:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.023119:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.023136:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272984960:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1445us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.023145:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14359 00000100:00100000:0.0:1746065139.023534:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.023611:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272985216 00000100:00100000:2.0:1746065139.023616:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272985216 00002000:00100000:2.0:1746065139.023638:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b32d80 x1830881272985216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.023651:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b32d80 with x1830881272985216 ext(0->4095) 00010000:00010000:2.0:1746065139.023656:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.023667:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.023672:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b32d80 00000100:00100000:2.0:1746065139.023692:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2881 00000100:00100000:2.0:1746065139.023697:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2004:x1830881272985216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.023780:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2004:x1830881272985216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 83us (247us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.023784:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2881 00002000:00100000:2.0:1746065139.023788:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b32d80 x1830881272985216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.023792:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b32d80 with x1830881272985216 ext(0->4095) 00010000:00010000:2.0:1746065139.023795:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.023801:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.023804:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b32d80 00000100:00100000:0.0:1746065139.025838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.025894:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272985344 00000100:00100000:3.0:1746065139.025900:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272985344 00010000:00010000:3.0:1746065139.026033:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.026064:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14360 00000100:00100000:3.0:1746065139.026068:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2002:x1830881272985344:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.026076:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.026112:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.026122:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.026138:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f87fe8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5dff expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.026252:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.026254:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.026260:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.026267:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.026292:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 94 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.026302:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267697664:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.026368:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.027872:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267697664:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.027884:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.027920:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2002:x1830881272985344:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1851us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.027928:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14360 00000100:00100000:0.0:1746065139.028008:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.028145:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272985600 00000100:00100000:2.0:1746065139.028151:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272985600 00002000:00100000:2.0:1746065139.028172:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b33480 x1830881272985600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.028179:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b33480 with x1830881272985600 ext(0->4095) 00002000:00010000:2.0:1746065139.028182:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b33480 00000100:00100000:2.0:1746065139.028203:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13635 00000100:00100000:2.0:1746065139.028207:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2003:x1830881272985600:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746065139.028296:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2003:x1830881272985600:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 89us (290us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.028300:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13635 00002000:00100000:2.0:1746065139.028303:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b33480 x1830881272985600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.028307:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b33480 with x1830881272985600 ext(0->4095) 00002000:00010000:2.0:1746065139.028309:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b33480 00000100:00100000:2.0:1746065139.029803:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.029924:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272985728 00000100:00100000:0.0:1746065139.029929:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272985728 00000100:00100000:0.0:1746065139.029963:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30389 00000100:00100000:0.0:1746065139.029968:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272985728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065139.029977:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.029988:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e0d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.030007:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.030014:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065139.030015:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065139.030018:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.030039:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 93 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.030049:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 93 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065139.030057:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267697792:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065139.030297:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.031043:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267697792:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.031058:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.031067:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f846600, rc 0) 00000100:00100000:2.0:1746065139.031117:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272985728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1148us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.031122:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30389 00000100:00100000:0.0:1746065139.031436:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.031501:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272985856 00000100:00100000:3.0:1746065139.031505:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272985856 00010000:00010000:3.0:1746065139.031522:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.031547:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14361 00000100:00100000:3.0:1746065139.031553:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272985856:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.031560:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.031574:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.031582:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.031598:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fe95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e06 expref: 94 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.031616:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.031618:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.031622:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.031629:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.031648:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.031660:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267697920:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.031714:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.033002:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267697920:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.033012:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.033044:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:2005:x1830881272985856:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1491us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.033050:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14361 00000100:00100000:0.0:1746065139.033212:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.033277:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272986112 00000100:00100000:3.0:1746065139.033281:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272986112 00002000:00100000:3.0:1746065139.033301:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b33800 x1830881272986112/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.033310:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b33800 with x1830881272986112 ext(0->4095) 00002000:00010000:3.0:1746065139.033313:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b33800 00000100:00100000:3.0:1746065139.033337:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13636 00000100:00100000:3.0:1746065139.033343:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272986112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.033579:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272986112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 236us (367us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.033586:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13636 00002000:00100000:3.0:1746065139.033591:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b33800 x1830881272986112/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.033598:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b33800 with x1830881272986112 ext(0->4095) 00002000:00010000:3.0:1746065139.033601:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b33800 00000100:00100000:0.0:1746065139.034855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.034919:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272986240 00000100:00100000:2.0:1746065139.034924:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272986240 00000100:00100000:2.0:1746065139.034964:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30390 00000100:00100000:2.0:1746065139.034970:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+93:1795:x1830881272986240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.034978:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.034989:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e14 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.035006:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.035013:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.035015:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.035018:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.035038:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.035047:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.035056:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267698048:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.035129:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.036316:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267698048:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.036333:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 94 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.036343:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065139.036366:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:1795:x1830881272986240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1396us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.036371:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30390 00000100:00100000:1.0:1746065139.036475:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.036549:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272986368 00000100:00100000:3.0:1746065139.036554:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272986368 00010000:00010000:3.0:1746065139.036571:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.036598:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14362 00000100:00100000:3.0:1746065139.036604:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272986368:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.036613:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.036626:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.036635:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.036648:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f87fe9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e0d expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.036657:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.036658:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.036663:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.036673:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.036691:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.036699:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267698176:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.036752:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.037818:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267698176:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.037827:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065139.037828:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.037853:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272986368:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1249us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.037859:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14362 00000100:00100000:2.0:1746065139.038017:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272986624 00000100:00100000:2.0:1746065139.038022:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272986624 00002000:00100000:2.0:1746065139.038042:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72bb80 x1830881272986624/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.038050:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72bb80 with x1830881272986624 ext(0->4095) 00002000:00010000:2.0:1746065139.038053:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72bb80 00000100:00100000:2.0:1746065139.038073:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13637 00000100:00100000:2.0:1746065139.038078:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272986624:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.038190:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2005:x1830881272986624:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 111us (361us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.038196:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13637 00002000:00100000:2.0:1746065139.038201:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72bb80 x1830881272986624/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.038207:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72bb80 with x1830881272986624 ext(0->4095) 00002000:00010000:2.0:1746065139.038210:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72bb80 00000100:00100000:1.0:1746065139.039203:0:3768:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065139.039213:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267698304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746065139.039241:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065139.039300:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267698304 00000100:00100000:2.0:1746065139.039304:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267698304 00000100:00100000:0.0:1746065139.039449:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.039488:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1746065139.039494:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267698304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746065139.039510:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 980040512 pending 0 free 3921227776 avail 3689705472 00000100:00100000:2.0:1746065139.039534:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267698304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.039542:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1746065139.039554:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272986752 00000100:00100000:2.0:1746065139.039557:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272986752 00000100:00100000:2.0:1746065139.039572:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30391 00000100:00100000:2.0:1746065139.039576:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272986752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.039582:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.039593:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e1b expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.039611:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.039617:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.039619:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.039621:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.039636:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 93 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.039645:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 93 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.039653:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267698432:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.039681:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746065139.039724:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065139.039862:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267698304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746065139.040547:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267698432:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.040560:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.040571:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065139.040592:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272986752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1015us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.040597:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30391 00000100:00100000:0.0:1746065139.040833:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.041070:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272986880 00000100:00100000:2.0:1746065139.041074:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272986880 00002000:00100000:2.0:1746065139.041323:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012d36c380 x1830881272986880/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.041332:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36c380 with x1830881272986880 ext(0->7) 00010000:00010000:2.0:1746065139.041337:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.041347:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 94 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.041352:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36c380 00000100:00100000:2.0:1746065139.041375:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2882 00000100:00100000:2.0:1746065139.041381:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+94:2004:x1830881272986880:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065139.042046:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:2004:x1830881272986880:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 663us (1210us total) trans 4294972110 rc 0/0 00000100:00100000:0.0:1746065139.042051:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2882 00002000:00100000:0.0:1746065139.042057:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012d36c380 x1830881272986880/t4294972110(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/448 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.042064:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36c380 with x1830881272986880 ext(0->7) 00010000:00010000:0.0:1746065139.042068:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.042076:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065139.042219:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d36c380 00000100:00100000:0.0:1746065139.044634:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.044823:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272987008 00000100:00100000:3.0:1746065139.044831:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272987008 00010000:00010000:3.0:1746065139.044856:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.045028:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14363 00000100:00100000:3.0:1746065139.045035:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5945050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:2004:x1830881272987008:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.045047:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.045061:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.045072:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.045123:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fea3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e14 expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.045136:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.045138:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.045144:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.045151:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.045255:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.045265:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267698560:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.045345:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.046568:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267698560:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.046580:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.046612:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5945050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:2004:x1830881272987008:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1577us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.046619:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14363 00000100:00100000:0.0:1746065139.047063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.047109:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272987264 00000100:00100000:2.0:1746065139.047114:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272987264 00002000:00100000:2.0:1746065139.047136:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36ea00 x1830881272987264/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.047145:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36ea00 with x1830881272987264 ext(0->4095) 00002000:00010000:2.0:1746065139.047148:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36ea00 00000100:00100000:2.0:1746065139.047161:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13638 00000100:00100000:2.0:1746065139.047165:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272987264:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746065139.047266:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272987264:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 99us (202us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.047271:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13638 00002000:00100000:2.0:1746065139.047276:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012d36ea00 x1830881272987264/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.047283:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d36ea00 with x1830881272987264 ext(0->4095) 00002000:00010000:2.0:1746065139.047286:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d36ea00 00000100:00100000:0.0:1746065139.048335:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.048391:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272987392 00000100:00100000:2.0:1746065139.048395:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272987392 00000100:00100000:2.0:1746065139.048416:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30392 00000100:00100000:2.0:1746065139.048422:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+95:1795:x1830881272987392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.048430:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.048442:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e22 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.048462:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.048623:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.048624:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.048628:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 96 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.048651:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.048661:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.048671:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267698688:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.048726:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.050706:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267698688:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.050725:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 96 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.050736:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065139.050945:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:1795:x1830881272987392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2511us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.050952:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30392 00000100:00100000:0.0:1746065139.052124:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.052206:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272987520 00000100:00100000:3.0:1746065139.052213:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272987520 00010000:00010000:3.0:1746065139.052236:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.052275:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14364 00000100:00100000:3.0:1746065139.052280:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272987520:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.052289:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.052303:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.052312:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.052327:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87feaa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e1b expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.052345:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.052347:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.052352:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.052357:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.052380:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.052389:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267698816:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.052439:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.053317:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267698816:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.053328:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.053357:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272987520:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1076us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.053364:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14364 00000100:00100000:0.0:1746065139.053784:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.053919:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272987776 00000100:00100000:2.0:1746065139.053923:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272987776 00002000:00100000:2.0:1746065139.053960:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a7800 x1830881272987776/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.053968:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7800 with x1830881272987776 ext(0->4095) 00002000:00010000:2.0:1746065139.053972:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a7800 00000100:00100000:2.0:1746065139.053995:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13639 00000100:00100000:2.0:1746065139.054004:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:2002:x1830881272987776:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746065139.054118:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:2002:x1830881272987776:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 113us (333us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.054126:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13639 00002000:00100000:2.0:1746065139.054131:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a7800 x1830881272987776/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.054138:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7800 with x1830881272987776 ext(0->4095) 00002000:00010000:2.0:1746065139.054141:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a7800 00000100:00100000:0.0:1746065139.055575:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.055614:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272987904 00000100:00100000:2.0:1746065139.055620:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272987904 00000100:00100000:2.0:1746065139.055647:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30393 00000100:00100000:2.0:1746065139.055652:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272987904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.055661:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.055672:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e29 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.055690:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.055696:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.055697:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.055700:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.055720:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 95 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.055730:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 95 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.055744:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267698944:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.055810:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.056738:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267698944:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.056755:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.056765:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065139.056800:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272987904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1147us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.056806:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30393 00000100:00100000:0.0:1746065139.057064:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.057130:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272988032 00000100:00100000:2.0:1746065139.057135:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272988032 00002000:00100000:3.0:1746065139.057279:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012f18ca80 x1830881272988032/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.057288:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18ca80 with x1830881272988032 ext(0->7) 00010000:00010000:3.0:1746065139.057292:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.057302:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 96 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.057308:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18ca80 00000100:00100000:3.0:1746065139.057328:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2883 00000100:00100000:3.0:1746065139.057333:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+96:2005:x1830881272988032:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065139.057995:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272988032:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 660us (931us total) trans 4294972111 rc 0/0 00000100:00100000:0.0:1746065139.058002:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2883 00002000:00100000:0.0:1746065139.058007:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012f18ca80 x1830881272988032/t4294972111(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/448 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.058014:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18ca80 with x1830881272988032 ext(0->7) 00010000:00010000:0.0:1746065139.058018:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.058032:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065139.058037:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18ca80 00000100:00100000:0.0:1746065139.060112:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.060172:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272988160 00000100:00100000:3.0:1746065139.060178:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272988160 00010000:00010000:3.0:1746065139.060196:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.060223:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14365 00000100:00100000:3.0:1746065139.060228:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2003:x1830881272988160:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.060236:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.060247:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.060255:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.060270:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87feb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e22 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.060283:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.060285:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.060290:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.060296:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.060319:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.060328:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267699072:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.060383:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.061557:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267699072:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.061568:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.061591:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2003:x1830881272988160:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1363us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.061599:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14365 00000100:00100000:0.0:1746065139.061898:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.062035:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272988416 00000100:00100000:2.0:1746065139.062040:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272988416 00002000:00100000:2.0:1746065139.062063:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008251e450 x1830881272988416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.062070:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008251e450 with x1830881272988416 ext(0->4095) 00002000:00010000:2.0:1746065139.062073:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008251e450 00000100:00100000:2.0:1746065139.062104:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13640 00000100:00100000:2.0:1746065139.062110:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008251e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272988416:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746065139.062281:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008251e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272988416:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 171us (382us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.062287:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13640 00002000:00100000:2.0:1746065139.062292:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008251e450 x1830881272988416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.062298:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008251e450 with x1830881272988416 ext(0->4095) 00002000:00010000:2.0:1746065139.062301:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008251e450 00000100:00100000:0.0:1746065139.065297:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.065398:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272988544 00000100:00100000:2.0:1746065139.065405:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272988544 00000100:00100000:2.0:1746065139.065432:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30394 00000100:00100000:2.0:1746065139.065438:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1795:x1830881272988544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.065451:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.065465:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e30 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.065487:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.065493:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.065495:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.065498:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.065521:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.065532:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.065543:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267699200:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.065769:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.067844:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267699200:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.067863:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.067875:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:0.0:1746065139.067896:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.067926:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272988672 00000100:00100000:0.0:1746065139.067930:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272988672 00000100:00100000:0.0:1746065139.067972:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30395 00000100:00100000:0.0:1746065139.067978:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881272988672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065139.067989:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.067998:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e37 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.068001:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881272988544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2476us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.068007:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30394 00010000:00010000:0.0:1746065139.068012:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.068016:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.068021:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065139.068024:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.068043:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.068055:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.068056:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:0.0:1746065139.068061:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f847a00, rc 0) 00000100:00100000:0.0:1746065139.068075:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881272988672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 98us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.068099:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30395 00000100:00100000:3.0:1746065139.068219:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272988800 00000100:00100000:3.0:1746065139.068222:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272988800 00010000:00010000:3.0:1746065139.068234:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.068247:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14366 00000100:00100000:3.0:1746065139.068250:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272988800:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.068255:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.068267:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.068274:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.068284:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87feb8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e29 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.068300:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.068301:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.068305:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.068310:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.068322:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.068328:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.068334:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267699456:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.068375:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.069310:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.069343:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272989056 00000100:00100000:2.0:1746065139.069347:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272989056 00002000:00100000:2.0:1746065139.069369:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a1c00 x1830881272989056/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.069377:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1c00 with x1830881272989056 ext(0->4095) 00010000:00010000:2.0:1746065139.069382:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.069391:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.069397:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a1c00 00000100:00100000:2.0:1746065139.069408:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2884 00000100:00100000:2.0:1746065139.069414:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881272989056:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.069515:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267699456:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.069520:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881272989056:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 105us (210us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746065139.069522:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.069530:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2884 00002000:00100000:2.0:1746065139.069534:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a1c00 x1830881272989056/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.069546:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1c00 with x1830881272989056 ext(0->4095) 00010000:00010000:2.0:1746065139.069551:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.069552:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272988800:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1300us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.069558:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14366 00010000:00010000:2.0:1746065139.069559:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.069564:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a1c00 00000100:00100000:0.0:1746065139.071353:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.071376:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272989184 00000100:00100000:2.0:1746065139.071382:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272989184 00000100:00100000:2.0:1746065139.071445:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30396 00000100:00100000:2.0:1746065139.071451:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272989184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.071459:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.071475:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e3e expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.071491:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.071495:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.071501:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065139.071503:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.071533:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.071545:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.071553:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065139.071586:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272989184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 135us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.071602:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30396 00000100:00100000:0.0:1746065139.071742:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.071790:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272989312 00000100:00100000:3.0:1746065139.071794:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272989312 00010000:00010000:3.0:1746065139.071810:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.071905:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14367 00000100:00100000:3.0:1746065139.071911:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2002:x1830881272989312:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.071919:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.071944:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.072212:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.072230:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87febf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e30 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.072254:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.072256:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.072261:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.072268:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.072287:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.072297:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.072307:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267699712:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.072358:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.073414:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267699712:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.073427:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.073458:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2002:x1830881272989312:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1547us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.073469:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14367 00000100:00100000:0.0:1746065139.073717:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.073787:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272989568 00000100:00100000:2.0:1746065139.073792:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272989568 00002000:00100000:2.0:1746065139.073818:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a1880 x1830881272989568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.073825:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1880 with x1830881272989568 ext(0->4095) 00010000:00010000:2.0:1746065139.073831:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.073841:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.073846:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a1880 00000100:00100000:2.0:1746065139.073871:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2885 00000100:00100000:2.0:1746065139.073876:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272989568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.073975:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272989568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (258us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.073981:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2885 00002000:00100000:2.0:1746065139.073997:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a1880 x1830881272989568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.074003:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1880 with x1830881272989568 ext(0->4095) 00010000:00010000:2.0:1746065139.074006:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.074014:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.074018:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a1880 00000100:00100000:0.0:1746065139.075135:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.075237:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272989696 00000100:00100000:2.0:1746065139.075242:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272989696 00000100:00100000:2.0:1746065139.075277:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30397 00000100:00100000:2.0:1746065139.075282:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881272989696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065139.075286:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065139.075291:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.075302:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e45 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.075320:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.075325:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.075331:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065139.075334:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.075361:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.075370:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.075377:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065139.075407:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881272989696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 124us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.075412:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30397 00000100:00100000:3.0:1746065139.075419:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272989824 00000100:00100000:3.0:1746065139.075423:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272989824 00010000:00010000:3.0:1746065139.075437:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.075466:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14368 00000100:00100000:3.0:1746065139.075481:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881272989824:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.075490:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.075501:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.075511:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.075662:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f847a00/0x392ae0376f87fec6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e37 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.075671:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.075673:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.075677:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.075685:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.075707:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.075719:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.075729:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267699968:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.075784:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.077352:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267699968:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.077363:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.077433:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272989824:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1952us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.077439:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14368 00000100:00100000:0.0:1746065139.077645:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.077727:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272990080 00000100:00100000:2.0:1746065139.077731:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272990080 00002000:00100000:2.0:1746065139.077753:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0380 x1830881272990080/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.077759:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0380 with x1830881272990080 ext(0->4095) 00010000:00010000:2.0:1746065139.077763:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.077771:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.077775:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a0380 00000100:00100000:2.0:1746065139.077784:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2886 00000100:00100000:2.0:1746065139.077788:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272990080:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.077866:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272990080:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 77us (222us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.077870:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2886 00002000:00100000:2.0:1746065139.077873:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0380 x1830881272990080/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.077878:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0380 with x1830881272990080 ext(0->4095) 00010000:00010000:2.0:1746065139.077880:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.077886:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.077889:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a0380 00000100:00100000:0.0:1746065139.079560:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.079608:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272990208 00000100:00100000:3.0:1746065139.079613:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272990208 00010000:00010000:3.0:1746065139.079632:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.079660:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14369 00000100:00100000:3.0:1746065139.079664:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272990208:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.079671:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.079682:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.079688:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.079703:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87fecd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e3e expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.079711:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.079712:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.079717:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.079722:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.079740:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.079747:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267700096:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.079799:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.081796:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.081902:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267700096:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.081915:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.082008:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272990464 00000100:00100000:3.0:1746065139.082010:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272990208:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2344us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.082013:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272990464 00000100:00100000:3.0:1746065139.082018:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14369 00002000:00100000:1.0:1746065139.082042:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f980e00 x1830881272990464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.082052:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980e00 with x1830881272990464 ext(0->4095) 00002000:00010000:1.0:1746065139.082055:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f980e00 00000100:00100000:1.0:1746065139.082078:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13641 00000100:00100000:1.0:1746065139.082099:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272990464:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.082192:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272990464:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 93us (400us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.082198:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13641 00002000:00100000:1.0:1746065139.082202:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f980e00 x1830881272990464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.082209:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980e00 with x1830881272990464 ext(0->4095) 00002000:00010000:1.0:1746065139.082211:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f980e00 00000100:00100000:0.0:1746065139.083947:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.083999:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272990592 00000100:00100000:2.0:1746065139.084005:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272990592 00000100:00100000:2.0:1746065139.084271:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30398 00000100:00100000:2.0:1746065139.084277:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272990592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.084289:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.084302:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e4c expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.084324:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.084330:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.084332:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.084335:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.084361:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.084371:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 97 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.084380:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267700224:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.084444:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.086146:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.086237:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267700224:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.086257:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272990720 00000100:00100000:3.0:1746065139.086262:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272990720 00010000:00010000:3.0:1746065139.086283:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.086285:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.086313:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14370 00010000:00010000:2.0:1746065139.086315:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:3.0:1746065139.086319:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5944c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272990720:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.086328:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065139.086342:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272990592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2065us (2414us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065139.086343:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.086348:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30398 00010000:00010000:3.0:1746065139.086353:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.086369:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f87fed4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e45 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.086378:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.086381:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.086386:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.086393:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.086414:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.086423:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267700352:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.086454:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.088707:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267700352:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.088722:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.088758:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5944c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2005:x1830881272990720:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2438us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.088767:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14370 00000100:00100000:0.0:1746065139.088928:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.089014:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272990976 00000100:00100000:2.0:1746065139.089019:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272990976 00002000:00100000:2.0:1746065139.089046:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f981500 x1830881272990976/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.089055:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981500 with x1830881272990976 ext(0->4095) 00002000:00010000:2.0:1746065139.089060:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f981500 00000100:00100000:2.0:1746065139.089111:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13642 00000100:00100000:2.0:1746065139.089118:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272990976:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.089207:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272990976:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 89us (280us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.089359:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13642 00002000:00100000:2.0:1746065139.089366:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f981500 x1830881272990976/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.089373:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981500 with x1830881272990976 ext(0->4095) 00002000:00010000:2.0:1746065139.089376:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f981500 00000100:00100000:0.0:1746065139.090816:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.091158:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272991104 00000100:00100000:2.0:1746065139.091164:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272991104 00000100:00100000:2.0:1746065139.091200:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30399 00000100:00100000:2.0:1746065139.091206:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1795:x1830881272991104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.091217:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.091230:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e53 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.091252:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.091259:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.091260:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.091263:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.091287:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.091302:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.091312:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267700480:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.091381:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.091794:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.092194:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272991232 00000100:00100000:1.0:1746065139.092198:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272991232 00000100:00100000:1.0:1746065139.092267:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30400 00000100:00100000:1.0:1746065139.092275:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881272991232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.092282:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.092291:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e5a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.092309:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.092313:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.092318:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.092321:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.092340:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.092350:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.092359:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065139.092635:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881272991232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 360us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.092641:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30400 00000100:00100000:3.0:1746065139.092997:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267700480:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.093012:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.093021:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:3.0:1746065139.093052:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881272991104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1845us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.093061:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30399 00000100:00100000:0.0:1746065139.093948:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.094009:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272991360 00000100:00100000:3.0:1746065139.094014:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272991360 00010000:00010000:3.0:1746065139.094034:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.094065:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14371 00000100:00100000:3.0:1746065139.094071:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272991360:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.094079:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.094117:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.094127:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.094143:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f87fedb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e4c expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.094355:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.094357:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.094363:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.094371:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.094392:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.094402:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.094411:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267700736:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.094470:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.096007:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267700736:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.096020:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.096044:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881272991360:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1973us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.096051:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14371 00000100:00100000:0.0:1746065139.096807:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.096904:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272991616 00000100:00100000:2.0:1746065139.096909:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272991616 00002000:00100000:2.0:1746065139.096947:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f983480 x1830881272991616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.096955:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983480 with x1830881272991616 ext(0->4095) 00010000:00010000:2.0:1746065139.096961:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.096972:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.096977:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f983480 00000100:00100000:2.0:1746065139.097004:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2887 00000100:00100000:2.0:1746065139.097010:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881272991616:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.097422:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881272991616:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 412us (615us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.097428:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2887 00002000:00100000:2.0:1746065139.097434:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f983480 x1830881272991616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.097446:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983480 with x1830881272991616 ext(0->4095) 00010000:00010000:2.0:1746065139.097451:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.097460:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.097465:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f983480 00000100:00100000:0.0:1746065139.099330:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.099490:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272991744 00000100:00100000:3.0:1746065139.099495:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272991744 00000100:00100000:3.0:1746065139.099526:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30401 00000100:00100000:3.0:1746065139.099532:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272991744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.099541:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.099553:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e61 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.099569:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.099573:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.099578:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065139.099581:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.099616:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.099625:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.099632:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065139.099656:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272991744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.099661:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30401 00000100:00100000:0.0:1746065139.101155:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.101226:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272991872 00000100:00100000:3.0:1746065139.101230:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272991872 00010000:00010000:3.0:1746065139.101245:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.101268:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14372 00000100:00100000:3.0:1746065139.101272:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2002:x1830881272991872:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.101279:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.101292:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.101299:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.101311:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fee2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e53 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.101329:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.101330:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.101335:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.101339:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.101355:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.101361:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.101368:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267700992:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.101417:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.102781:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.102853:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267700992:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.102861:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272992128 00010000:00010000:3.0:1746065139.102864:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.102865:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272992128 00000100:00100000:3.0:1746065139.102886:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2002:x1830881272991872:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1613us (1734us total) trans 0 rc 0/0 00002000:00100000:2.0:1746065139.102886:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f982a00 x1830881272992128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065139.102893:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14372 00002000:00100000:2.0:1746065139.102893:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982a00 with x1830881272992128 ext(0->4095) 00010000:00010000:2.0:1746065139.102897:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.102904:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.102908:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f982a00 00000100:00100000:2.0:1746065139.102926:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2888 00000100:00100000:2.0:1746065139.102931:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272992128:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.103025:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272992128:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 95us (247us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.103029:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2888 00002000:00100000:2.0:1746065139.103033:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f982a00 x1830881272992128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.103038:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982a00 with x1830881272992128 ext(0->4095) 00010000:00010000:2.0:1746065139.103040:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.103047:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.103050:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f982a00 00000100:00100000:2.0:1746065139.103155:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267701120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065139.103192:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065139.103390:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267701120 00000100:00100000:3.0:1746065139.103394:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267701120 00000100:00100000:3.0:1746065139.103437:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:3.0:1746065139.103442:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3768:x1830881267701120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746065139.103454:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 980040512 pending 0 free 3921227776 avail 3689705472 00000100:00100000:3.0:1746065139.103478:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3768:x1830881267701120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.103482:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1746065139.103493:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267701120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1746065139.103624:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065139.105394:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.105437:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.105537:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272992384 00000100:00100000:3.0:1746065139.105543:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272992384 00010000:00010000:3.0:1746065139.105565:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.105597:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14373 00000100:00100000:3.0:1746065139.105603:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272992384:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.105613:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.105627:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.105637:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.105655:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f87fee9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e5a expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.105668:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.105670:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.105676:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.105682:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.105704:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.105713:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267701248:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.105766:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.105870:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272992256 00000100:00100000:2.0:1746065139.105874:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272992256 00000100:00100000:2.0:1746065139.105894:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30402 00000100:00100000:2.0:1746065139.105899:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881272992256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.105911:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.105921:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e68 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.105945:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.105951:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.105952:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.105955:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.105979:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.105988:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.105997:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267701376:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.106028:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.107404:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267701248:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.107404:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267701376:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.107416:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065139.107422:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.107431:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:3.0:1746065139.107570:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881272992384:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1965us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.107570:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881272992256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1668us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.107576:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30402 00000100:00100000:3.0:1746065139.107577:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14373 00000100:00100000:0.0:1746065139.107736:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.107908:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272992640 00000100:00100000:3.0:1746065139.107912:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272992640 00002000:00100000:3.0:1746065139.107949:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79c000 x1830881272992640/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.107958:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79c000 with x1830881272992640 ext(0->4095) 00010000:00010000:3.0:1746065139.107964:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.108076:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.108150:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79c000 00000100:00100000:3.0:1746065139.108378:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2889 00000100:00100000:3.0:1746065139.108385:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272992640:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.108474:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272992640:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (738us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.108480:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2889 00002000:00100000:3.0:1746065139.108484:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79c000 x1830881272992640/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.108491:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79c000 with x1830881272992640 ext(0->4095) 00010000:00010000:3.0:1746065139.108495:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.108504:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.108509:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79c000 00000100:00100000:0.0:1746065139.109956:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.110045:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272992768 00000100:00100000:3.0:1746065139.110050:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272992768 00010000:00010000:3.0:1746065139.110069:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.110119:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14374 00000100:00100000:3.0:1746065139.110125:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272992768:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.110134:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.110147:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.110160:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.110178:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87fef0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e61 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.110188:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.110189:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.110195:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.110202:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.110225:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.110235:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267701504:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.110310:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.111545:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267701504:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.111557:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.111580:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272992768:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1455us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.111587:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14374 00000100:00100000:0.0:1746065139.111859:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.111969:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272993024 00000100:00100000:1.0:1746065139.111974:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272993024 00002000:00100000:1.0:1746065139.112002:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79ca80 x1830881272993024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.112010:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ca80 with x1830881272993024 ext(0->4095) 00002000:00010000:1.0:1746065139.112013:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79ca80 00000100:00100000:1.0:1746065139.112038:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13643 00000100:00100000:1.0:1746065139.112043:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2002:x1830881272993024:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065139.112169:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2002:x1830881272993024:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 124us (309us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.112174:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13643 00002000:00100000:1.0:1746065139.112179:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79ca80 x1830881272993024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.112186:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ca80 with x1830881272993024 ext(0->4095) 00002000:00010000:1.0:1746065139.112188:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79ca80 00000100:00100000:0.0:1746065139.113046:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.113198:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272993152 00000100:00100000:2.0:1746065139.113203:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272993152 00000100:00100000:2.0:1746065139.113238:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30403 00000100:00100000:2.0:1746065139.113244:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272993152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.113253:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.113266:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e6f expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.113291:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.113298:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.113299:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.113302:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.113322:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.113333:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 97 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.113341:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267701632:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.113402:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.115303:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.115386:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267701632:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.115388:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272993280 00000100:00100000:3.0:1746065139.115392:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272993280 00010000:00010000:2.0:1746065139.115404:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.115415:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.115415:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:3.0:1746065139.115489:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14375 00000100:00100000:3.0:1746065139.115495:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272993280:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.115505:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.115519:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.115529:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.115545:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87fef7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e68 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.115643:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272993152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2265us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.115650:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30403 00010000:00010000:3.0:1746065139.115701:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.115703:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.115709:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.115716:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.115741:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.115750:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267701760:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.115806:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.118033:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267701760:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.118046:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.118074:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2004:x1830881272993280:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2578us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.118108:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14375 00000100:00100000:0.0:1746065139.118526:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.118563:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272993536 00000100:00100000:1.0:1746065139.118568:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272993536 00002000:00100000:1.0:1746065139.118597:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79d880 x1830881272993536/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.118606:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d880 with x1830881272993536 ext(0->4095) 00002000:00010000:1.0:1746065139.118610:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79d880 00000100:00100000:1.0:1746065139.118635:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13644 00000100:00100000:1.0:1746065139.118641:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272993536:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.118742:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272993536:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 100us (216us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.118748:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13644 00002000:00100000:1.0:1746065139.118753:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79d880 x1830881272993536/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.118759:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d880 with x1830881272993536 ext(0->4095) 00002000:00010000:1.0:1746065139.118761:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79d880 00000100:00100000:2.0:1746065139.121324:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.121408:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272993664 00000100:00100000:3.0:1746065139.121414:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272993664 00000100:00100000:3.0:1746065139.121492:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30404 00000100:00100000:3.0:1746065139.121498:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1795:x1830881272993664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.121510:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.121523:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e76 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.121544:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.121550:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.121551:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.121554:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.121573:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.121580:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.121587:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267701888:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.121649:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.123948:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.124052:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.124524:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272993792 00000100:00100000:1.0:1746065139.124532:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272993792 00000100:00100000:1.0:1746065139.124565:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30405 00000100:00100000:1.0:1746065139.124575:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881272993792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.124588:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.124606:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e7d expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.124626:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.124630:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.124636:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.124639:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.124664:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.124675:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.124685:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:1.0:1746065139.124731:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881272993792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 160us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.124736:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30405 00000100:00100000:3.0:1746065139.124826:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267701888:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.124840:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.124848:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065139.124869:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881272993664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3371us (3552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.124880:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30404 00000100:00100000:2.0:1746065139.124915:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272993920 00000100:00100000:2.0:1746065139.124919:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272993920 00010000:00010000:2.0:1746065139.124947:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.124966:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14376 00000100:00100000:2.0:1746065139.124971:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272993920:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.124979:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.124993:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.125003:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.125018:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87fefe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e6f expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.125031:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.125032:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.125037:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.125043:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.125060:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.125074:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.125102:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267702144:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.125155:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.126911:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267702144:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065139.126912:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065139.126923:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.127039:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272993920:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2067us (2986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.127046:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14376 00000100:00100000:1.0:1746065139.127147:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272994176 00000100:00100000:1.0:1746065139.127152:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272994176 00002000:00100000:1.0:1746065139.127244:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79dc00 x1830881272994176/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.127257:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79dc00 with x1830881272994176 ext(0->4095) 00010000:00010000:1.0:1746065139.127264:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.127275:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.127280:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79dc00 00000100:00100000:1.0:1746065139.127305:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2890 00000100:00100000:1.0:1746065139.127310:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881272994176:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.127408:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881272994176:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 97us (496us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.127413:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2890 00002000:00100000:1.0:1746065139.127418:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79dc00 x1830881272994176/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.127425:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79dc00 with x1830881272994176 ext(0->4095) 00010000:00010000:1.0:1746065139.127429:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.127437:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.127442:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79dc00 00000100:00100000:0.0:1746065139.129005:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.129105:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272994304 00000100:00100000:2.0:1746065139.129110:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272994304 00000100:00100000:2.0:1746065139.129255:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30406 00000100:00100000:2.0:1746065139.129262:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272994304:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.129272:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.129284:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e84 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.129301:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.129305:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.129310:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065139.129313:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.129341:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.129353:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.129360:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065139.129385:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272994304:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 123us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.129389:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30406 00000100:00100000:0.0:1746065139.129553:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.129797:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272994432 00000100:00100000:2.0:1746065139.129800:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272994432 00010000:00010000:2.0:1746065139.129813:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.129839:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14377 00000100:00100000:2.0:1746065139.129844:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5944850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881272994432:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.129852:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.129865:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.129873:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.129887:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e76 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.130341:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.130344:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.130349:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.130356:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.130374:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.130384:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.130393:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267702400:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.130510:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.131853:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267702400:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.131866:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.132044:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5944850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272994432:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2197us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.132052:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14377 00000100:00100000:0.0:1746065139.132440:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.132569:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272994688 00000100:00100000:3.0:1746065139.132574:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272994688 00002000:00100000:3.0:1746065139.132602:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79c380 x1830881272994688/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.132610:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79c380 with x1830881272994688 ext(0->4095) 00010000:00010000:3.0:1746065139.132620:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.132631:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.132636:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79c380 00000100:00100000:3.0:1746065139.132683:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2891 00000100:00100000:3.0:1746065139.132690:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272994688:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.132874:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272994688:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 185us (434us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.132883:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2891 00002000:00100000:3.0:1746065139.132888:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79c380 x1830881272994688/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.132894:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79c380 with x1830881272994688 ext(0->4095) 00010000:00010000:3.0:1746065139.132898:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.132906:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.132912:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79c380 00000100:00100000:0.0:1746065139.134611:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.134908:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.135112:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272994816 00000100:00100000:2.0:1746065139.135112:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272994944 00000100:00100000:3.0:1746065139.135118:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272994816 00000100:00100000:2.0:1746065139.135118:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272994944 00010000:00010000:2.0:1746065139.135142:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.135149:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30407 00000100:00100000:3.0:1746065139.135154:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881272994816:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.135165:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.135177:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e8b expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.135194:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.135199:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.135204:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065139.135208:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.135240:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.135251:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.135259:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065139.135294:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881272994816:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 139us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.135299:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30407 00000100:00100000:2.0:1746065139.135426:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14378 00000100:00100000:2.0:1746065139.135432:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2002:x1830881272994944:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.135439:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.135453:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.135462:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.135476:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f800/0x392ae0376f87ff0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e7d expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.135486:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.135488:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.135492:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.135498:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.135522:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.135532:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.135545:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267702656:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.135594:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.137225:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267702656:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.137239:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.137265:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2002:x1830881272994944:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1833us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.137272:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14378 00000100:00100000:2.0:1746065139.138315:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.138430:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272995200 00000100:00100000:0.0:1746065139.138435:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272995200 00002000:00100000:0.0:1746065139.138464:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072979500 x1830881272995200/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.138473:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072979500 with x1830881272995200 ext(0->4095) 00010000:00010000:0.0:1746065139.138480:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.138491:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065139.138497:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072979500 00000100:00100000:0.0:1746065139.138523:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2892 00000100:00100000:0.0:1746065139.138529:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272995200:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065139.138637:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272995200:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 107us (324us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065139.138642:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2892 00002000:00100000:0.0:1746065139.138647:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072979500 x1830881272995200/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.138654:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072979500 with x1830881272995200 ext(0->4095) 00010000:00010000:0.0:1746065139.138658:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.138665:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065139.138670:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072979500 00000100:00100000:0.0:1746065139.140990:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.141114:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272995328 00000100:00100000:2.0:1746065139.141120:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272995328 00010000:00010000:3.0:1746065139.141244:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.141279:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14379 00000100:00100000:3.0:1746065139.141286:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272995328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.141296:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.141315:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.141325:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.141341:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ff13 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e84 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.141369:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.141477:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.141484:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.141491:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.141516:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.141526:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267702784:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.141599:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.143982:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267702784:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.143998:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065139.144017:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.144037:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272995328:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2752us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.144045:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14379 00000100:00100000:1.0:1746065139.144380:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272995584 00000100:00100000:1.0:1746065139.144386:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272995584 00002000:00100000:1.0:1746065139.144415:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b88000 x1830881272995584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.144423:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88000 with x1830881272995584 ext(0->4095) 00002000:00010000:1.0:1746065139.144427:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b88000 00000100:00100000:1.0:1746065139.144442:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13645 00000100:00100000:1.0:1746065139.144448:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2002:x1830881272995584:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065139.144537:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2002:x1830881272995584:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 89us (520us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.144542:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13645 00002000:00100000:1.0:1746065139.144546:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b88000 x1830881272995584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.144552:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88000 with x1830881272995584 ext(0->4095) 00002000:00010000:1.0:1746065139.144554:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b88000 00000100:00100000:0.0:1746065139.146121:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.146187:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272995712 00000100:00100000:3.0:1746065139.146193:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272995712 00000100:00100000:3.0:1746065139.146220:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30408 00000100:00100000:3.0:1746065139.146225:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272995712:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.146235:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.146248:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e92 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.146274:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.146281:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.146283:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.146286:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.146309:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.146319:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 97 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.146329:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267702912:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.146405:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.147624:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267702912:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065139.148264:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065139.148367:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.148380:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065139.148575:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272995712:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2349us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.148582:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30408 00000100:00100000:2.0:1746065139.148582:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272995840 00000100:00100000:2.0:1746065139.148586:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272995840 00010000:00010000:2.0:1746065139.148605:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.148634:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14380 00000100:00100000:2.0:1746065139.148639:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272995840:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.148647:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.148660:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.148669:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.148689:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e8b expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.148800:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.148802:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.148808:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.148816:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.148843:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.148853:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267703040:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.149956:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.151073:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267703040:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.151168:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.151207:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2005:x1830881272995840:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2565us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.151214:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14380 00000100:00100000:0.0:1746065139.151808:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.151915:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272996096 00000100:00100000:2.0:1746065139.151921:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272996096 00002000:00100000:2.0:1746065139.151955:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8b800 x1830881272996096/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.151965:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8b800 with x1830881272996096 ext(0->4095) 00002000:00010000:2.0:1746065139.151969:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8b800 00000100:00100000:2.0:1746065139.151996:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13646 00000100:00100000:2.0:1746065139.152006:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272996096:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.152123:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272996096:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 119us (316us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.152129:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13646 00002000:00100000:2.0:1746065139.152134:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8b800 x1830881272996096/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.152140:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8b800 with x1830881272996096 ext(0->4095) 00002000:00010000:2.0:1746065139.152142:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8b800 00000100:00100000:0.0:1746065139.153440:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.153514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.153538:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272996224 00000100:00100000:3.0:1746065139.153543:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272996224 00000100:00100000:3.0:1746065139.153565:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272996352 00000100:00100000:3.0:1746065139.153567:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272996352 00000100:00100000:3.0:1746065139.153595:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30409 00000100:00100000:3.0:1746065139.153601:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1795:x1830881272996224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.153611:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.153623:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5e99 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.153643:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.153650:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.153652:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.153655:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.153678:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.153682:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30410 00010000:00010000:3.0:1746065139.153688:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.153693:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881272996352:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:3.0:1746065139.153699:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267703168:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065139.153700:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.153708:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ea0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.153719:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.153723:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.153732:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.153734:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 100 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.153749:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fad80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065139.153752:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.153761:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 100 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.153769:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:1.0:1746065139.153787:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881272996352:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 98us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.153792:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30410 00000100:00100000:3.0:1746065139.154766:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267703168:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.154779:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.154790:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065139.154811:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881272996224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1211us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.154816:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30409 00000100:00100000:2.0:1746065139.155211:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.155498:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272996480 00000100:00100000:0.0:1746065139.155503:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272996480 00010000:00010000:0.0:1746065139.155521:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065139.155553:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14381 00000100:00100000:0.0:1746065139.155558:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881272996480:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065139.155565:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065139.155577:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.155583:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.155594:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e92 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.155744:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.155746:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.155752:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.155760:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.155782:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.155790:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065139.155804:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b88e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267703424:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065139.155853:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.157499:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.157586:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b88e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267703424:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.157594:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272996736 00000100:00100000:3.0:1746065139.157598:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272996736 00010000:00010000:2.0:1746065139.157600:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065139.157624:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8bb80 x1830881272996736/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746065139.157624:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881272996480:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2066us (2414us total) trans 0 rc 0/0 00002000:00100000:3.0:1746065139.157632:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8bb80 with x1830881272996736 ext(0->4095) 00000100:00100000:2.0:1746065139.157632:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14381 00010000:00010000:3.0:1746065139.157638:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.157648:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.157653:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8bb80 00000100:00100000:3.0:1746065139.157678:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2893 00000100:00100000:3.0:1746065139.157683:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881272996736:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.157769:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881272996736:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 85us (274us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.157774:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2893 00002000:00100000:3.0:1746065139.157779:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8bb80 x1830881272996736/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.157791:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8bb80 with x1830881272996736 ext(0->4095) 00010000:00010000:3.0:1746065139.157795:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.157802:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.157807:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b8bb80 00000100:00100000:0.0:1746065139.159808:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.160063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.160169:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272996864 00000100:00100000:3.0:1746065139.160174:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272996864 00000100:00100000:3.0:1746065139.160209:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30411 00000100:00100000:3.0:1746065139.160215:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272996864:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.160226:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.160238:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ea7 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.160261:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.160267:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.160272:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065139.160275:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.160290:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272996992 00000100:00100000:2.0:1746065139.160294:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272996992 00010000:00010000:3.0:1746065139.160301:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.160309:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.160315:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.160323:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065139.160352:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272996864:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 137us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.160357:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30411 00000100:00100000:2.0:1746065139.160375:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14382 00000100:00100000:2.0:1746065139.160382:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2003:x1830881272996992:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.160389:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.160401:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.160415:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.160429:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5e99 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.160440:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.160442:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.160446:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.160452:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.160515:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.160525:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.160535:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267703680:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.160595:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.164351:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.164401:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272997248 00000100:00100000:1.0:1746065139.164409:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272997248 00002000:00100000:1.0:1746065139.164443:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b88a80 x1830881272997248/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746065139.164445:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267703680:192.168.202.8@tcp:105: 00002000:00100000:1.0:1746065139.164452:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88a80 with x1830881272997248 ext(0->4095) 00010000:00010000:1.0:1746065139.164459:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.164460:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065139.164471:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.164476:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b88a80 00000100:00100000:2.0:1746065139.164489:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2003:x1830881272996992:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4107us (4426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.164500:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14382 00000100:00100000:1.0:1746065139.164506:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2894 00000100:00100000:1.0:1746065139.164512:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272997248:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.164619:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272997248:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 106us (274us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.164625:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2894 00002000:00100000:1.0:1746065139.164630:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b88a80 x1830881272997248/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.164636:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88a80 with x1830881272997248 ext(0->4095) 00010000:00010000:1.0:1746065139.164641:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.164649:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.164654:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b88a80 00000100:00100000:0.0:1746065139.165759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.165789:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.165797:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272997376 00000100:00100000:2.0:1746065139.165801:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272997376 00000100:00100000:2.0:1746065139.166063:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30412 00000100:00100000:2.0:1746065139.166069:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881272997376:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.166077:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065139.166105:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272997504 00010000:00010000:2.0:1746065139.166106:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5eae expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.166109:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272997504 00010000:00010000:3.0:1746065139.166123:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 100 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.166123:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.166127:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.166130:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065139.166133:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.166148:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14383 00010000:00010000:2.0:1746065139.166152:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.166153:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881272997504:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.166160:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.166160:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.166165:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00010000:00010000:3.0:1746065139.166171:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 100 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.166179:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 100 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.166183:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881272997376:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 115us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.166186:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30412 00010000:00010000:3.0:1746065139.166283:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87ff2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea0 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.166300:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.166302:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.166307:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.166313:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.166329:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.166336:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.166346:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267703936:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.166525:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.167620:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267703936:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.167632:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.167664:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272997504:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1511us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.167671:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14383 00000100:00100000:0.0:1746065139.167816:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.167947:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272997760 00000100:00100000:3.0:1746065139.167951:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272997760 00002000:00100000:3.0:1746065139.167972:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a3480 x1830881272997760/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.167980:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a3480 with x1830881272997760 ext(0->4095) 00010000:00010000:3.0:1746065139.167984:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.167997:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.168002:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a3480 00000100:00100000:3.0:1746065139.168022:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2895 00000100:00100000:3.0:1746065139.168026:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272997760:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.168126:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272997760:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (310us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.168131:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2895 00002000:00100000:3.0:1746065139.168135:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a3480 x1830881272997760/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.168141:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a3480 with x1830881272997760 ext(0->4095) 00010000:00010000:3.0:1746065139.168145:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.168153:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.168157:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a3480 00000100:00100000:0.0:1746065139.170127:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.170294:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272997888 00000100:00100000:3.0:1746065139.170301:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272997888 00010000:00010000:3.0:1746065139.170332:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.170354:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14384 00000100:00100000:3.0:1746065139.170361:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5944450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881272997888:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.170370:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.170383:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.170394:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.170412:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff36 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ea7 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.170431:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.170433:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.170439:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.170445:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.170578:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.170590:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267704064:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.170853:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.172786:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267704064:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.172802:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.172831:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5944450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881272997888:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2469us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.172840:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14384 00000100:00100000:3.0:1746065139.173370:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.173507:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272998144 00000100:00100000:1.0:1746065139.173513:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272998144 00002000:00100000:1.0:1746065139.173541:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e889c00 x1830881272998144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.173550:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889c00 with x1830881272998144 ext(0->4095) 00002000:00010000:1.0:1746065139.173554:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e889c00 00000100:00100000:1.0:1746065139.173581:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13647 00000100:00100000:1.0:1746065139.173587:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272998144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.174018:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272998144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 429us (647us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.174025:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13647 00002000:00100000:1.0:1746065139.174030:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e889c00 x1830881272998144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.174037:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889c00 with x1830881272998144 ext(0->4095) 00002000:00010000:1.0:1746065139.174040:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e889c00 00000100:00100000:0.0:1746065139.175141:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.175186:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272998272 00000100:00100000:3.0:1746065139.175191:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272998272 00000100:00100000:3.0:1746065139.175397:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30413 00000100:00100000:3.0:1746065139.175404:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272998272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.175414:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.175427:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5eb5 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.175446:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.175452:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.175453:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.175456:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.175479:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.175489:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 97 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.175497:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267704192:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.175553:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.176668:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267704192:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.176686:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.176697:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065139.176738:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272998272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1334us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.176744:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30413 00000100:00100000:0.0:1746065139.177250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.177516:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272998400 00000100:00100000:3.0:1746065139.177521:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272998400 00010000:00010000:3.0:1746065139.177541:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.177573:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14385 00000100:00100000:3.0:1746065139.177579:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881272998400:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.177588:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.177602:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.177612:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.177629:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ff3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eae expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.177850:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.177852:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.177858:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.177867:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.177889:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.177898:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267704320:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.177961:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.179069:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267704320:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.179099:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.179125:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2004:x1830881272998400:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1545us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.179132:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14385 00000100:00100000:0.0:1746065139.180965:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.181021:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272998656 00000100:00100000:1.0:1746065139.181031:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272998656 00002000:00100000:1.0:1746065139.181069:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1c00 x1830881272998656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.181077:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1c00 with x1830881272998656 ext(0->4095) 00002000:00010000:1.0:1746065139.181113:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a1c00 00000100:00100000:1.0:1746065139.181138:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13648 00000100:00100000:1.0:1746065139.181144:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272998656:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.181312:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881272998656:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 168us (355us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.181318:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13648 00002000:00100000:1.0:1746065139.181327:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1c00 x1830881272998656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.181334:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1c00 with x1830881272998656 ext(0->4095) 00002000:00010000:1.0:1746065139.181336:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a1c00 00000100:00100000:0.0:1746065139.183264:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.183344:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272998784 00000100:00100000:3.0:1746065139.183349:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272998784 00000100:00100000:3.0:1746065139.183381:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30414 00000100:00100000:3.0:1746065139.183387:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1795:x1830881272998784:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.183399:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.183413:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ebc expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.183434:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.183445:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.183448:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.183451:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.183473:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.183484:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.183494:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267704448:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.183637:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.183658:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.183729:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272998912 00000100:00100000:2.0:1746065139.183733:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272998912 00000100:00100000:2.0:1746065139.183759:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30415 00000100:00100000:2.0:1746065139.183764:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881272998912:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.183770:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.183776:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ec3 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.183787:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.183790:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.183795:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.183798:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.183814:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.183826:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.183833:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065139.183852:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881272998912:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 89us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.183857:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30415 00000100:00100000:3.0:1746065139.184792:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267704448:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.184805:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.184814:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065139.184833:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881272998784:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1446us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.184838:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30414 00000100:00100000:0.0:1746065139.185596:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.185679:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272999040 00000100:00100000:3.0:1746065139.185684:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272999040 00010000:00010000:3.0:1746065139.185702:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.185737:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14386 00000100:00100000:3.0:1746065139.185742:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881272999040:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.185756:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.185769:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.185778:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.185793:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff44 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eb5 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.185816:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.185818:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.185824:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.185831:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.185851:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.185860:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.185870:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267704704:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.185916:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.189468:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267704704:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.189468:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065139.189491:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.189526:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881272999040:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3783us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.189530:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272999296 00000100:00100000:3.0:1746065139.189533:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14386 00000100:00100000:1.0:1746065139.189537:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272999296 00002000:00100000:1.0:1746065139.189568:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297a300 x1830881272999296/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.189577:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297a300 with x1830881272999296 ext(0->4095) 00010000:00010000:1.0:1746065139.189583:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.189595:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.189601:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007297a300 00000100:00100000:1.0:1746065139.189616:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2896 00000100:00100000:1.0:1746065139.189621:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881272999296:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.189727:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881272999296:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 106us (261us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.189733:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2896 00002000:00100000:1.0:1746065139.189738:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297a300 x1830881272999296/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.189744:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297a300 with x1830881272999296 ext(0->4095) 00010000:00010000:1.0:1746065139.189748:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.189757:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.189762:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007297a300 00000100:00100000:0.0:1746065139.191339:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.191370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.191427:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272999424 00000100:00100000:2.0:1746065139.191431:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272999424 00010000:00010000:2.0:1746065139.191446:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.191467:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14387 00000100:00100000:2.0:1746065139.191470:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2003:x1830881272999424:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.191477:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.191487:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.191494:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.191507:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ebc expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.191518:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.191519:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.191523:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.191528:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.191544:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.191551:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267704832:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.191591:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.192655:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272999552 00000100:00100000:3.0:1746065139.192661:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272999552 00000100:00100000:3.0:1746065139.192704:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30416 00000100:00100000:3.0:1746065139.192710:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881272999552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.192721:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.192731:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5eca expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.192748:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.192754:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.192756:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.192759:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.192776:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.192786:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.192795:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267704960:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.192958:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.193067:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.193119:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267704832:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.193131:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.193143:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272999808 00000100:00100000:3.0:1746065139.193146:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272999808 00000100:00100000:2.0:1746065139.193157:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2003:x1830881272999424:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1685us (1785us total) trans 0 rc 0/0 00002000:00100000:3.0:1746065139.193169:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5880 x1830881272999808/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746065139.193169:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14387 00002000:00100000:3.0:1746065139.193177:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5880 with x1830881272999808 ext(0->4095) 00010000:00010000:3.0:1746065139.193182:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.193191:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.193196:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5880 00000100:00100000:3.0:1746065139.193218:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2897 00000100:00100000:3.0:1746065139.193224:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272999808:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.193384:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881272999808:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 160us (316us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.193390:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2897 00002000:00100000:3.0:1746065139.193394:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5880 x1830881272999808/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.193402:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5880 with x1830881272999808 ext(0->4095) 00010000:00010000:3.0:1746065139.193406:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.193414:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.193419:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5880 00000100:00100000:3.0:1746065139.193901:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267704960:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.193912:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.193922:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065139.193951:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881272999552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1241us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.193956:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30416 00000100:00100000:0.0:1746065139.196438:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.196486:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.196498:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881272999936 00000100:00100000:3.0:1746065139.196506:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881272999936 00000100:00100000:3.0:1746065139.196575:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30417 00000100:00100000:3.0:1746065139.196581:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881272999936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.196594:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.196608:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ed1 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.196629:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.196635:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.196640:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065139.196642:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.196668:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.196677:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.196684:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065139.196727:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881272999936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 146us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.196733:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30417 00000100:00100000:2.0:1746065139.196790:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273000064 00000100:00100000:2.0:1746065139.196793:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273000064 00010000:00010000:2.0:1746065139.196807:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.196830:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14388 00000100:00100000:2.0:1746065139.196835:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273000064:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.196841:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.196854:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.196863:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.196882:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ff52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ec3 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.196890:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.196891:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.196896:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.196907:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.196923:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.196941:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.196950:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267705216:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.197008:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.198370:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267705216:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.198383:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.198417:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273000064:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1581us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.198424:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14388 00000100:00100000:0.0:1746065139.198995:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.199063:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273000320 00000100:00100000:3.0:1746065139.199068:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273000320 00002000:00100000:3.0:1746065139.199118:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f849f80 x1830881273000320/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.199126:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f849f80 with x1830881273000320 ext(0->4095) 00010000:00010000:3.0:1746065139.199132:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.199142:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.199147:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f849f80 00000100:00100000:3.0:1746065139.199171:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2898 00000100:00100000:3.0:1746065139.199176:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273000320:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.199259:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273000320:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 83us (265us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.199265:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2898 00002000:00100000:3.0:1746065139.199270:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f849f80 x1830881273000320/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.199277:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f849f80 with x1830881273000320 ext(0->4095) 00010000:00010000:3.0:1746065139.199281:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.199290:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.199295:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f849f80 00000100:00100000:1.0:1746065139.202690:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.202744:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273000448 00000100:00100000:2.0:1746065139.202751:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273000448 00010000:00010000:2.0:1746065139.202780:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.202814:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14389 00000100:00100000:2.0:1746065139.202821:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273000448:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.202832:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.202848:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.202859:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.202877:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eca expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.202898:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.202900:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.202905:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.202913:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.202950:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.202961:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267705344:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.203021:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.204377:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267705344:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.204391:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.204425:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273000448:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1605us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.204432:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14389 00000100:00100000:0.0:1746065139.205774:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.205835:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273000704 00000100:00100000:3.0:1746065139.205840:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273000704 00002000:00100000:3.0:1746065139.205870:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f84bb80 x1830881273000704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.205878:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84bb80 with x1830881273000704 ext(0->4095) 00002000:00010000:3.0:1746065139.205882:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f84bb80 00000100:00100000:3.0:1746065139.205908:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13649 00000100:00100000:3.0:1746065139.205914:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273000704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.206574:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273000704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 659us (802us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.206580:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13649 00002000:00100000:3.0:1746065139.206586:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f84bb80 x1830881273000704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.206593:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84bb80 with x1830881273000704 ext(0->4095) 00002000:00010000:3.0:1746065139.206596:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f84bb80 00000100:00100000:0.0:1746065139.208578:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.208630:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273000832 00000100:00100000:2.0:1746065139.208636:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273000832 00000100:00100000:2.0:1746065139.208673:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30418 00000100:00100000:2.0:1746065139.208677:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273000832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.208688:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.208699:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ed8 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.208716:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.208721:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.208722:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.208724:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.208743:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.208749:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 97 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.208756:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267705472:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.208929:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.210338:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267705472:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.210357:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.210370:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065139.210407:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273000832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1728us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.210413:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30418 00000100:00100000:0.0:1746065139.211292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.211441:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273000960 00000100:00100000:2.0:1746065139.211447:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273000960 00010000:00010000:2.0:1746065139.211466:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.212264:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14390 00000100:00100000:1.0:1746065139.212273:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273000960:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.212285:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.212302:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.212314:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.212331:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f87ff60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed1 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.212357:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.212359:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.212365:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.212372:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.212396:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.212405:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267705600:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.212472:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.215360:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.215404:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273001216 00000100:00100000:3.0:1746065139.215411:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273001216 00002000:00100000:3.0:1746065139.215453:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91c00 x1830881273001216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.215462:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91c00 with x1830881273001216 ext(0->4095) 00002000:00010000:3.0:1746065139.215467:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c91c00 00000100:00100000:3.0:1746065139.215485:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13650 00000100:00100000:3.0:1746065139.215492:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273001216:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.215536:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267705600:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.215550:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.215579:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2005:x1830881273000960:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3309us (4290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.215587:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14390 00000100:00100000:3.0:1746065139.215600:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273001216:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 108us (246us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.215605:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13650 00002000:00100000:3.0:1746065139.215609:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91c00 x1830881273001216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.215616:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91c00 with x1830881273001216 ext(0->4095) 00002000:00010000:3.0:1746065139.215618:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c91c00 00000100:00100000:0.0:1746065139.215783:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.215838:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273001344 00000100:00100000:3.0:1746065139.215841:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273001344 00000100:00100000:3.0:1746065139.215877:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30419 00000100:00100000:3.0:1746065139.215882:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1791:x1830881273001344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.215889:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.215900:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5edf expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.215918:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.215928:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.215930:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.215945:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.215969:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.215978:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.215987:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267705728:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.217026:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.218206:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.218261:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273001472 00000100:00100000:2.0:1746065139.218359:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273001472 00000100:00100000:2.0:1746065139.218561:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30420 00000100:00100000:2.0:1746065139.218568:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881273001472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.218580:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.218590:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ee6 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.218608:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.218612:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.218617:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.218620:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.218642:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.218651:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.218664:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:2.0:1746065139.218691:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1795:x1830881273001472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 124us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.218696:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30420 00000100:00100000:3.0:1746065139.219115:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267705728:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.219129:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.219137:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065139.219224:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273001344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3341us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.219231:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30419 00000100:00100000:1.0:1746065139.219525:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.219626:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273001600 00000100:00100000:0.0:1746065139.219634:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273001600 00010000:00010000:0.0:1746065139.219657:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065139.219674:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14391 00000100:00100000:0.0:1746065139.219679:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5944050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273001600:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065139.219806:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065139.219824:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.219834:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.219849:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ff67 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ed8 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.219873:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.219874:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.219879:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.219886:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.219904:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.219918:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065139.219928:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267705984:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065139.219983:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.222394:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.222462:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273001856 00000100:00100000:1.0:1746065139.222469:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273001856 00000100:00100000:2.0:1746065139.222503:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267705984:192.168.202.8@tcp:105: 00002000:00100000:1.0:1746065139.222503:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91180 x1830881273001856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.222512:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91180 with x1830881273001856 ext(0->4095) 00010000:00010000:2.0:1746065139.222519:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065139.222519:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.222530:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.222536:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91180 00000100:00100000:1.0:1746065139.222566:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2899 00000100:00100000:1.0:1746065139.222572:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273001856:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.222672:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273001856:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 100us (284us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.222678:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2899 00002000:00100000:1.0:1746065139.222683:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91180 x1830881273001856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.222690:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91180 with x1830881273001856 ext(0->4095) 00010000:00010000:1.0:1746065139.222695:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.222703:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.222708:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91180 00000100:00100000:2.0:1746065139.222783:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5944050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273001600:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3102us (3257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.222791:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14391 00000100:00100000:0.0:1746065139.225811:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.226468:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273001984 00000100:00100000:3.0:1746065139.226476:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273001984 00010000:00010000:3.0:1746065139.226510:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.226549:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14392 00000100:00100000:3.0:1746065139.226556:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273001984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.226568:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.226590:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.226602:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.226620:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f87ff6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5edf expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.226640:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.226641:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.226648:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.226655:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.226681:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 98 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.226691:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267706112:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.226768:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.231994:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267706112:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065139.231994:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065139.232011:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.232047:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273001984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5491us (6242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.232056:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14392 00000100:00100000:2.0:1746065139.232139:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273002240 00000100:00100000:2.0:1746065139.232144:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273002240 00002000:00100000:2.0:1746065139.232173:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c93100 x1830881273002240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.232181:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c93100 with x1830881273002240 ext(0->4095) 00002000:00010000:2.0:1746065139.232185:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c93100 00000100:00100000:2.0:1746065139.232208:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13651 00000100:00100000:2.0:1746065139.232214:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273002240:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.232316:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273002240:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (327us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.232322:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13651 00002000:00100000:2.0:1746065139.232326:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c93100 x1830881273002240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.232333:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c93100 with x1830881273002240 ext(0->4095) 00002000:00010000:2.0:1746065139.232336:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c93100 00010000:00010000:2.0:1746065139.233158:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065139.235038:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.235122:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273002368 00000100:00100000:3.0:1746065139.235128:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273002368 00000100:00100000:3.0:1746065139.235202:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30421 00000100:00100000:3.0:1746065139.235208:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273002368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.235219:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.235230:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5eed expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.235251:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.235256:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.235258:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.235260:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.235280:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.235289:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 97 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.235298:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267706240:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.235448:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.236184:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267706240:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.236200:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.236211:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065139.236247:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273002368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1039us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.236253:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30421 00000100:00100000:0.0:1746065139.236643:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.236743:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273002496 00000100:00100000:3.0:1746065139.236747:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273002496 00010000:00010000:3.0:1746065139.236765:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.236790:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14393 00000100:00100000:3.0:1746065139.236798:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273002496:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.236808:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.236820:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.236829:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.236844:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f87ff75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ee6 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.236871:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.236873:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.236878:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.236885:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.236904:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.236912:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267706368:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.236972:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.238213:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267706368:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.238224:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.238250:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2005:x1830881273002496:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1452us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.238256:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14393 00000100:00100000:0.0:1746065139.238325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.238358:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273002752 00000100:00100000:2.0:1746065139.238361:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273002752 00002000:00100000:2.0:1746065139.238385:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90e00 x1830881273002752/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.238393:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90e00 with x1830881273002752 ext(0->4095) 00002000:00010000:2.0:1746065139.238396:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90e00 00000100:00100000:2.0:1746065139.238422:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13652 00000100:00100000:2.0:1746065139.238428:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273002752:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.238593:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273002752:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 164us (268us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.238598:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13652 00002000:00100000:2.0:1746065139.238603:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90e00 x1830881273002752/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.238610:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90e00 with x1830881273002752 ext(0->4095) 00002000:00010000:2.0:1746065139.238612:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90e00 00000100:00100000:0.0:1746065139.240700:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.240771:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273002880 00000100:00100000:3.0:1746065139.240777:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273002880 00000100:00100000:3.0:1746065139.240856:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30422 00000100:00100000:3.0:1746065139.240863:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1795:x1830881273002880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.240874:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.240896:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ef4 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.240917:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.240923:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.240925:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.240927:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.240958:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.240967:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.240977:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267706496:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.241038:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.241709:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.241759:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273003008 00000100:00100000:1.0:1746065139.241763:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273003008 00000100:00100000:1.0:1746065139.241790:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30423 00000100:00100000:1.0:1746065139.241795:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273003008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.241800:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.241807:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5efb expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.241817:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.241821:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.241826:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.241828:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 100 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.241860:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.241870:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 100 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.241883:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065139.241904:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273003008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 109us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.241909:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30423 00000100:00100000:3.0:1746065139.242781:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267706496:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.242794:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.242802:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065139.242824:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881273002880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1962us (2128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.242829:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30422 00000100:00100000:0.0:1746065139.243834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.243905:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273003136 00000100:00100000:3.0:1746065139.243910:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273003136 00010000:00010000:3.0:1746065139.243929:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.243973:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14394 00000100:00100000:3.0:1746065139.243978:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273003136:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.243988:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.244001:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.244010:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.244026:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ff7c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5eed expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.244316:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.244318:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.244324:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.244330:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.244353:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.244361:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.244371:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267706752:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.244583:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.245947:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267706752:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.245962:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.245990:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273003136:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2011us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.245997:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14394 00000100:00100000:0.0:1746065139.247786:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.247986:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273003392 00000100:00100000:2.0:1746065139.247993:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273003392 00002000:00100000:2.0:1746065139.248026:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91880 x1830881273003392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.248036:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91880 with x1830881273003392 ext(0->4095) 00010000:00010000:2.0:1746065139.248043:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.248059:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.248065:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91880 00000100:00100000:2.0:1746065139.248110:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2900 00000100:00100000:2.0:1746065139.248116:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273003392:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.248216:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273003392:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 100us (435us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.248222:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2900 00002000:00100000:2.0:1746065139.248227:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91880 x1830881273003392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.248233:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91880 with x1830881273003392 ext(0->4095) 00010000:00010000:2.0:1746065139.248238:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.248246:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.248252:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91880 00000100:00100000:0.0:1746065139.251700:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.251783:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273003520 00000100:00100000:0.0:1746065139.251788:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.251792:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273003520 00000100:00100000:3.0:1746065139.251844:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30424 00000100:00100000:3.0:1746065139.251852:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273003520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.251865:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.251879:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f02 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.251901:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.251905:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.251911:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065139.251914:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.251973:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.251982:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273003648 00000100:00100000:2.0:1746065139.251986:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273003648 00010000:00010000:3.0:1746065139.251988:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.251996:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00010000:00010000:2.0:1746065139.252002:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.252032:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14395 00000100:00100000:3.0:1746065139.252036:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273003520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 184us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.252037:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2003:x1830881273003648:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065139.252042:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30424 00010000:00010000:2.0:1746065139.252045:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.252061:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.252077:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.252115:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ff83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ef4 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.252128:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.252130:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.252135:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.252142:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.252160:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.252169:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.252180:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267707008:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.252227:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.253255:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267707008:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.253266:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.253284:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2003:x1830881273003648:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1247us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.253290:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14395 00000100:00100000:0.0:1746065139.254722:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.254781:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273003904 00000100:00100000:3.0:1746065139.254787:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273003904 00002000:00100000:3.0:1746065139.254816:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92d80 x1830881273003904/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.254824:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92d80 with x1830881273003904 ext(0->4095) 00010000:00010000:3.0:1746065139.254831:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.254842:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.254847:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c92d80 00000100:00100000:3.0:1746065139.254876:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2901 00000100:00100000:3.0:1746065139.254882:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273003904:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.255000:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273003904:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 117us (280us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.255005:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2901 00002000:00100000:3.0:1746065139.255011:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92d80 x1830881273003904/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.255018:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92d80 with x1830881273003904 ext(0->4095) 00010000:00010000:3.0:1746065139.255022:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.255030:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.255036:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c92d80 00000100:00100000:0.0:1746065139.257001:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.257783:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.257841:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273004160 00000100:00100000:2.0:1746065139.257849:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273004160 00010000:00010000:2.0:1746065139.257875:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.257897:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14396 00000100:00100000:2.0:1746065139.257903:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2002:x1830881273004160:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.257913:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.257927:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.257951:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.257956:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273004032 00000100:00100000:3.0:1746065139.257961:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273004032 00010000:00010000:2.0:1746065139.257968:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f87ff8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5efb expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.257984:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065139.257985:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30425 00010000:00010000:2.0:1746065139.257986:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065139.257990:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273004032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.257992:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.257998:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.258001:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.258010:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f09 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.258023:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.258025:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.258031:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.258032:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.258035:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.258044:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.258097:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267707136:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.258098:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.258110:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.258118:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267707264:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.259022:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.259043:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.260414:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267707264:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.260435:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.260445:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267707136:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.260449:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00010000:00010000:2.0:1746065139.260455:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.260494:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273004032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2502us (3496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.260494:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2002:x1830881273004160:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2590us (2710us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.260501:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30425 00000100:00100000:2.0:1746065139.260501:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14396 00000100:00100000:0.0:1746065139.261396:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.261437:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273004416 00000100:00100000:3.0:1746065139.261442:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273004416 00002000:00100000:3.0:1746065139.261466:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084380 x1830881273004416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.261472:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084380 with x1830881273004416 ext(0->4095) 00010000:00010000:3.0:1746065139.261477:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.261485:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.261492:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f084380 00000100:00100000:3.0:1746065139.261502:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2902 00000100:00100000:3.0:1746065139.261506:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273004416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.261588:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273004416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 81us (194us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.261592:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2902 00002000:00100000:3.0:1746065139.261595:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084380 x1830881273004416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.261599:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084380 with x1830881273004416 ext(0->4095) 00010000:00010000:3.0:1746065139.261602:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.261607:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.261611:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f084380 00000100:00100000:0.0:1746065139.263362:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.263589:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273004544 00000100:00100000:2.0:1746065139.263597:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273004544 00010000:00010000:2.0:1746065139.263623:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.263656:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14397 00000100:00100000:2.0:1746065139.263662:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273004544:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.263673:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.263690:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.263700:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.263720:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f87ff91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f02 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.263749:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.263751:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.263758:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.263767:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.263794:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.263805:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267707392:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.263878:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.267764:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.267900:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273004800 00000100:00100000:2.0:1746065139.267904:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267707392:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.267906:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273004800 00010000:00010000:2.0:1746065139.267920:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065139.268274:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f085880 x1830881273004800/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.268284:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f085880 with x1830881273004800 ext(0->4095) 00002000:00010000:1.0:1746065139.268288:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f085880 00000100:00100000:1.0:1746065139.268305:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13653 00000100:00100000:1.0:1746065139.268312:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273004800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.268458:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273004800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 145us (698us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.268464:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13653 00002000:00100000:1.0:1746065139.268469:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f085880 x1830881273004800/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.268476:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f085880 with x1830881273004800 ext(0->4095) 00002000:00010000:1.0:1746065139.268479:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f085880 00000100:00100000:2.0:1746065139.268648:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273004544:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4986us (5289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.268655:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14397 00000100:00100000:0.0:1746065139.271842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.271887:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273004928 00000100:00100000:3.0:1746065139.271895:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273004928 00000100:00100000:3.0:1746065139.271950:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30426 00000100:00100000:3.0:1746065139.271956:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273004928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.271970:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.271983:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f10 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.272008:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.272014:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.272015:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.272018:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.272039:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.272048:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 97 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.272058:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267707520:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.272154:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.276356:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267707520:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.276379:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.276394:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065139.276432:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273004928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4471us (4591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.276439:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30426 00000100:00100000:0.0:1746065139.276742:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.276820:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273005056 00000100:00100000:2.0:1746065139.276826:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273005056 00010000:00010000:2.0:1746065139.276847:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.276869:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14398 00000100:00100000:2.0:1746065139.276875:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273005056:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.276885:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.276899:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.276908:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.276926:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ff98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f09 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.276959:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.276961:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.276967:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.276973:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.276994:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.277003:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267707648:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.277044:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.279011:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.279172:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.279201:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273005440 00000100:00100000:0.0:1746065139.279206:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273005440 00002000:00100000:0.0:1746065139.279234:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f086300 x1830881273005440/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.279243:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086300 with x1830881273005440 ext(0->4095) 00002000:00010000:0.0:1746065139.279247:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f086300 00000100:00100000:0.0:1746065139.279267:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13654 00000100:00100000:0.0:1746065139.279273:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273005440:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065139.279369:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273005440:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 96us (197us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065139.279375:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13654 00002000:00100000:0.0:1746065139.279380:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f086300 x1830881273005440/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.279387:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086300 with x1830881273005440 ext(0->4095) 00002000:00010000:0.0:1746065139.279389:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f086300 00000100:00100000:3.0:1746065139.279499:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273005184 00000100:00100000:3.0:1746065139.279503:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273005184 00000100:00100000:3.0:1746065139.279525:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30427 00000100:00100000:3.0:1746065139.279530:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273005184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.279538:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.279550:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f17 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.279567:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.279572:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.279574:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.279577:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.279596:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.279606:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.279616:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267707776:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.279658:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.279793:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267707648:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.279806:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.279824:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273005056:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2949us (3083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.279832:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14398 00000100:00100000:3.0:1746065139.281501:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267707776:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.281517:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.281527:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065139.281549:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273005184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2018us (2542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.281554:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30427 00000100:00100000:0.0:1746065139.282314:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.282350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.282411:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273005696 00000100:00100000:3.0:1746065139.282416:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273005696 00000100:00100000:3.0:1746065139.282437:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30428 00000100:00100000:3.0:1746065139.282442:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273005696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.282452:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.282462:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f1e expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.282475:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.282479:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.282484:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.282486:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 7 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.282506:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.282514:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 7 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.282521:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065139.282551:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1795:x1830881273005696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 108us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.282555:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273005568 00000100:00100000:3.0:1746065139.282559:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30428 00000100:00100000:2.0:1746065139.282559:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273005568 00010000:00010000:2.0:1746065139.282575:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 7 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.282592:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14399 00000100:00100000:2.0:1746065139.282597:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2002:x1830881273005568:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.282604:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.282618:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 7 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.282628:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 7 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.282642:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ff9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f10 expref: 7 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.282660:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.282662:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.282667:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.282673:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.282691:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.282700:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 97 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.282708:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267708032:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.283153:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.286263:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267708032:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.286280:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.286328:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273005568:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3729us (4014us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.286338:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14399 00000100:00100000:0.0:1746065139.286973:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.287203:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273005952 00000100:00100000:1.0:1746065139.287209:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273005952 00002000:00100000:1.0:1746065139.287237:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f086680 x1830881273005952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.287251:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086680 with x1830881273005952 ext(0->4095) 00010000:00010000:1.0:1746065139.287257:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.287267:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.287273:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f086680 00000100:00100000:1.0:1746065139.287285:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2903 00000100:00100000:1.0:1746065139.287290:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273005952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.287379:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273005952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 88us (407us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.287384:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2903 00002000:00100000:1.0:1746065139.287388:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f086680 x1830881273005952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.287393:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086680 with x1830881273005952 ext(0->4095) 00010000:00010000:1.0:1746065139.287397:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.287404:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.287409:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f086680 00000100:00100000:0.0:1746065139.288885:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.289165:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273006080 00000100:00100000:2.0:1746065139.289170:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273006080 00000100:00100000:0.0:1746065139.289205:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.289300:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30429 00000100:00100000:2.0:1746065139.289307:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273006080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.289317:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.289329:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f25 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.289346:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.289350:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.289364:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065139.289367:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.289393:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.289404:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.289411:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065139.289497:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273006080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.289503:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30429 00000100:00100000:2.0:1746065139.289527:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273006208 00000100:00100000:2.0:1746065139.289529:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273006208 00010000:00010000:2.0:1746065139.289540:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.289573:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14400 00000100:00100000:2.0:1746065139.289579:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273006208:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.289590:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.289603:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.289618:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.289705:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f87ffa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f17 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.289715:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.289716:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.289721:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.289733:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.289752:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.289770:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.289779:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267708288:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.289902:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.291315:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267708288:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065139.291325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065139.291327:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.291350:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273006208:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1770us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.291357:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14400 00000100:00100000:1.0:1746065139.291681:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273006464 00000100:00100000:1.0:1746065139.291687:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273006464 00002000:00100000:1.0:1746065139.291714:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1df80 x1830881273006464/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.291722:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1df80 with x1830881273006464 ext(0->4095) 00010000:00010000:1.0:1746065139.291728:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.291738:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.291744:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1df80 00000100:00100000:1.0:1746065139.291765:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2904 00000100:00100000:1.0:1746065139.291771:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273006464:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.291873:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273006464:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (547us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.291879:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2904 00002000:00100000:1.0:1746065139.291883:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1df80 x1830881273006464/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.291890:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1df80 with x1830881273006464 ext(0->4095) 00010000:00010000:1.0:1746065139.291894:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.291903:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.291908:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1df80 00000100:00100000:0.0:1746065139.294827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.294902:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273006592 00000100:00100000:2.0:1746065139.294910:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273006592 00010000:00010000:2.0:1746065139.294946:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.294982:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14401 00000100:00100000:2.0:1746065139.294989:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273006592:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.294999:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.295012:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.295022:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.295039:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f87ffad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f1e expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.295053:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.295055:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.295060:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 97 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.295066:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 97 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.295119:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 97 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.295128:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267708416:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.295185:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.297198:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267708416:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.297304:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.297344:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273006592:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2354us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.297352:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14401 00000100:00100000:0.0:1746065139.298192:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.298255:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273006848 00000100:00100000:2.0:1746065139.298261:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273006848 00002000:00100000:2.0:1746065139.298289:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1c380 x1830881273006848/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.298297:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1c380 with x1830881273006848 ext(0->4095) 00002000:00010000:2.0:1746065139.298300:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1c380 00000100:00100000:2.0:1746065139.298621:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13655 00000100:00100000:2.0:1746065139.298628:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273006848:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.298962:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273006848:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 333us (769us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.298968:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13655 00002000:00100000:2.0:1746065139.298973:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1c380 x1830881273006848/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.298980:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1c380 with x1830881273006848 ext(0->4095) 00002000:00010000:2.0:1746065139.298982:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1c380 00000100:00100000:0.0:1746065139.300122:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.300266:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273006976 00000100:00100000:2.0:1746065139.300272:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273006976 00000100:00100000:2.0:1746065139.300310:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30430 00000100:00100000:2.0:1746065139.300316:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273006976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.300332:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.300344:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f2c expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.300364:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 97 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.300371:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.300372:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.300375:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.300398:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 97 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.300410:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 97 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.300424:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267708544:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.300494:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.302289:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267708544:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.302308:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.302318:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065139.302350:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273006976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2033us (2228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.302359:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30430 00000100:00100000:0.0:1746065139.302526:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.302630:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273007104 00000100:00100000:2.0:1746065139.302636:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273007104 00010000:00010000:2.0:1746065139.302655:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.302820:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14402 00000100:00100000:2.0:1746065139.302827:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273007104:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.302837:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.302852:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.302861:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.302883:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f87ffb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f25 expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.302903:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.302908:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.302913:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.302920:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.302952:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.302961:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267708672:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.303253:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.305241:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267708672:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.305257:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.305286:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2004:x1830881273007104:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2459us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.305295:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14402 00000100:00100000:1.0:1746065139.305578:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.305790:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273007360 00000100:00100000:2.0:1746065139.305795:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273007360 00002000:00100000:2.0:1746065139.306368:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff6a00 x1830881273007360/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.306377:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6a00 with x1830881273007360 ext(0->4095) 00002000:00010000:2.0:1746065139.306381:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff6a00 00000100:00100000:2.0:1746065139.306405:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13656 00000100:00100000:2.0:1746065139.306412:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273007360:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.306511:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273007360:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (933us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.306516:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13656 00002000:00100000:2.0:1746065139.306521:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff6a00 x1830881273007360/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.306526:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6a00 with x1830881273007360 ext(0->4095) 00002000:00010000:2.0:1746065139.306529:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff6a00 00000100:00100000:0.0:1746065139.308548:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.308613:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.308684:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273007488 00000100:00100000:3.0:1746065139.308690:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273007488 00000100:00100000:3.0:1746065139.308714:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273007616 00000100:00100000:3.0:1746065139.308715:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273007616 00000100:00100000:3.0:1746065139.308726:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30431 00000100:00100000:3.0:1746065139.308731:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273007488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.308742:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.308755:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f33 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.308775:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.308782:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.308783:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.308786:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.308808:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.308818:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.308839:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267708800:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.308895:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.308954:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30432 00000100:00100000:2.0:1746065139.308960:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881273007616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.308966:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.308972:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f3a expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.308982:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.308986:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.308991:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.308993:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.309009:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.309223:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.309234:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065139.309679:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1795:x1830881273007616:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 713us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.309684:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30432 00000100:00100000:3.0:1746065139.310288:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267708800:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.310302:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.310310:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065139.310328:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273007488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1596us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.310333:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30431 00000100:00100000:0.0:1746065139.310984:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.311124:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273007744 00000100:00100000:2.0:1746065139.311129:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273007744 00010000:00010000:2.0:1746065139.311147:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.311238:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14403 00000100:00100000:2.0:1746065139.311244:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273007744:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.311253:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.311266:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.311275:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.311292:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f87ffbb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f2c expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.311420:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.311422:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.311427:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.311435:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.311455:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.311464:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.311479:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267709056:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.311809:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.312824:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267709056:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.312834:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.312853:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273007744:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1609us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.312859:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14403 00000100:00100000:0.0:1746065139.314698:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.314965:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273008000 00000100:00100000:1.0:1746065139.314971:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273008000 00002000:00100000:1.0:1746065139.315003:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c322a00 x1830881273008000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.315012:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322a00 with x1830881273008000 ext(0->4095) 00010000:00010000:1.0:1746065139.315019:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.315031:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.315036:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c322a00 00000100:00100000:1.0:1746065139.315063:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2905 00000100:00100000:1.0:1746065139.315070:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273008000:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.315201:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273008000:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 131us (505us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.315206:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2905 00002000:00100000:1.0:1746065139.315211:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c322a00 x1830881273008000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.315218:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322a00 with x1830881273008000 ext(0->4095) 00010000:00010000:1.0:1746065139.315221:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.315230:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.315236:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c322a00 00000100:00100000:0.0:1746065139.317377:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.317658:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273008128 00000100:00100000:2.0:1746065139.317664:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273008128 00010000:00010000:2.0:1746065139.317687:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.317717:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14404 00000100:00100000:2.0:1746065139.317724:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2002:x1830881273008128:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.317732:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.317747:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.317757:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.317775:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87ffc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f33 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.317800:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.317802:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.317809:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.317816:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.317840:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.317850:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267709184:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.317915:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.320561:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267709184:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.320578:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.320612:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2002:x1830881273008128:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2889us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.320620:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14404 00000100:00100000:0.0:1746065139.320760:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.320871:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273008384 00000100:00100000:3.0:1746065139.320877:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273008384 00002000:00100000:3.0:1746065139.320906:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c320a80 x1830881273008384/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.320915:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320a80 with x1830881273008384 ext(0->4095) 00002000:00010000:3.0:1746065139.320918:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c320a80 00000100:00100000:3.0:1746065139.321048:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13657 00000100:00100000:3.0:1746065139.321055:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273008384:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.321174:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273008384:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 120us (417us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.321180:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13657 00002000:00100000:3.0:1746065139.321185:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c320a80 x1830881273008384/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.321191:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320a80 with x1830881273008384 ext(0->4095) 00002000:00010000:3.0:1746065139.321194:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c320a80 00000100:00100000:0.0:1746065139.323164:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.323228:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273008512 00000100:00100000:3.0:1746065139.323235:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273008512 00000100:00100000:3.0:1746065139.323262:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30433 00000100:00100000:3.0:1746065139.323268:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273008512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.323278:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.323290:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f41 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.323312:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.323318:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.323320:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.323323:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.323345:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.323355:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 97 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.323365:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267709312:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.323975:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.324908:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267709312:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.324925:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.324948:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065139.325065:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273008512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1797us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.325071:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30433 00000100:00100000:0.0:1746065139.325255:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.325395:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273008640 00000100:00100000:3.0:1746065139.325400:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273008640 00010000:00010000:3.0:1746065139.325417:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.325445:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14405 00000100:00100000:3.0:1746065139.325450:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273008640:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.325458:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.325472:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.325481:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.325496:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f87ffc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f3a expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.325508:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.325509:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.325514:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.325520:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.325543:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.325552:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267709440:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.325588:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.327206:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267709440:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.327219:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.327256:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2004:x1830881273008640:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1804us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.327263:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14405 00000100:00100000:0.0:1746065139.327450:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.327723:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273008896 00000100:00100000:2.0:1746065139.327728:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273008896 00002000:00100000:2.0:1746065139.327757:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c322680 x1830881273008896/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.327770:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322680 with x1830881273008896 ext(0->4095) 00002000:00010000:2.0:1746065139.327774:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c322680 00000100:00100000:2.0:1746065139.327801:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13658 00000100:00100000:2.0:1746065139.327807:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273008896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.327906:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273008896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (456us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.327912:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13658 00002000:00100000:2.0:1746065139.327917:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c322680 x1830881273008896/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.327923:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c322680 with x1830881273008896 ext(0->4095) 00002000:00010000:2.0:1746065139.327926:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c322680 00000100:00100000:0.0:1746065139.329560:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.330202:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273009024 00000100:00100000:3.0:1746065139.330208:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273009024 00000100:00100000:3.0:1746065139.330235:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30434 00000100:00100000:3.0:1746065139.330240:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1795:x1830881273009024:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.330251:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.330263:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f48 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.330283:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.330289:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.330290:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.330293:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.330317:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.330326:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.330335:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267709568:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.331124:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.331960:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.332027:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273009152 00000100:00100000:2.0:1746065139.332034:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273009152 00000100:00100000:2.0:1746065139.332060:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30435 00000100:00100000:2.0:1746065139.332066:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273009152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.332074:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.332101:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f4f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.332117:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.332121:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.332126:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.332129:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 100 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.332151:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.332162:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 100 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.332174:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065139.332552:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273009152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 486us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.332558:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30435 00000100:00100000:0.0:1746065139.333006:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.333021:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267709568:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.333036:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.333046:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:2.0:1746065139.333048:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273009280 00000100:00100000:2.0:1746065139.333052:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273009280 00010000:00010000:2.0:1746065139.333067:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.333077:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881273009024:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2836us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.333098:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30434 00000100:00100000:2.0:1746065139.333109:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14406 00000100:00100000:2.0:1746065139.333115:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273009280:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.333123:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.333138:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.333146:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.333160:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f41 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.333182:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.333183:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.333188:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.333199:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.333217:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.333227:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.333237:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267709824:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.333271:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.334626:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267709824:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.334637:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.334657:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273009280:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1542us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.334664:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14406 00000100:00100000:0.0:1746065139.335945:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.336070:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273009536 00000100:00100000:3.0:1746065139.336076:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273009536 00002000:00100000:3.0:1746065139.336127:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c323b80 x1830881273009536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.336137:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323b80 with x1830881273009536 ext(0->4095) 00010000:00010000:3.0:1746065139.336143:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.336159:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.336288:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c323b80 00000100:00100000:3.0:1746065139.336846:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2906 00000100:00100000:3.0:1746065139.336854:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273009536:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.336981:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273009536:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 127us (1050us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.336987:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2906 00002000:00100000:3.0:1746065139.336993:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c323b80 x1830881273009536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.337000:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323b80 with x1830881273009536 ext(0->4095) 00010000:00010000:3.0:1746065139.337006:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.337014:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.337020:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c323b80 00000100:00100000:0.0:1746065139.338830:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.338890:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273009664 00000100:00100000:3.0:1746065139.338895:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273009664 00000100:00100000:3.0:1746065139.339186:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30436 00000100:00100000:3.0:1746065139.339193:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273009664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.339204:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.339216:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f56 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.339234:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.339239:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.339245:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065139.339248:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.339276:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.339284:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.339291:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:0.0:1746065139.339307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.339364:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273009792 00000100:00100000:2.0:1746065139.339368:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273009792 00010000:00010000:2.0:1746065139.339391:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.339412:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14407 00000100:00100000:2.0:1746065139.339417:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273009792:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.339424:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.339443:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.339451:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.339465:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f87ffd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f48 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.339474:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.339475:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.339480:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.339486:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.339502:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.339512:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.339521:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267710080:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.339582:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.339791:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273009664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 426us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.339797:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30436 00000100:00100000:2.0:1746065139.341695:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267710080:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.341709:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.341743:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273009792:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2325us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.341752:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14407 00000100:00100000:0.0:1746065139.342965:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.343980:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273010048 00000100:00100000:2.0:1746065139.343988:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273010048 00002000:00100000:2.0:1746065139.344022:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a06300 x1830881273010048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.344032:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a06300 with x1830881273010048 ext(0->4095) 00010000:00010000:2.0:1746065139.344039:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.344051:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.344056:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a06300 00000100:00100000:2.0:1746065139.344110:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2907 00000100:00100000:2.0:1746065139.344117:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273010048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.344226:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273010048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 109us (1262us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.344232:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2907 00002000:00100000:2.0:1746065139.344236:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a06300 x1830881273010048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.344243:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a06300 with x1830881273010048 ext(0->4095) 00010000:00010000:2.0:1746065139.344247:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.344260:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.344265:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a06300 00000100:00100000:0.0:1746065139.345737:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.345801:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.345967:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273010176 00000100:00100000:2.0:1746065139.345972:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273010176 00010000:00010000:2.0:1746065139.345990:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 98 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.346077:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14408 00000100:00100000:2.0:1746065139.346100:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273010176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065139.346103:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273010304 00000100:00100000:3.0:1746065139.346106:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273010304 00010000:00010000:2.0:1746065139.346111:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.346124:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.346134:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30437 00010000:00010000:2.0:1746065139.346134:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.346140:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273010304:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.346148:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.346153:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f87ffde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f4f expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.346158:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f5d expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.346174:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.346176:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.346282:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.346294:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.346306:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.346313:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.346314:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.346317:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.346335:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.346345:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.346354:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.346355:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267710208:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.346363:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.346371:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267710336:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.346423:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.346490:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.348523:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267710336:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.348539:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.348561:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267710208:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.348577:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.348579:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273010176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2479us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.348587:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14408 00010000:00010000:3.0:1746065139.348588:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065139.348608:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273010304:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2468us (2873us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.348614:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30437 00000100:00100000:0.0:1746065139.349338:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.349379:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273010560 00000100:00100000:3.0:1746065139.349391:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273010560 00002000:00100000:3.0:1746065139.349489:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04700 x1830881273010560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.349498:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04700 with x1830881273010560 ext(0->4095) 00010000:00010000:3.0:1746065139.349503:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.349513:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.349519:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a04700 00000100:00100000:3.0:1746065139.349531:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2908 00000100:00100000:3.0:1746065139.349537:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273010560:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.349623:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273010560:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 86us (286us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.349628:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2908 00002000:00100000:3.0:1746065139.349634:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04700 x1830881273010560/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.349640:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04700 with x1830881273010560 ext(0->4095) 00010000:00010000:3.0:1746065139.349644:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.349653:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.349658:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a04700 00000100:00100000:0.0:1746065139.351849:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.352061:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273010688 00000100:00100000:2.0:1746065139.352068:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273010688 00010000:00010000:2.0:1746065139.352180:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.352406:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14409 00000100:00100000:2.0:1746065139.352413:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273010688:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.352424:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.352439:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.352449:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.352466:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f87ffe5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f56 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.352478:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.352479:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.352484:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.352490:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.352516:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.352526:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267710464:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.354098:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.357343:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267710464:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065139.357343:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065139.357358:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.357391:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273010688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4978us (5545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.357400:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14409 00000100:00100000:3.0:1746065139.357725:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273010944 00000100:00100000:3.0:1746065139.357731:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273010944 00002000:00100000:3.0:1746065139.357762:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04000 x1830881273010944/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.357771:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04000 with x1830881273010944 ext(0->4095) 00002000:00010000:3.0:1746065139.357775:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04000 00000100:00100000:3.0:1746065139.357804:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13659 00000100:00100000:3.0:1746065139.357810:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2003:x1830881273010944:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746065139.358429:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2003:x1830881273010944:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 619us (1088us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.358436:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13659 00002000:00100000:3.0:1746065139.358441:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04000 x1830881273010944/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.358448:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04000 with x1830881273010944 ext(0->4095) 00002000:00010000:3.0:1746065139.358451:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04000 00000100:00100000:0.0:1746065139.359947:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.359998:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273011072 00000100:00100000:3.0:1746065139.360004:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273011072 00000100:00100000:3.0:1746065139.360045:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30438 00000100:00100000:3.0:1746065139.360052:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273011072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.360063:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.360076:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f64 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.360128:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.360140:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.360143:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.360146:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.360232:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.360245:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 97 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.360255:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267710592:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.360319:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.363644:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267710592:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.363669:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.363685:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:2.0:1746065139.363724:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273011072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3672us (3793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.363732:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30438 00000100:00100000:0.0:1746065139.363912:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.364019:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273011200 00000100:00100000:3.0:1746065139.364026:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273011200 00010000:00010000:3.0:1746065139.364047:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.364102:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14410 00000100:00100000:3.0:1746065139.364109:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273011200:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.364118:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.364132:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.364142:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.364160:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f87ffec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f5d expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.364178:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.364180:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.364186:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.364199:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.364222:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.364232:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267710720:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.364284:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.364582:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.364611:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.364638:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.364659:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.364671:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.364682:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.364698:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273011456 00000100:00100000:0.0:1746065139.364702:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273011456 00000100:00100000:3.0:1746065139.364714:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273011584 00000100:00100000:3.0:1746065139.364718:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273011584 00000100:00100000:0.0:1746065139.364728:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273011840 00000100:00100000:0.0:1746065139.364730:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273011840 00000100:00100000:1.0:1746065139.364734:0:7208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273011328 00000100:00100000:1.0:1746065139.364736:0:7208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273011328 00000100:00100000:3.0:1746065139.364738:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273011968 00000100:00100000:3.0:1746065139.364740:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273011968 00000100:00100000:0.0:1746065139.364742:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1183 00000100:00100000:0.0:1746065139.364747:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273011456:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065139.364753:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1184 00000100:00100000:1.0:1746065139.364754:0:7208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 561 00000100:00100000:3.0:1746065139.364758:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2003:x1830881273011584:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1746065139.364759:0:7208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70506d4b-f74d-460b-a2d0-0f9fd3b6e38b+12:2003:x1830881273011328:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065139.364774:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273011456:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 27us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.364775:0:7208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70506d4b-f74d-460b-a2d0-0f9fd3b6e38b+12:2003:x1830881273011328:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 17us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.364779:0:7208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 561 00000100:00100000:0.0:1746065139.364780:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1183 00000100:00100000:3.0:1746065139.364781:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2003:x1830881273011584:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 23us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.364786:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1184 00000100:00100000:0.0:1746065139.364790:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1185 00000100:00100000:0.0:1746065139.364794:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2003:x1830881273011840:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065139.364795:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1186 00000100:00080000:1.0:1746065139.364795:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746065139.364797:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065139.364799:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273011968:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065139.364810:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2003:x1830881273011840:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 15us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.364814:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1185 00000100:00100000:2.0:1746065139.364854:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273011712 00000100:00100000:2.0:1746065139.364857:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273011712 00000100:00100000:2.0:1746065139.364880:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 819 00000100:00100000:2.0:1746065139.364884:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2002:x1830881273011712:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1746065139.364904:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2002:x1830881273011712:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 20us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.364909:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 819 00000100:00100000:2.0:1746065139.364951:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.364962:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273012096 00000100:00100000:2.0:1746065139.364965:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273012096 00000100:00100000:2.0:1746065139.364981:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 820 00000100:00100000:2.0:1746065139.364986:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273012096:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065139.365007:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273011968:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 206us (323us total) trans 0 rc 0/0 00000100:00080000:1.0:1746065139.365008:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065139.365014:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273012096:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 28us (63us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.365017:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1186 00000100:00100000:2.0:1746065139.365019:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 820 00000100:00100000:3.0:1746065139.365393:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267710720:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.365403:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.365426:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2005:x1830881273011200:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1318us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.365434:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14410 00000100:00100000:0.0:1746065139.365795:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.365858:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273012352 00000100:00100000:3.0:1746065139.365862:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273012352 00002000:00100000:3.0:1746065139.366004:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc10a80 x1830881273012352/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.366014:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10a80 with x1830881273012352 ext(0->4095) 00002000:00010000:3.0:1746065139.366017:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc10a80 00000100:00100000:3.0:1746065139.366061:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13660 00000100:00100000:3.0:1746065139.366067:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273012352:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.366208:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273012352:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 141us (412us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.366214:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13660 00002000:00100000:3.0:1746065139.366218:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc10a80 x1830881273012352/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.366226:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10a80 with x1830881273012352 ext(0->4095) 00002000:00010000:3.0:1746065139.366228:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc10a80 00000100:00100000:0.0:1746065139.366321:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.366356:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273012480 00000100:00100000:1.0:1746065139.366359:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273012480 00000100:00100000:1.0:1746065139.366382:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30439 00000100:00100000:1.0:1746065139.366386:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1791:x1830881273012480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.366392:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.366405:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f6b expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.366426:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.366432:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.366434:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.366436:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.366482:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.366492:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 5 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.366501:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267710848:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065139.366547:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.367480:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.367630:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273012608 00000100:00100000:3.0:1746065139.367634:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273012608 00000100:00100000:3.0:1746065139.367666:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30440 00000100:00100000:3.0:1746065139.367671:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881273012608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.367678:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.367686:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f72 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.367702:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.367706:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.368013:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.368018:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.368039:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.368049:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.368056:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065139.368291:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1795:x1830881273012608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 619us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.368297:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30440 00000100:00100000:1.0:1746065139.368524:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267710848:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065139.368538:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.368546:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:1.0:1746065139.368574:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273012480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2187us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.368579:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30439 00000100:00100000:0.0:1746065139.369125:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.369235:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273012736 00000100:00100000:3.0:1746065139.369240:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273012736 00010000:00010000:3.0:1746065139.369256:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.369282:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14411 00000100:00100000:3.0:1746065139.369287:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273012736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.369295:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.369309:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.369318:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.369334:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f87fff3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f64 expref: 6 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.369345:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.369346:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.369352:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.369359:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.369378:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.369387:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.369397:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267711104:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.369450:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.371338:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267711104:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.371559:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.371601:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273012736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2313us (2477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.371611:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14411 00000100:00100000:0.0:1746065139.371660:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.371717:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273012992 00000100:00100000:3.0:1746065139.371721:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273012992 00002000:00100000:3.0:1746065139.371746:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728700 x1830881273012992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.371755:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728700 with x1830881273012992 ext(0->4095) 00010000:00010000:3.0:1746065139.371761:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.371771:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.371776:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f728700 00000100:00100000:3.0:1746065139.371789:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2909 00000100:00100000:3.0:1746065139.371794:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273012992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.371890:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273012992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (230us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.371895:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2909 00002000:00100000:3.0:1746065139.371900:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728700 x1830881273012992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.371906:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728700 with x1830881273012992 ext(0->4095) 00010000:00010000:3.0:1746065139.371910:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.371922:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.371927:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f728700 00000100:00100000:0.0:1746065139.373697:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.373777:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273013120 00000100:00100000:3.0:1746065139.373781:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273013120 00010000:00010000:3.0:1746065139.373797:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.373827:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14412 00000100:00100000:3.0:1746065139.373833:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273013120:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.373842:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.373854:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.373862:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.373883:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f87fffa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f6b expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.373894:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.373895:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.373900:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.373912:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.373951:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.373961:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267711232:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.374222:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.376175:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267711232:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.376189:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.376215:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273013120:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2381us (2520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.376223:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14412 00000100:00100000:0.0:1746065139.376689:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.376735:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273013376 00000100:00100000:2.0:1746065139.376740:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273013376 00002000:00100000:2.0:1746065139.376764:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72ad80 x1830881273013376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.376772:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72ad80 with x1830881273013376 ext(0->4095) 00002000:00010000:2.0:1746065139.376776:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72ad80 00000100:00100000:2.0:1746065139.376799:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13661 00000100:00100000:2.0:1746065139.376804:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273013376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.376909:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273013376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 104us (221us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.376914:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13661 00002000:00100000:2.0:1746065139.376919:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72ad80 x1830881273013376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.376923:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72ad80 with x1830881273013376 ext(0->4095) 00002000:00010000:2.0:1746065139.376925:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72ad80 00000100:00100000:0.0:1746065139.378230:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.378272:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273013504 00000100:00100000:1.0:1746065139.378277:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273013504 00000100:00100000:1.0:1746065139.378314:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30441 00000100:00100000:1.0:1746065139.378320:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273013504:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.378329:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.378341:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f79 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.378363:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.378370:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.378372:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.378375:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.378396:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.378406:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 97 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.378415:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267711360:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065139.378483:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.380278:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267711360:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065139.380303:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.380315:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065139.380345:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273013504:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2025us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.380352:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30441 00000100:00100000:0.0:1746065139.380618:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.380667:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273013632 00000100:00100000:3.0:1746065139.380673:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273013632 00010000:00010000:3.0:1746065139.380692:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.380711:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14413 00000100:00100000:3.0:1746065139.380716:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273013632:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.380725:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.380740:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.380749:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.380767:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880001 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f72 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.380776:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.380777:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.380783:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.380790:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.380811:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.380821:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267711488:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.380860:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.383838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.383849:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267711488:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.383884:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.383927:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273013888 00000100:00100000:2.0:1746065139.383946:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273013888 00002000:00100000:2.0:1746065139.383976:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72b800 x1830881273013888/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065139.383989:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2005:x1830881273013632:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3266us (3364us total) trans 0 rc 0/0 00002000:00100000:2.0:1746065139.383992:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72b800 with x1830881273013888 ext(0->4095) 00002000:00010000:2.0:1746065139.383996:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72b800 00000100:00100000:3.0:1746065139.384010:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14413 00000100:00100000:2.0:1746065139.384014:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13662 00000100:00100000:2.0:1746065139.384020:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273013888:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.384144:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273013888:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 123us (312us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.384150:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13662 00002000:00100000:2.0:1746065139.384155:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72b800 x1830881273013888/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.384161:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72b800 with x1830881273013888 ext(0->4095) 00002000:00010000:2.0:1746065139.384164:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72b800 00000100:00100000:0.0:1746065139.385454:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.386318:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273014016 00000100:00100000:1.0:1746065139.386325:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273014016 00000100:00100000:1.0:1746065139.386378:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30442 00000100:00100000:1.0:1746065139.386385:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1795:x1830881273014016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.386398:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.386412:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f80 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.386432:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.386439:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.386441:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.386444:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.386467:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.386477:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.386488:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267711616:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065139.386552:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.387205:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.387341:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273014144 00000100:00100000:3.0:1746065139.387345:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273014144 00000100:00100000:3.0:1746065139.387434:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30443 00000100:00100000:3.0:1746065139.387482:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273014144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.387524:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.387580:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f87 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.387672:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.387706:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.387713:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.387738:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.387838:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.387894:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.387923:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065139.388047:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273014144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 588us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.388070:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30443 00000100:00100000:1.0:1746065139.388227:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267711616:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065139.388240:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.388254:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065139.388273:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881273014016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1889us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.388282:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30442 00000100:00100000:2.0:1746065139.388585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.388627:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273014272 00000100:00100000:3.0:1746065139.388630:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273014272 00010000:00010000:3.0:1746065139.388645:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.388672:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14414 00000100:00100000:3.0:1746065139.388678:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273014272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.388685:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.388697:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.388707:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.388720:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f880008 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f79 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.388728:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.388730:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.388735:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.388742:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.388757:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.388765:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.388773:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267711872:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.388825:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.390637:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267711872:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.390651:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.390691:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273014272:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2012us (2107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.390699:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14414 00000100:00100000:0.0:1746065139.391756:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.392107:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273014528 00000100:00100000:2.0:1746065139.392114:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273014528 00002000:00100000:2.0:1746065139.392144:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f729500 x1830881273014528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.392153:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729500 with x1830881273014528 ext(0->4095) 00010000:00010000:2.0:1746065139.392160:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.392171:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.392177:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f729500 00000100:00100000:2.0:1746065139.392198:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2910 00000100:00100000:2.0:1746065139.392205:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273014528:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.392318:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273014528:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 113us (565us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.392324:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2910 00002000:00100000:2.0:1746065139.392329:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f729500 x1830881273014528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.392336:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729500 with x1830881273014528 ext(0->4095) 00010000:00010000:2.0:1746065139.392340:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.392349:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.392354:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f729500 00000100:00100000:0.0:1746065139.393959:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.393993:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273014656 00000100:00100000:1.0:1746065139.393997:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273014656 00000100:00100000:1.0:1746065139.394023:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30444 00000100:00100000:1.0:1746065139.394027:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273014656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.394034:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.394045:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f8e expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.394059:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.394062:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.394065:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065139.394068:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.394108:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.394115:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.394121:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065139.394142:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273014656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 115us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.394146:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30444 00000100:00100000:0.0:1746065139.394807:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.394847:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273014784 00000100:00100000:3.0:1746065139.394851:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273014784 00010000:00010000:3.0:1746065139.394865:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.394883:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14415 00000100:00100000:3.0:1746065139.394886:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273014784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.394893:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.394903:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.394910:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.394921:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f88000f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f80 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.394942:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.394944:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.394949:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.394956:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.394978:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.394986:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.394995:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267712128:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.395045:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.395801:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267712128:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.395810:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.395841:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273014784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 953us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.395848:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14415 00000100:00100000:0.0:1746065139.396041:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.396106:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273015040 00000100:00100000:3.0:1746065139.396109:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273015040 00002000:00100000:3.0:1746065139.396127:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72a680 x1830881273015040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.396135:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a680 with x1830881273015040 ext(0->4095) 00010000:00010000:3.0:1746065139.396140:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.396149:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.396154:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72a680 00000100:00100000:3.0:1746065139.396167:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2911 00000100:00100000:3.0:1746065139.396177:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273015040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.396256:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273015040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 79us (215us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.396261:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2911 00002000:00100000:3.0:1746065139.396266:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72a680 x1830881273015040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.396273:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a680 with x1830881273015040 ext(0->4095) 00010000:00010000:3.0:1746065139.396277:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.396295:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.396300:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72a680 00000100:00100000:0.0:1746065139.397110:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.397156:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.397200:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273015168 00000100:00100000:1.0:1746065139.397204:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273015168 00000100:00100000:3.0:1746065139.397218:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273015296 00000100:00100000:3.0:1746065139.397222:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273015296 00010000:00010000:3.0:1746065139.397234:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.397237:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30445 00000100:00100000:1.0:1746065139.397243:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273015168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.397250:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065139.397256:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14416 00010000:00010000:1.0:1746065139.397258:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f95 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.397261:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2002:x1830881273015296:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.397268:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.397271:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.397276:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.397281:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065139.397284:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.397291:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 100 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.397302:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.397305:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 100 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.397324:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880016 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f87 expref: 100 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.397325:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.397331:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.397332:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.397336:0:21550:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.397341:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.397352:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065139.397358:0:21550:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.397366:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.397374:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267712384:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.397382:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2002:x1830881273015296:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 120us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.397388:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14416 00000100:00100000:1.0:1746065139.397417:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.398414:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267712384:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.398424:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065139.398440:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273015168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1198us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.398444:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30445 00000100:00100000:0.0:1746065139.398665:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.398701:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273015552 00000100:00100000:3.0:1746065139.398705:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273015552 00002000:00100000:3.0:1746065139.398723:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72bb80 x1830881273015552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.398731:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72bb80 with x1830881273015552 ext(0->4095) 00010000:00010000:3.0:1746065139.398736:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.398746:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.398752:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72bb80 00000100:00100000:3.0:1746065139.398769:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2912 00000100:00100000:3.0:1746065139.398775:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273015552:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.398837:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273015552:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 62us (172us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.398842:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2912 00002000:00100000:3.0:1746065139.398847:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72bb80 x1830881273015552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.398853:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72bb80 with x1830881273015552 ext(0->4095) 00010000:00010000:3.0:1746065139.398857:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.398866:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.398871:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72bb80 00000100:00100000:2.0:1746065139.400425:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.400475:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273015680 00000100:00100000:3.0:1746065139.400479:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273015680 00010000:00010000:3.0:1746065139.400498:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.400529:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14417 00000100:00100000:3.0:1746065139.400535:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273015680:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.400544:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.400556:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.400565:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.400582:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88001d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f8e expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.400593:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.400595:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.400600:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.400608:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.400629:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.400638:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267712512:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.400738:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.401458:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267712512:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.401469:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.401500:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273015680:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 962us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.401507:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14417 00000100:00100000:0.0:1746065139.401903:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.402107:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273015936 00000100:00100000:3.0:1746065139.402112:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273015936 00002000:00100000:3.0:1746065139.402133:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72b100 x1830881273015936/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.402141:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72b100 with x1830881273015936 ext(0->4095) 00002000:00010000:3.0:1746065139.402145:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72b100 00000100:00100000:3.0:1746065139.402164:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13663 00000100:00100000:3.0:1746065139.402171:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273015936:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.402257:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273015936:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 85us (353us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.402263:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13663 00002000:00100000:3.0:1746065139.402268:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72b100 x1830881273015936/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.402274:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72b100 with x1830881273015936 ext(0->4095) 00002000:00010000:3.0:1746065139.402277:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72b100 00000100:00100000:2.0:1746065139.403466:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.403522:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273016064 00000100:00100000:1.0:1746065139.403528:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273016064 00000100:00100000:1.0:1746065139.403560:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30446 00000100:00100000:1.0:1746065139.403566:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273016064:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.403575:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.403587:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5f9c expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.403605:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.403614:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.403615:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.403618:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.403633:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.403640:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 97 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.403647:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267712640:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065139.403695:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.405023:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267712640:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065139.405040:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.405051:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746065139.405105:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273016064:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1535us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.405111:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30446 00000100:00100000:0.0:1746065139.405520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.405568:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273016192 00000100:00100000:3.0:1746065139.405577:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273016192 00010000:00010000:3.0:1746065139.405595:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.405623:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14418 00000100:00100000:3.0:1746065139.405628:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273016192:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.405638:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.405650:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.405658:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.405673:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880024 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f95 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.405680:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.405682:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.405686:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.405691:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.405705:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.405711:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267712768:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.405761:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.407223:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.407272:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273016448 00000100:00100000:2.0:1746065139.407277:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273016448 00000100:00100000:3.0:1746065139.407279:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267712768:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.407290:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746065139.407303:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5880 x1830881273016448/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.407311:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5880 with x1830881273016448 ext(0->4095) 00002000:00010000:2.0:1746065139.407314:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a5880 00000100:00100000:3.0:1746065139.407342:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2004:x1830881273016192:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1712us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.407343:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13664 00000100:00100000:3.0:1746065139.407349:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14418 00000100:00100000:2.0:1746065139.407349:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273016448:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.407433:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273016448:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 84us (215us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.407439:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13664 00002000:00100000:2.0:1746065139.407443:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5880 x1830881273016448/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.407450:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5880 with x1830881273016448 ext(0->4095) 00002000:00010000:2.0:1746065139.407452:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a5880 00000100:00100000:0.0:1746065139.409537:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.409914:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273016576 00000100:00100000:1.0:1746065139.409921:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273016576 00000100:00100000:1.0:1746065139.409965:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30447 00000100:00100000:1.0:1746065139.409971:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1795:x1830881273016576:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.409984:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.409996:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5fa3 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.410017:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.410022:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.410023:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.410026:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.410046:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.410055:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.410063:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267712896:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065139.410205:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.411398:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267712896:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065139.411416:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.411427:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:1.0:1746065139.411459:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1795:x1830881273016576:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1488us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.411468:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30447 00000100:00100000:0.0:1746065139.411624:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.411748:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273016704 00000100:00100000:3.0:1746065139.411752:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273016704 00010000:00010000:3.0:1746065139.411771:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.411789:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14419 00000100:00100000:3.0:1746065139.411794:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273016704:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.411802:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.411816:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.411829:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.411845:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fc00/0x392ae0376f88002b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5f9c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.411857:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.411858:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.411863:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.411869:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.411888:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.411897:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267713024:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.411956:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.412652:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.412703:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273016832 00000100:00100000:1.0:1746065139.412707:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273016832 00000100:00100000:1.0:1746065139.413076:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30448 00000100:00100000:1.0:1746065139.413105:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273016832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.413115:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.413124:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5faa expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.413137:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.413142:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.413144:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.413147:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.413162:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.413170:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.413178:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267713152:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065139.413211:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.413304:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267713024:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.413313:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.413329:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273016704:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1535us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.413335:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14419 00000100:00100000:0.0:1746065139.413956:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.414164:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273017088 00000100:00100000:1.0:1746065139.414168:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273017088 00002000:00100000:1.0:1746065139.414189:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a7100 x1830881273017088/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.414197:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7100 with x1830881273017088 ext(0->4095) 00010000:00010000:1.0:1746065139.414201:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.414211:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.414216:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a7100 00000100:00100000:1.0:1746065139.414233:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2913 00000100:00100000:1.0:1746065139.414237:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273017088:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.414399:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273017088:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 160us (443us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.414404:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2913 00002000:00100000:1.0:1746065139.414409:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a7100 x1830881273017088/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.414416:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7100 with x1830881273017088 ext(0->4095) 00010000:00010000:1.0:1746065139.414420:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.414427:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.414432:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a7100 00000100:00100000:1.0:1746065139.414453:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267713152:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065139.414462:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.414471:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:1.0:1746065139.414485:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273016832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1404us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.414490:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30448 00000100:00100000:0.0:1746065139.415599:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.415625:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.415632:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273017216 00000100:00100000:1.0:1746065139.415636:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273017216 00000100:00100000:1.0:1746065139.415662:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30449 00000100:00100000:1.0:1746065139.415668:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273017216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.415675:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.415684:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5fb1 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.415686:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273017344 00000100:00100000:3.0:1746065139.415690:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273017344 00010000:00010000:1.0:1746065139.415696:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.415700:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.415700:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.415705:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065139.415707:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.415713:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14420 00000100:00100000:3.0:1746065139.415717:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2003:x1830881273017344:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.415722:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.415724:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.415731:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.415732:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.415739:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.415755:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0f000/0x392ae0376f880032 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fa3 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.415755:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.415756:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.415760:0:21550:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.415767:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.415829:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065139.415835:0:21550:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.415844:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.415853:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267713408:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.415903:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2003:x1830881273017344:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 184us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.415909:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14420 00000100:00100000:1.0:1746065139.415920:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.416899:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267713408:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.416908:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00000100:00100000:1.0:1746065139.416928:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273017216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1260us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.416945:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30449 00000100:00100000:2.0:1746065139.417566:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.417604:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273017600 00000100:00100000:1.0:1746065139.417608:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273017600 00002000:00100000:1.0:1746065139.417626:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072978a80 x1830881273017600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.417636:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978a80 with x1830881273017600 ext(0->4095) 00010000:00010000:1.0:1746065139.417640:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.417646:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.417650:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978a80 00000100:00100000:1.0:1746065139.417667:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2914 00000100:00100000:1.0:1746065139.417671:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273017600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.417737:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273017600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 65us (172us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.417740:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2914 00002000:00100000:1.0:1746065139.417743:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072978a80 x1830881273017600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.417748:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978a80 with x1830881273017600 ext(0->4095) 00010000:00010000:1.0:1746065139.417750:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.417755:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.417759:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978a80 00000100:00100000:0.0:1746065139.418724:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.418822:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.418857:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273017856 00000100:00100000:3.0:1746065139.418861:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273017856 00000100:00100000:1.0:1746065139.418868:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273017728 00000100:00100000:1.0:1746065139.418871:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273017728 00010000:00010000:3.0:1746065139.418875:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.418889:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14421 00000100:00100000:1.0:1746065139.418889:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30450 00000100:00100000:3.0:1746065139.418894:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273017856:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065139.418894:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273017728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.418900:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.418902:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.418908:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5fb8 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.418911:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.418918:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.419028:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.419033:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.419038:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065139.419041:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.419052:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e600/0x392ae0376f880039 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5faa expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.419060:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.419061:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.419065:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.419071:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.419120:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.419129:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70080400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.419138:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267713536:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.419143:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.419149:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.419155:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267713664:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.419186:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.419193:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.420131:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267713536:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065139.420143:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.420150:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065139.420174:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273017728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1280us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.420179:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30450 00000100:00100000:3.0:1746065139.420384:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267713664:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.420392:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.420414:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273017856:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1520us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.420419:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14421 00000100:00100000:2.0:1746065139.420650:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.420777:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273018112 00000100:00100000:0.0:1746065139.420782:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273018112 00002000:00100000:0.0:1746065139.420801:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072978380 x1830881273018112/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.420810:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978380 with x1830881273018112 ext(0->4095) 00010000:00010000:0.0:1746065139.420814:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.420824:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065139.420834:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978380 00000100:00100000:0.0:1746065139.420948:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2915 00000100:00100000:0.0:1746065139.420954:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273018112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065139.421212:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273018112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 257us (562us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065139.421218:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2915 00002000:00100000:0.0:1746065139.421223:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072978380 x1830881273018112/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.421230:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978380 with x1830881273018112 ext(0->4095) 00010000:00010000:0.0:1746065139.421235:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.421243:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065139.421248:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978380 00000100:00100000:0.0:1746065139.422198:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.422237:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273018240 00000100:00100000:3.0:1746065139.422241:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273018240 00010000:00010000:3.0:1746065139.422255:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.422279:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14422 00000100:00100000:3.0:1746065139.422285:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273018240:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.422294:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.422303:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.422311:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.422326:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880040 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb1 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.422335:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.422337:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.422342:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.422349:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.422371:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.422381:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267713792:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.422434:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.423712:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267713792:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.423722:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.423753:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273018240:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1468us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.423760:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14422 00000100:00100000:0.0:1746065139.424801:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.424871:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273018496 00000100:00100000:2.0:1746065139.424877:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273018496 00002000:00100000:2.0:1746065139.424906:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a7b80 x1830881273018496/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.424914:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7b80 with x1830881273018496 ext(0->4095) 00002000:00010000:2.0:1746065139.424918:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a7b80 00000100:00100000:2.0:1746065139.424948:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13665 00000100:00100000:2.0:1746065139.424954:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273018496:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.425043:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273018496:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (245us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.425055:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13665 00002000:00100000:2.0:1746065139.425060:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a7b80 x1830881273018496/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.425066:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7b80 with x1830881273018496 ext(0->4095) 00002000:00010000:2.0:1746065139.425069:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a7b80 00000100:00100000:0.0:1746065139.427001:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.427076:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273018624 00000100:00100000:1.0:1746065139.427121:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273018624 00000100:00100000:1.0:1746065139.427158:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30451 00000100:00100000:1.0:1746065139.427164:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273018624:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.427175:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.427188:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5fbf expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.427208:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.427215:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.427217:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.427220:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.427241:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.427250:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 97 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.427260:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267713920:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065139.427314:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.428459:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267713920:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065139.428476:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.428486:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:1.0:1746065139.428508:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273018624:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1345us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.428513:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30451 00000100:00100000:0.0:1746065139.430641:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.430756:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273018752 00000100:00100000:3.0:1746065139.430763:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273018752 00010000:00010000:3.0:1746065139.430789:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.430818:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14423 00000100:00100000:3.0:1746065139.430823:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273018752:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.430834:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.430848:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.430857:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.430873:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f880047 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fb8 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.430897:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.430899:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.430905:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.430912:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.430945:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.430956:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267714048:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.431111:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.433055:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.433303:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267714048:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.433306:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273019008 00000100:00100000:2.0:1746065139.433311:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273019008 00010000:00010000:3.0:1746065139.433317:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746065139.433343:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18df80 x1830881273019008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.433352:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18df80 with x1830881273019008 ext(0->4095) 00002000:00010000:2.0:1746065139.433356:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f18df80 00000100:00100000:3.0:1746065139.433362:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2005:x1830881273018752:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2538us (2727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.433371:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14423 00000100:00100000:2.0:1746065139.433371:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13666 00000100:00100000:2.0:1746065139.433377:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273019008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.433468:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273019008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 91us (416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.433473:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13666 00002000:00100000:2.0:1746065139.433477:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18df80 x1830881273019008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.433483:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18df80 with x1830881273019008 ext(0->4095) 00002000:00010000:2.0:1746065139.433486:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f18df80 00000100:00100000:0.0:1746065139.435392:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.435461:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.435529:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273019136 00000100:00100000:1.0:1746065139.435534:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273019136 00000100:00100000:1.0:1746065139.435570:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273019264 00000100:00100000:1.0:1746065139.435572:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273019264 00000100:00100000:1.0:1746065139.435586:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30452 00000100:00100000:1.0:1746065139.435592:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273019136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.435603:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.435616:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5fc6 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.435641:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.435647:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.435648:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.435650:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.435663:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30453 00000100:00100000:3.0:1746065139.435671:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881273019264:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.435672:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.435678:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.435685:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5fcd expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.435686:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.435696:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065139.435696:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267714176:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.435700:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.435704:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.435707:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.435724:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.435735:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.435743:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:1.0:1746065139.435747:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.435761:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1795:x1830881273019264:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.435766:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30453 00000100:00100000:0.0:1746065139.437518:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.437559:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273019392 00000100:00100000:3.0:1746065139.437564:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273019392 00010000:00010000:3.0:1746065139.437580:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.437594:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14424 00000100:00100000:1.0:1746065139.437597:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267714176:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.437598:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273019392:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.437604:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.437612:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.437616:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.437622:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e800, rc 0) 00010000:00010000:3.0:1746065139.437625:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.437638:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e000/0x392ae0376f88004e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fbf expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.437645:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273019136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2053us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.437651:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30452 00010000:00010000:3.0:1746065139.437655:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.437656:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.437660:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.437664:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.437678:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.437684:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.437689:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267714432:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.437716:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.439054:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267714432:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.439063:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.439113:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273019392:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1512us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.439123:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14424 00000100:00100000:0.0:1746065139.439377:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.439465:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273019648 00000100:00100000:2.0:1746065139.439469:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273019648 00002000:00100000:2.0:1746065139.439492:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18ce00 x1830881273019648/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.439500:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18ce00 with x1830881273019648 ext(0->4095) 00010000:00010000:2.0:1746065139.439505:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.439515:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.439522:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18ce00 00000100:00100000:2.0:1746065139.439551:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2916 00000100:00100000:2.0:1746065139.439557:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273019648:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.439654:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273019648:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 97us (276us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.439659:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2916 00002000:00100000:2.0:1746065139.439664:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18ce00 x1830881273019648/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.439670:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18ce00 with x1830881273019648 ext(0->4095) 00010000:00010000:2.0:1746065139.439674:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.439683:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.439689:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18ce00 00000100:00100000:0.0:1746065139.441263:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.441386:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273019776 00000100:00100000:3.0:1746065139.441392:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273019776 00010000:00010000:3.0:1746065139.441413:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.441432:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14425 00000100:00100000:3.0:1746065139.441438:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273019776:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.441448:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.441461:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.441471:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.441489:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0e800/0x392ae0376f880055 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fc6 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.441667:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.441669:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.441676:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.441684:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.441709:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 98 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.441720:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267714560:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.442099:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.443714:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267714560:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.443728:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.443756:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273019776:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2317us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.443764:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14425 00000100:00100000:0.0:1746065139.444384:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.444445:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273020032 00000100:00100000:3.0:1746065139.444451:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273020032 00002000:00100000:3.0:1746065139.444478:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091e300 x1830881273020032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.444487:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091e300 with x1830881273020032 ext(0->4095) 00002000:00010000:3.0:1746065139.444491:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091e300 00000100:00100000:3.0:1746065139.444511:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13667 00000100:00100000:3.0:1746065139.444517:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273020032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.444615:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273020032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (232us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.444621:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13667 00002000:00100000:3.0:1746065139.444626:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091e300 x1830881273020032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.444633:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091e300 with x1830881273020032 ext(0->4095) 00002000:00010000:3.0:1746065139.444635:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091e300 00000100:00100000:0.0:1746065139.447582:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.449215:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273020160 00000100:00100000:1.0:1746065139.449224:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273020160 00000100:00100000:1.0:1746065139.449276:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30454 00000100:00100000:1.0:1746065139.449282:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273020160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.449297:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.449310:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5fd4 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.449333:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.449345:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.449347:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.449350:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.449372:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 97 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.449383:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 97 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.449393:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267714688:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065139.449480:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.453142:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267714688:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.453166:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.453181:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130641c00, rc 0) 00000100:00100000:2.0:1746065139.453282:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273020160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3998us (5703us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.453290:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.453293:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30454 00000100:00100000:2.0:1746065139.453325:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273020288 00000100:00100000:2.0:1746065139.453330:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273020288 00010000:00010000:2.0:1746065139.453348:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.453375:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14426 00000100:00100000:2.0:1746065139.453381:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273020288:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.453391:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.453405:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.453413:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.453430:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88005c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fcd expref: 98 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.453452:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.453454:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.453460:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.453467:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.453490:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.453501:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267714816:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.453551:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.454890:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.455002:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.455044:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273020416 00000100:00100000:2.0:1746065139.455048:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273020416 00000100:00100000:2.0:1746065139.455078:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30455 00000100:00100000:2.0:1746065139.455101:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273020416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.455113:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.455123:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5fdb expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.455138:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.455144:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.455145:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.455148:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.455163:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.455172:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.455180:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267714944:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.455423:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273020672 00000100:00100000:3.0:1746065139.455427:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273020672 00002000:00100000:3.0:1746065139.455448:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091c380 x1830881273020672/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.455456:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091c380 with x1830881273020672 ext(0->4095) 00010000:00010000:3.0:1746065139.455461:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 7/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.455470:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 7/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.455476:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091c380 00000100:00100000:3.0:1746065139.455493:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2917 00000100:00100000:3.0:1746065139.455498:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273020672:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.455666:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273020672:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 167us (663us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.455672:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2917 00002000:00100000:3.0:1746065139.455676:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091c380 x1830881273020672/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.455683:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091c380 with x1830881273020672 ext(0->4095) 00010000:00010000:3.0:1746065139.455687:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 7/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.455695:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 7/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.455705:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091c380 00000100:00100000:3.0:1746065139.455730:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267714816:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.455739:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.455760:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273020288:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2379us (2471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.455766:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14426 00000100:00100000:2.0:1746065139.455822:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.456607:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267714944:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.456618:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.456626:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065139.456647:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273020416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1548us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.456651:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30455 00000100:00100000:0.0:1746065139.457336:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.457535:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.457581:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273020800 00000100:00100000:2.0:1746065139.457585:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273020800 00000100:00100000:2.0:1746065139.457615:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30456 00000100:00100000:2.0:1746065139.457620:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1795:x1830881273020800:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.457630:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.457640:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5fe2 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.457654:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.457658:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.457663:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.457666:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.457743:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273020928 00000100:00100000:3.0:1746065139.457747:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273020928 00010000:00010000:3.0:1746065139.457761:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.457783:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14427 00000100:00100000:3.0:1746065139.457787:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273020928:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.457794:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.457808:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.457816:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.457831:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880063 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fd4 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.457847:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.457848:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.457853:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.457860:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.457880:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.457889:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.457898:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267715072:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.457954:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065139.458054:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.458069:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.458077:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267715200:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.458122:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.459423:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267715072:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.459439:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.459463:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273020928:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1675us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.459470:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14427 00000100:00100000:0.0:1746065139.461610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.461800:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273021184 00000100:00100000:3.0:1746065139.461807:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273021184 00002000:00100000:3.0:1746065139.461838:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091f100 x1830881273021184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.461847:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f100 with x1830881273021184 ext(0->4095) 00010000:00010000:3.0:1746065139.461854:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.461871:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.461877:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091f100 00000100:00100000:3.0:1746065139.461902:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2918 00000100:00100000:3.0:1746065139.461908:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273021184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.462015:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267715200:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.462020:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273021184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 112us (415us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.462025:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2918 00002000:00100000:3.0:1746065139.462029:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091f100 x1830881273021184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1746065139.462034:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065139.462035:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f100 with x1830881273021184 ext(0->4095) 00010000:00010000:3.0:1746065139.462039:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.462045:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00010000:00010000:3.0:1746065139.462047:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.462052:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091f100 00000100:00100000:2.0:1746065139.462066:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881273020800:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4446us (4732us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.462072:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30456 00000100:00100000:0.0:1746065139.463399:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.463966:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273021312 00000100:00100000:3.0:1746065139.463972:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273021312 00010000:00010000:3.0:1746065139.463993:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.464060:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14428 00000100:00100000:3.0:1746065139.464068:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273021312:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.464078:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.464114:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.464124:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.464143:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88006a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fdb expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.464153:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.464154:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.464165:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.464172:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.464195:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.464206:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267715328:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.464264:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.465394:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267715328:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.465406:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.465429:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273021312:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1361us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.465437:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14428 00000100:00100000:0.0:1746065139.465738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.465795:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273021568 00000100:00100000:1.0:1746065139.465801:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273021568 00002000:00100000:1.0:1746065139.465826:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091d500 x1830881273021568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.465835:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091d500 with x1830881273021568 ext(0->4095) 00002000:00010000:1.0:1746065139.465839:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091d500 00000100:00100000:1.0:1746065139.465860:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13668 00000100:00100000:1.0:1746065139.465866:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273021568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.465966:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273021568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 100us (228us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.465971:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13668 00002000:00100000:1.0:1746065139.465976:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091d500 x1830881273021568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.465982:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091d500 with x1830881273021568 ext(0->4095) 00002000:00010000:1.0:1746065139.465984:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091d500 00000100:00100000:0.0:1746065139.467798:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.468045:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273021696 00000100:00100000:2.0:1746065139.468052:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273021696 00000100:00100000:2.0:1746065139.468115:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30457 00000100:00100000:2.0:1746065139.468123:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273021696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.468135:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.468148:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5fe9 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.468169:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.468180:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.468182:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.468184:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.468211:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 97 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.468222:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 97 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.468233:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267715456:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.468301:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.469702:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267715456:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.469722:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.469735:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065139.469768:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273021696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1645us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.469775:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30457 00000100:00100000:0.0:1746065139.469986:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.470127:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273021824 00000100:00100000:3.0:1746065139.470133:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273021824 00010000:00010000:3.0:1746065139.470661:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.470690:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14429 00000100:00100000:3.0:1746065139.470697:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2004:x1830881273021824:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.470712:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.470727:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.470737:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.470754:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880071 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe2 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.470777:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.470778:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.470785:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.470792:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.470814:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.470824:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267715584:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.470890:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.472337:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267715584:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.472347:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.472378:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:2004:x1830881273021824:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1682us (2392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.472384:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14429 00000100:00100000:0.0:1746065139.472866:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.472979:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273022080 00000100:00100000:1.0:1746065139.472985:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273022080 00002000:00100000:1.0:1746065139.473009:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091ca80 x1830881273022080/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.473018:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ca80 with x1830881273022080 ext(0->4095) 00002000:00010000:1.0:1746065139.473022:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091ca80 00000100:00100000:1.0:1746065139.473049:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13669 00000100:00100000:1.0:1746065139.473055:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273022080:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.473173:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273022080:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 118us (308us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.473178:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13669 00002000:00100000:1.0:1746065139.473183:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091ca80 x1830881273022080/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.473190:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ca80 with x1830881273022080 ext(0->4095) 00002000:00010000:1.0:1746065139.473193:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091ca80 00000100:00100000:0.0:1746065139.474868:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.474916:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273022208 00000100:00100000:2.0:1746065139.474921:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273022208 00000100:00100000:2.0:1746065139.475292:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30458 00000100:00100000:2.0:1746065139.475300:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+97:1795:x1830881273022208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.475314:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.475328:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ff0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.475355:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.475361:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.475362:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.475365:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.475388:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.475399:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.475409:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267715712:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.475738:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.477012:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.477819:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267715712:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.477840:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.477854:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065139.477883:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1795:x1830881273022208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2584us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.477893:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30458 00000100:00100000:2.0:1746065139.477913:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273022336 00000100:00100000:2.0:1746065139.477917:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273022336 00000100:00100000:2.0:1746065139.477962:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30459 00000100:00100000:2.0:1746065139.477968:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273022336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.477979:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.477989:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ff7 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.478004:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065139.478300:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065139.478579:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.478586:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.478589:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.478611:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.478616:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273022464 00000100:00100000:3.0:1746065139.478620:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273022464 00010000:00010000:2.0:1746065139.478620:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.478627:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00010000:00010000:3.0:1746065139.478636:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.478648:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273022336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 680us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.478653:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30459 00000100:00100000:3.0:1746065139.478662:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14430 00000100:00100000:3.0:1746065139.478668:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273022464:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.478675:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.478770:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.478780:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.478794:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880078 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5fe9 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.479197:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.479200:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.479206:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.479214:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.479231:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.479241:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.479252:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267715968:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.479312:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.480773:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267715968:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.480785:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.480813:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273022464:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2144us (2512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.480821:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14430 00000100:00100000:0.0:1746065139.481661:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.481744:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273022720 00000100:00100000:3.0:1746065139.481749:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273022720 00002000:00100000:3.0:1746065139.481775:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbdf80 x1830881273022720/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.481784:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdf80 with x1830881273022720 ext(0->4095) 00010000:00010000:3.0:1746065139.481790:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.481806:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.481812:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbdf80 00000100:00100000:3.0:1746065139.482153:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2919 00000100:00100000:3.0:1746065139.482160:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273022720:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.482484:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273022720:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 323us (822us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.482490:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2919 00002000:00100000:3.0:1746065139.482496:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbdf80 x1830881273022720/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.482503:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdf80 with x1830881273022720 ext(0->4095) 00010000:00010000:3.0:1746065139.482507:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.482516:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.482522:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbdf80 00000100:00100000:0.0:1746065139.485592:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.485791:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273022848 00000100:00100000:2.0:1746065139.485799:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273022848 00000100:00100000:2.0:1746065139.485880:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30460 00000100:00100000:2.0:1746065139.485887:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273022848:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.485900:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.485912:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e5ffe expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.485941:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.485947:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.485951:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065139.485955:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.485981:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.485993:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.486000:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065139.486030:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273022848:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 144us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.486035:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30460 00000100:00100000:0.0:1746065139.486212:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.486272:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273022976 00000100:00100000:3.0:1746065139.486275:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273022976 00010000:00010000:3.0:1746065139.486287:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.486316:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14431 00000100:00100000:3.0:1746065139.486322:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273022976:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.486329:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.486342:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.486351:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.486365:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88007f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff0 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.486377:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.486379:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.486384:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.486390:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.486408:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 98 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.486417:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.486427:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267716224:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.486486:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.488757:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267716224:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.488772:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.488848:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273022976:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2524us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.488856:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14431 00000100:00100000:0.0:1746065139.489664:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.489860:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273023232 00000100:00100000:3.0:1746065139.489865:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273023232 00002000:00100000:3.0:1746065139.489905:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbf800 x1830881273023232/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.489913:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881273023232 ext(0->4095) 00010000:00010000:3.0:1746065139.489920:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.489939:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.489946:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbf800 00000100:00100000:3.0:1746065139.489960:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2920 00000100:00100000:3.0:1746065139.489966:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273023232:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.490063:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273023232:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 97us (399us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.490069:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2920 00002000:00100000:3.0:1746065139.490074:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbf800 x1830881273023232/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.490098:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881273023232 ext(0->4095) 00010000:00010000:3.0:1746065139.490103:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.490112:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 98 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.490117:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbf800 00000100:00100000:0.0:1746065139.492339:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.492395:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273023360 00000100:00100000:1.0:1746065139.492403:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273023360 00000100:00100000:0.0:1746065139.492410:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.492866:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30461 00000100:00100000:1.0:1746065139.492874:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:1791:x1830881273023360:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.492887:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.492900:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6005 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.492919:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.492924:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.492942:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065139.492946:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.492974:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.492983:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.492991:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130641c00, rc 0) 00000100:00100000:1.0:1746065139.493023:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273023360:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 150us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.493029:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30461 00000100:00100000:3.0:1746065139.493257:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273023488 00000100:00100000:3.0:1746065139.493261:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273023488 00010000:00010000:3.0:1746065139.493277:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.493296:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14432 00000100:00100000:3.0:1746065139.493300:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2002:x1830881273023488:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.493307:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.493320:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.493330:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.493344:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880086 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ff7 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.493419:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.493422:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.493431:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.493441:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.493459:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.493469:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.493478:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267716480:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.493542:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.495229:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267716480:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.495242:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.495276:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2002:x1830881273023488:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1975us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.495284:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14432 00000100:00100000:0.0:1746065139.495863:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.496139:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273023744 00000100:00100000:1.0:1746065139.496144:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273023744 00002000:00100000:1.0:1746065139.496176:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbce00 x1830881273023744/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.496184:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbce00 with x1830881273023744 ext(0->4095) 00010000:00010000:1.0:1746065139.496191:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.496206:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.496212:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbce00 00000100:00100000:1.0:1746065139.496235:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2921 00000100:00100000:1.0:1746065139.496242:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273023744:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.496408:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273023744:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 166us (545us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.496414:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2921 00002000:00100000:1.0:1746065139.496419:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbce00 x1830881273023744/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.496426:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbce00 with x1830881273023744 ext(0->4095) 00010000:00010000:1.0:1746065139.496430:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.496439:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.496444:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbce00 00000100:00100000:0.0:1746065139.500775:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.500835:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273023872 00000100:00100000:3.0:1746065139.500842:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273023872 00010000:00010000:3.0:1746065139.500870:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.500966:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14433 00000100:00100000:3.0:1746065139.500973:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273023872:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.500985:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.501001:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.501011:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.501029:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88008d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e5ffe expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.501056:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.501058:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.501063:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.501069:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.501117:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.501128:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267716608:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.501413:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.504907:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267716608:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.504925:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.504982:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273023872:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4008us (4212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.504992:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14433 00000100:00100000:0.0:1746065139.505906:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.505983:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273024128 00000100:00100000:1.0:1746065139.505990:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273024128 00002000:00100000:1.0:1746065139.506021:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbe300 x1830881273024128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.506030:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbe300 with x1830881273024128 ext(0->4095) 00002000:00010000:1.0:1746065139.506034:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbe300 00000100:00100000:1.0:1746065139.506061:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13670 00000100:00100000:1.0:1746065139.506068:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273024128:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.506195:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273024128:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 127us (290us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.506201:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13670 00002000:00100000:1.0:1746065139.506206:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbe300 x1830881273024128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.506213:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbe300 with x1830881273024128 ext(0->4095) 00002000:00010000:1.0:1746065139.506215:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbe300 00000100:00100000:0.0:1746065139.508038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.508480:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273024256 00000100:00100000:2.0:1746065139.508488:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273024256 00000100:00100000:2.0:1746065139.508536:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30462 00000100:00100000:2.0:1746065139.508543:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273024256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.508557:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.508571:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e600c expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.508596:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.508603:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.508604:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.508607:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.508631:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 97 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.508640:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 97 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.508651:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267716736:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.508728:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.518752:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267716736:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.518780:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.518795:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065139.518837:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273024256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 10294us (10803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.518845:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30462 00000100:00100000:0.0:1746065139.523049:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.523114:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273024384 00000100:00100000:1.0:1746065139.523122:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273024384 00002000:00100000:1.0:1746065139.523159:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fbbdc00 x1830881273024384/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.523167:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdc00 with x1830881273024384 ext(0->7) 00010000:00010000:1.0:1746065139.523175:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.523188:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 98 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.523194:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbdc00 00000100:00100000:1.0:1746065139.523763:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2922 00000100:00100000:1.0:1746065139.523770:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+98:2005:x1830881273024384:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065139.528158:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273024384:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 4379us (5106us total) trans 4294972112 rc 0/0 00000100:00100000:0.0:1746065139.528170:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2922 00002000:00100000:0.0:1746065139.528181:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fbbdc00 x1830881273024384/t4294972112(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/448 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.528290:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdc00 with x1830881273024384 ext(0->7) 00010000:00010000:0.0:1746065139.528306:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.528321:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065139.528327:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbdc00 00000100:00100000:0.0:1746065139.530827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.530888:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273024512 00000100:00100000:2.0:1746065139.530896:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273024512 00000100:00100000:0.0:1746065139.530915:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.530949:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30463 00000100:00100000:2.0:1746065139.530956:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273024512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.530971:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.530984:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6013 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.531005:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.531010:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.531016:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065139.531018:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.531045:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.531056:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.531065:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065139.531134:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1791:x1830881273024512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 178us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.531142:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30463 00000100:00100000:3.0:1746065139.531303:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273024640 00000100:00100000:3.0:1746065139.531308:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273024640 00010000:00010000:3.0:1746065139.531323:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.531340:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14434 00000100:00100000:3.0:1746065139.531345:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2004:x1830881273024640:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.531352:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.531366:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.531376:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.531389:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f880094 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6005 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.531402:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.531403:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.531408:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.531414:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.531431:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.531441:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.531451:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267716992:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.532019:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.534006:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.534146:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267716992:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.534160:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.534179:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273024896 00000100:00100000:1.0:1746065139.534185:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273024896 00002000:00100000:1.0:1746065139.534224:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09ff100 x1830881273024896/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.534234:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09ff100 with x1830881273024896 ext(0->4095) 00010000:00010000:1.0:1746065139.534240:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.534249:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.534250:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273024640:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2903us (3333us total) trans 0 rc 0/0 00002000:00010000:1.0:1746065139.534254:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09ff100 00000100:00100000:3.0:1746065139.534259:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14434 00000100:00100000:1.0:1746065139.534273:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2923 00000100:00100000:1.0:1746065139.534279:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273024896:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.534380:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273024896:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 100us (378us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.534385:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2923 00002000:00100000:1.0:1746065139.534390:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09ff100 x1830881273024896/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.534397:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09ff100 with x1830881273024896 ext(0->4095) 00010000:00010000:1.0:1746065139.534402:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.534411:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.534416:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09ff100 00000100:00100000:0.0:1746065139.537313:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.538015:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273025024 00000100:00100000:3.0:1746065139.538022:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273025024 00010000:00010000:3.0:1746065139.538050:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.538111:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14435 00000100:00100000:3.0:1746065139.538118:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273025024:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.538130:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.538146:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.538156:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.538174:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88009b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e600c expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.538186:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.538188:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.538195:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.538202:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.538228:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.538239:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267717120:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.538316:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.542489:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267717120:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.542508:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.542558:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273025024:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4440us (5249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.542568:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14435 00000100:00100000:0.0:1746065139.542815:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.543140:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273025280 00000100:00100000:1.0:1746065139.543146:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273025280 00002000:00100000:1.0:1746065139.543174:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fce00 x1830881273025280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.543183:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fce00 with x1830881273025280 ext(0->4095) 00002000:00010000:1.0:1746065139.543186:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fce00 00000100:00100000:1.0:1746065139.543198:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13671 00000100:00100000:1.0:1746065139.543202:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273025280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.543295:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273025280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 92us (480us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.543299:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13671 00002000:00100000:1.0:1746065139.543304:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fce00 x1830881273025280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.543310:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fce00 with x1830881273025280 ext(0->4095) 00002000:00010000:1.0:1746065139.543312:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fce00 00000100:00100000:0.0:1746065139.545058:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.545423:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273025408 00000100:00100000:2.0:1746065139.545431:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273025408 00000100:00100000:2.0:1746065139.545466:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30464 00000100:00100000:2.0:1746065139.545472:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273025408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.545484:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.545497:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e601a expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.545518:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.545524:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.545526:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.545529:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.545553:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.545565:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 99 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.545575:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267717248:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.545642:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.547512:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267717248:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.547535:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.547548:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065139.547575:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273025408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2103us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.547582:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30464 00000100:00100000:0.0:1746065139.548038:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.548107:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273025536 00000100:00100000:3.0:1746065139.548113:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273025536 00010000:00010000:3.0:1746065139.548132:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.548163:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14436 00000100:00100000:3.0:1746065139.548169:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273025536:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.548179:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.548195:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.548210:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.548228:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6013 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.548329:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.548331:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.548337:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.548345:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.548368:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.548378:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267717376:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.548433:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.551042:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267717376:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065139.551042:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065139.551058:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.551237:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273025792 00000100:00100000:3.0:1746065139.551258:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273025536:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3087us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.551266:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14436 00000100:00100000:2.0:1746065139.551346:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273025792 00002000:00100000:2.0:1746065139.551381:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fe300 x1830881273025792/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.551389:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fe300 with x1830881273025792 ext(0->4095) 00002000:00010000:2.0:1746065139.551392:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fe300 00000100:00100000:2.0:1746065139.551406:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13672 00000100:00100000:2.0:1746065139.551411:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273025792:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.551510:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273025792:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (475us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.551515:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13672 00002000:00100000:2.0:1746065139.551519:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fe300 x1830881273025792/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.551526:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fe300 with x1830881273025792 ext(0->4095) 00002000:00010000:2.0:1746065139.551528:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fe300 00000100:00100000:0.0:1746065139.553713:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.553956:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.554280:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273025920 00000100:00100000:2.0:1746065139.554288:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273025920 00000100:00100000:2.0:1746065139.554327:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273026048 00000100:00100000:2.0:1746065139.554330:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273026048 00000100:00100000:2.0:1746065139.554345:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30465 00000100:00100000:2.0:1746065139.554351:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273025920:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.554363:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.554377:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6021 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.554400:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.554407:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.554408:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.554411:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.554435:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.554445:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.554455:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267717504:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.554515:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.554536:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30466 00000100:00100000:2.0:1746065139.554542:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1795:x1830881273026048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.554548:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.554555:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6028 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.554565:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.554568:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 102 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.554573:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.554575:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 102 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.554592:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 102 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.554603:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 102 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.554611:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065139.554628:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:1795:x1830881273026048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 86us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.554634:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30466 00000100:00100000:0.0:1746065139.559419:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.559524:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267717504:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.559548:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.559555:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273026176 00000100:00100000:3.0:1746065139.559561:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273026176 00010000:00010000:2.0:1746065139.559563:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00010000:00010000:3.0:1746065139.559588:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.559599:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1791:x1830881273025920:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5248us (5891us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.559606:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30465 00000100:00100000:3.0:1746065139.559628:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14437 00000100:00100000:3.0:1746065139.559634:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273026176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.559644:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.559658:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.559669:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.559687:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8800a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e601a expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.559700:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.559702:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.559708:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.559716:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.559746:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.559756:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.559765:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267717760:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.559820:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.562637:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267717760:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.562654:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.562687:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273026176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3052us (3274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.562695:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14437 00000100:00100000:0.0:1746065139.563036:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.563105:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273026432 00000100:00100000:1.0:1746065139.563111:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273026432 00002000:00100000:1.0:1746065139.563145:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c8000 x1830881273026432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.563153:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8000 with x1830881273026432 ext(0->4095) 00010000:00010000:1.0:1746065139.563159:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.563171:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.563181:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c8000 00000100:00100000:1.0:1746065139.563494:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2924 00000100:00100000:1.0:1746065139.563501:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2004:x1830881273026432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.564185:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2004:x1830881273026432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 683us (1148us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.564191:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2924 00002000:00100000:1.0:1746065139.564197:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c8000 x1830881273026432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.564204:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8000 with x1830881273026432 ext(0->4095) 00010000:00010000:1.0:1746065139.564209:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.564218:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.564222:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c8000 00000100:00100000:0.0:1746065139.565740:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.565834:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273026560 00000100:00100000:3.0:1746065139.565840:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273026560 00010000:00010000:3.0:1746065139.565865:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.565897:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14438 00000100:00100000:3.0:1746065139.565903:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2004:x1830881273026560:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.565912:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.565926:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.565949:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.565967:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6021 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.565991:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.565993:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.565999:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.566006:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.566031:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 100 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.566042:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267717888:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.566120:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.567645:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267717888:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.567657:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.567694:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273026560:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1790us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.567701:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14438 00000100:00100000:0.0:1746065139.568154:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.568679:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273026816 00000100:00100000:1.0:1746065139.568686:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273026816 00002000:00100000:1.0:1746065139.568722:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9880 x1830881273026816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.568731:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9880 with x1830881273026816 ext(0->4095) 00002000:00010000:1.0:1746065139.568735:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c9880 00000100:00100000:1.0:1746065139.568764:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13673 00000100:00100000:1.0:1746065139.568771:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273026816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.568867:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273026816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (714us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.568875:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13673 00002000:00100000:1.0:1746065139.568880:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9880 x1830881273026816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.568886:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9880 with x1830881273026816 ext(0->4095) 00002000:00010000:1.0:1746065139.568889:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c9880 00000100:00100000:0.0:1746065139.570288:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.570359:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273026944 00000100:00100000:2.0:1746065139.570363:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273026944 00000100:00100000:2.0:1746065139.570568:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30467 00000100:00100000:2.0:1746065139.570575:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273026944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.570584:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.570597:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e602f expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.570619:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.570625:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.570627:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.570630:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.570652:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.570663:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 99 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.570672:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267718016:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.571483:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.572342:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267718016:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.572361:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.572377:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065139.572403:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273026944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1828us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.572409:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30467 00000100:00100000:0.0:1746065139.572630:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.572800:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273027072 00000100:00100000:2.0:1746065139.572806:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273027072 00010000:00010000:2.0:1746065139.573017:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 100 pid: 9635 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.573050:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14439 00000100:00100000:2.0:1746065139.573056:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273027072:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.573066:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.573097:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 100 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.573107:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 100 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.573124:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8800b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6028 expref: 100 pid: 9635 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.573266:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.573268:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.573274:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.573284:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.573386:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.573396:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267718144:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.573463:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.576337:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.576518:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267718144:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.576533:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.576575:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273027072:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3520us (3946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.576584:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14439 00000100:00100000:1.0:1746065139.576649:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273027328 00000100:00100000:1.0:1746065139.576656:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273027328 00002000:00100000:1.0:1746065139.576687:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cb800 x1830881273027328/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.576696:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb800 with x1830881273027328 ext(0->4095) 00002000:00010000:1.0:1746065139.576700:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cb800 00000100:00100000:1.0:1746065139.576759:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13674 00000100:00100000:1.0:1746065139.576766:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273027328:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.577029:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273027328:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 262us (698us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.577035:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13674 00002000:00100000:1.0:1746065139.577040:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cb800 x1830881273027328/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.577047:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb800 with x1830881273027328 ext(0->4095) 00002000:00010000:1.0:1746065139.577050:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cb800 00000100:00100000:0.0:1746065139.580226:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.580298:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273027456 00000100:00100000:2.0:1746065139.580389:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273027456 00000100:00100000:2.0:1746065139.580431:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30468 00000100:00100000:2.0:1746065139.580437:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273027456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.580451:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.580463:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6036 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.580486:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.580493:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.580495:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.580498:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065139.580808:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065139.580849:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.580864:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.580875:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267718272:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.580963:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.581316:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273027584 00000100:00100000:1.0:1746065139.581320:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273027584 00000100:00100000:1.0:1746065139.581347:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30469 00000100:00100000:1.0:1746065139.581352:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1795:x1830881273027584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.581359:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.581366:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e603d expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.581378:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.581381:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 102 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.581386:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.581388:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 102 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.581408:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 102 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.581418:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 102 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.581427:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130641c00, rc 0) 00000100:00100000:1.0:1746065139.581452:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:1795:x1830881273027584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 99us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.581457:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30469 00000100:00100000:0.0:1746065139.583540:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.583703:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267718272:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.583723:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.583734:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:3.0:1746065139.583976:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273027712 00000100:00100000:3.0:1746065139.583982:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273027712 00000100:00100000:2.0:1746065139.584004:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1791:x1830881273027456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3566us (3784us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065139.584008:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.584010:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30468 00000100:00100000:1.0:1746065139.584230:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14440 00000100:00100000:1.0:1746065139.584238:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273027712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.584249:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.584265:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.584274:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.584292:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8800be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e602f expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.584376:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.584379:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.584384:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.584391:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.584417:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.584427:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.584437:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267718528:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.584510:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.585618:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267718528:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.585630:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.585664:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273027712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1426us (2129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.585671:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14440 00000100:00100000:0.0:1746065139.586124:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.586248:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273027968 00000100:00100000:1.0:1746065139.586253:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273027968 00002000:00100000:1.0:1746065139.586281:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9c00 x1830881273027968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.586290:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9c00 with x1830881273027968 ext(0->4095) 00010000:00010000:1.0:1746065139.586296:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.586306:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.586312:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9c00 00000100:00100000:1.0:1746065139.586332:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2925 00000100:00100000:1.0:1746065139.586337:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2004:x1830881273027968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.586434:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2004:x1830881273027968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (310us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.586439:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2925 00002000:00100000:1.0:1746065139.586445:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9c00 x1830881273027968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.586451:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9c00 with x1830881273027968 ext(0->4095) 00010000:00010000:1.0:1746065139.586455:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.586464:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.586469:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9c00 00000100:00100000:0.0:1746065139.588141:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.588174:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273028096 00000100:00100000:1.0:1746065139.588179:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273028096 00010000:00010000:1.0:1746065139.588194:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.588223:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14441 00000100:00100000:1.0:1746065139.588227:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2003:x1830881273028096:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.588234:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.588244:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.588251:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.588265:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6036 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.588285:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.588286:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.588292:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.588303:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.588326:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.588336:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267718656:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.588488:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.590583:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.590604:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267718656:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.590618:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.590648:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2003:x1830881273028096:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2420us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.590656:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14441 00000100:00100000:2.0:1746065139.590854:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273028352 00000100:00100000:2.0:1746065139.590859:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273028352 00002000:00100000:2.0:1746065139.590884:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6ca300 x1830881273028352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.590892:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6ca300 with x1830881273028352 ext(0->4095) 00002000:00010000:2.0:1746065139.590896:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6ca300 00000100:00100000:2.0:1746065139.590923:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13675 00000100:00100000:2.0:1746065139.590939:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273028352:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.591039:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273028352:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 109us (459us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.591044:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13675 00002000:00100000:2.0:1746065139.591049:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6ca300 x1830881273028352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.591056:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6ca300 with x1830881273028352 ext(0->4095) 00002000:00010000:2.0:1746065139.591059:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6ca300 00000100:00100000:0.0:1746065139.592868:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.592938:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273028480 00000100:00100000:2.0:1746065139.592945:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273028480 00000100:00100000:2.0:1746065139.593097:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30470 00000100:00100000:2.0:1746065139.593105:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273028480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.593117:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.593136:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6044 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.593159:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.593165:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.593166:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.593169:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.593190:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.593204:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.593214:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267718784:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.593279:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.594442:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267718784:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.594462:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.594475:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:2.0:1746065139.594510:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273028480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1406us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.594520:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30470 00000100:00100000:0.0:1746065139.595502:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.595615:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273028608 00000100:00100000:1.0:1746065139.595621:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273028608 00010000:00010000:1.0:1746065139.595646:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.595732:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14442 00000100:00100000:1.0:1746065139.595740:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273028608:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.595750:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.595770:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.595779:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.595798:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130641c00/0x392ae0376f8800cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e603d expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.595811:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.595813:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.595819:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.595825:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.595850:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.595859:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267718912:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.595917:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.597498:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.597524:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267718912:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.597539:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.597573:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273028608:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1833us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.597580:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14442 00000100:00100000:2.0:1746065139.597652:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273028864 00000100:00100000:2.0:1746065139.597657:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273028864 00002000:00100000:2.0:1746065139.597683:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c8700 x1830881273028864/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.597691:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8700 with x1830881273028864 ext(0->4095) 00002000:00010000:2.0:1746065139.597695:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c8700 00000100:00100000:2.0:1746065139.597719:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13676 00000100:00100000:2.0:1746065139.597725:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273028864:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.597811:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273028864:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 87us (317us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.597819:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13676 00002000:00100000:2.0:1746065139.597824:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c8700 x1830881273028864/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.597830:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8700 with x1830881273028864 ext(0->4095) 00002000:00010000:2.0:1746065139.597832:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c8700 00000100:00100000:0.0:1746065139.598861:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.599135:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273028992 00000100:00100000:2.0:1746065139.599142:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273028992 00000100:00100000:2.0:1746065139.599170:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30471 00000100:00100000:2.0:1746065139.599176:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881273028992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.599186:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.599199:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e604b expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.599219:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.599225:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.599226:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.599229:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.599252:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.599262:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 5 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.599276:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267719040:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.599827:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.601655:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.601772:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267719040:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065139.601793:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.601806:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:0.0:1746065139.601894:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1795:x1830881273028992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2716us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.601901:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30471 00000100:00100000:2.0:1746065139.602023:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.602550:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273029120 00000100:00100000:0.0:1746065139.602556:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273029120 00000100:00100000:0.0:1746065139.603186:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30472 00000100:00100000:0.0:1746065139.603193:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273029120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065139.603205:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.603216:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6052 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.603233:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.603237:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.603242:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065139.603244:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.603267:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.603277:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.603283:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f847000, rc 0) 00000100:00100000:0.0:1746065139.603306:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1791:x1830881273029120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 114us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.603310:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30472 00000100:00100000:1.0:1746065139.603894:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273029248 00000100:00100000:1.0:1746065139.603899:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273029248 00010000:00010000:1.0:1746065139.603916:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.603959:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14443 00000100:00100000:1.0:1746065139.603965:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273029248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.603972:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.603988:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.603998:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.604012:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8800d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6044 expref: 6 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.604024:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.604025:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.604030:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.604036:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.604055:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.604065:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.604078:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267719296:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.604150:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.605525:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267719296:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.605537:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.605559:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273029248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1595us (3536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.605566:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14443 00000100:00100000:0.0:1746065139.605823:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.605873:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273029504 00000100:00100000:3.0:1746065139.605877:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273029504 00002000:00100000:3.0:1746065139.605904:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6ca680 x1830881273029504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.605912:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6ca680 with x1830881273029504 ext(0->4095) 00010000:00010000:3.0:1746065139.605919:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.605947:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.605954:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6ca680 00000100:00100000:3.0:1746065139.605966:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2926 00000100:00100000:3.0:1746065139.605971:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2005:x1830881273029504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065139.606058:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2005:x1830881273029504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 86us (235us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.606063:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2926 00002000:00100000:3.0:1746065139.606069:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6ca680 x1830881273029504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.606076:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6ca680 with x1830881273029504 ext(0->4095) 00010000:00010000:3.0:1746065139.606100:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.606109:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.606115:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6ca680 00000100:00100000:0.0:1746065139.608032:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.608330:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273029632 00000100:00100000:0.0:1746065139.608333:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.608337:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273029632 00000100:00100000:3.0:1746065139.608503:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30473 00000100:00100000:1.0:1746065139.608506:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273029760 00000100:00100000:1.0:1746065139.608510:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273029760 00000100:00100000:3.0:1746065139.608513:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273029632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.608527:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.608527:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.608541:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6059 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.608561:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.608566:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.608570:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065139.608574:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.608604:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 101 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.608613:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.608620:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065139.608653:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273029632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 142us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.608658:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30473 00000100:00100000:1.0:1746065139.608736:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14444 00000100:00100000:1.0:1746065139.608742:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2004:x1830881273029760:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.608749:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.608764:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.608773:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.608787:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8800da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e604b expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.608906:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.608908:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.608914:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.608920:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.608948:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 100 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.608958:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.608967:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267719552:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.609332:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.612841:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267719552:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.612861:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.614156:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273029760:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5408us (5816us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.614167:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14444 00000100:00100000:0.0:1746065139.614271:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.614384:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273030016 00000100:00100000:1.0:1746065139.614391:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273030016 00002000:00100000:1.0:1746065139.614420:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130692d80 x1830881273030016/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.614580:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130692d80 with x1830881273030016 ext(0->4095) 00010000:00010000:1.0:1746065139.614589:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.614605:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.614610:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130692d80 00000100:00100000:1.0:1746065139.614652:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2927 00000100:00100000:1.0:1746065139.614659:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273030016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.615005:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273030016:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 345us (733us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.615011:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2927 00002000:00100000:1.0:1746065139.615016:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130692d80 x1830881273030016/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.615023:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130692d80 with x1830881273030016 ext(0->4095) 00010000:00010000:1.0:1746065139.615028:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.615036:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 100 pid: 21550 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.615041:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130692d80 00000100:00100000:0.0:1746065139.616701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.616977:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273030272 00000100:00100000:2.0:1746065139.616983:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273030272 00000100:00100000:2.0:1746065139.617022:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30474 00000100:00100000:2.0:1746065139.617029:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273030272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.617039:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.617050:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6060 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.617068:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.617073:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.617079:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065139.617102:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 101 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.617131:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.617142:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 101 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.617154:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065139.617182:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1791:x1830881273030272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 154us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.617188:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30474 00000100:00100000:0.0:1746065139.617280:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.617484:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273030144 00000100:00100000:1.0:1746065139.617488:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273030144 00010000:00010000:1.0:1746065139.617503:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.617521:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14445 00000100:00100000:1.0:1746065139.617526:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2004:x1830881273030144:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.617533:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.617546:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.617555:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.617568:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f847000/0x392ae0376f8800e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6052 expref: 101 pid: 21550 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.617580:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.617582:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.617586:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.617593:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.617610:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.617619:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.617629:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267719808:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.617667:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.619541:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267719808:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.619556:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.619624:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273030144:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2097us (2354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.619632:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14445 00000100:00100000:0.0:1746065139.620883:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.621236:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273030528 00000100:00100000:1.0:1746065139.621242:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273030528 00002000:00100000:1.0:1746065139.621272:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1500 x1830881273030528/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.621282:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1500 with x1830881273030528 ext(0->4095) 00010000:00010000:1.0:1746065139.621288:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.621299:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.621305:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1500 00000100:00100000:1.0:1746065139.621580:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2928 00000100:00100000:1.0:1746065139.621587:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273030528:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.621695:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273030528:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 108us (813us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.621701:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2928 00002000:00100000:1.0:1746065139.621706:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1500 x1830881273030528/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.621713:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1500 with x1830881273030528 ext(0->4095) 00010000:00010000:1.0:1746065139.621718:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.621726:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.621731:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1500 00000100:00100000:0.0:1746065139.623708:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.623791:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273030656 00000100:00100000:1.0:1746065139.623797:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273030656 00010000:00010000:1.0:1746065139.623820:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.624194:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14446 00000100:00100000:3.0:1746065139.624204:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273030656:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.624215:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.624231:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.624245:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.624264:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8800e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6059 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.624294:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.624296:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.624302:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.624308:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.624334:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.624345:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267719936:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.625244:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.626115:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267719936:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.626128:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.626154:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273030656:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1953us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.626162:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14446 00000100:00100000:2.0:1746065139.627359:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.627770:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273030912 00000100:00100000:3.0:1746065139.627776:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273030912 00002000:00100000:3.0:1746065139.627812:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072979180 x1830881273030912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.627820:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072979180 with x1830881273030912 ext(0->4095) 00002000:00010000:3.0:1746065139.627824:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072979180 00000100:00100000:3.0:1746065139.628149:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13677 00000100:00100000:3.0:1746065139.628156:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2002:x1830881273030912:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746065139.628262:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2002:x1830881273030912:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 107us (905us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.628268:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13677 00002000:00100000:3.0:1746065139.628273:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072979180 x1830881273030912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.628280:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072979180 with x1830881273030912 ext(0->4095) 00002000:00010000:3.0:1746065139.628283:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072979180 00000100:00100000:0.0:1746065139.629943:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.630015:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273031040 00000100:00100000:3.0:1746065139.630021:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273031040 00000100:00100000:3.0:1746065139.630065:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30475 00000100:00100000:3.0:1746065139.630070:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273031040:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.630103:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.630119:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6067 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.630141:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.630147:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.630150:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.630152:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.630177:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.630187:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.630197:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267720064:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.630258:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.631521:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267720064:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.631538:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.631548:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065139.631584:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273031040:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1514us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.631591:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30475 00000100:00100000:0.0:1746065139.632909:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.632998:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273031168 00000100:00100000:3.0:1746065139.633004:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273031168 00010000:00010000:3.0:1746065139.633029:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.633061:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14447 00000100:00100000:3.0:1746065139.633066:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273031168:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.633079:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.633119:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.633128:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.633144:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8800ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6060 expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.633161:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.633163:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.633169:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.633175:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.633198:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.633207:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267720192:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.633265:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.635022:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267720192:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.635039:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.635071:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2004:x1830881273031168:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2003us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.635105:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14447 00000100:00100000:0.0:1746065139.635697:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.636202:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273031424 00000100:00100000:2.0:1746065139.636208:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273031424 00002000:00100000:2.0:1746065139.636237:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2d80 x1830881273031424/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.636246:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2d80 with x1830881273031424 ext(0->4095) 00002000:00010000:2.0:1746065139.636250:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a2d80 00000100:00100000:2.0:1746065139.636275:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13678 00000100:00100000:2.0:1746065139.636282:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273031424:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.636643:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273031424:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 361us (946us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.636649:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13678 00002000:00100000:2.0:1746065139.636654:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2d80 x1830881273031424/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.636660:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2d80 with x1830881273031424 ext(0->4095) 00002000:00010000:2.0:1746065139.636663:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a2d80 00000100:00100000:0.0:1746065139.637305:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.637369:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273031552 00000100:00100000:3.0:1746065139.637373:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273031552 00000100:00100000:3.0:1746065139.637406:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30476 00000100:00100000:3.0:1746065139.637411:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1791:x1830881273031552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.637420:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.637433:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e606e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.637452:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.637519:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.637521:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.637525:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 100 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.637549:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.637559:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.637570:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267720320:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.637787:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.638797:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.638873:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.638875:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273031680 00000100:00100000:2.0:1746065139.638879:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273031680 00000100:00100000:2.0:1746065139.638916:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30477 00000100:00100000:2.0:1746065139.638922:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1795:x1830881273031680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.638943:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065139.638950:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267720320:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.638951:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6075 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.638964:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.638968:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 102 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.638973:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.638976:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 102 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.639117:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 102 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.639128:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065139.639249:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:1791:x1830881273031552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1836us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.639254:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30476 00000100:00100000:3.0:1746065139.639271:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273031808 00000100:00100000:3.0:1746065139.639274:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273031808 00010000:00010000:3.0:1746065139.639283:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.639604:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14448 00000100:00100000:3.0:1746065139.639610:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273031808:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.639617:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.639628:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.639637:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.639650:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8800f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6067 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.639796:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.639799:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.639806:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.639813:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.639834:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.639842:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 101 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.639850:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267720448:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.639888:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00010000:00010000:2.0:1746065139.640158:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 101 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.640166:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 101 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.640471:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267720576:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.640703:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.641250:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267720448:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.641259:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.641289:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273031808:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1678us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.641296:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14448 00000100:00100000:0.0:1746065139.641695:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.641759:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273032064 00000100:00100000:2.0:1746065139.641764:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273032064 00002000:00100000:2.0:1746065139.641787:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1180 x1830881273032064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.641795:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1180 with x1830881273032064 ext(0->4095) 00010000:00010000:2.0:1746065139.641801:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.641811:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.641816:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1180 00000100:00100000:2.0:1746065139.641840:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2929 00000100:00100000:2.0:1746065139.641846:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:2005:x1830881273032064:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.641939:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:2005:x1830881273032064:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 83us (234us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.641945:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2929 00002000:00100000:2.0:1746065139.641950:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1180 x1830881273032064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.641957:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1180 with x1830881273032064 ext(0->4095) 00010000:00010000:2.0:1746065139.641961:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.641969:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.641975:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1180 00000100:00100000:3.0:1746065139.643525:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267720576:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.643548:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 101 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.643565:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:3.0:1746065139.643589:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1795:x1830881273031680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4667us (4794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.643595:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30477 00000100:00100000:0.0:1746065139.646171:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.646293:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273032192 00000100:00100000:3.0:1746065139.646301:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273032192 00010000:00010000:3.0:1746065139.646330:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 101 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.646365:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14449 00000100:00100000:3.0:1746065139.646371:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2002:x1830881273032192:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.646381:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.646397:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 101 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.646407:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 101 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.646426:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8800fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e606e expref: 101 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.646436:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.646438:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.646443:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.646450:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.646475:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.646489:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267720704:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.647212:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.650746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.650820:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267720704:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.650836:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.650894:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2002:x1830881273032192:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4522us (4727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.650903:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14449 00000100:00100000:2.0:1746065139.651100:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273032448 00000100:00100000:2.0:1746065139.651107:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273032448 00002000:00100000:2.0:1746065139.651140:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2680 x1830881273032448/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.651148:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2680 with x1830881273032448 ext(0->4095) 00002000:00010000:2.0:1746065139.651152:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a2680 00000100:00100000:2.0:1746065139.651167:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13679 00000100:00100000:2.0:1746065139.651172:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273032448:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.651284:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273032448:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 111us (545us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.651289:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13679 00002000:00100000:2.0:1746065139.651293:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a2680 x1830881273032448/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.651300:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a2680 with x1830881273032448 ext(0->4095) 00002000:00010000:2.0:1746065139.651302:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a2680 00000100:00100000:0.0:1746065139.653065:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.653171:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273032576 00000100:00100000:3.0:1746065139.653177:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273032576 00000100:00100000:3.0:1746065139.653218:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30478 00000100:00100000:3.0:1746065139.653223:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273032576:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.653234:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.653247:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e607c expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.653267:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.653272:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.653273:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.653276:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.653296:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.653309:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 99 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.653317:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267720832:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.653384:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.654596:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.654598:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267720832:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.654711:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273032704 00000100:00100000:2.0:1746065139.654716:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273032704 00010000:00010000:3.0:1746065139.654719:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.654732:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00010000:00010000:2.0:1746065139.654735:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.654768:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273032576:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1544us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.654774:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30478 00000100:00100000:2.0:1746065139.654789:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14450 00000100:00100000:2.0:1746065139.654795:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273032704:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.654803:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.654818:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.654827:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.654848:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880104 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6075 expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.654862:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.654863:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.654868:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.654876:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.654895:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.654904:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267720960:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.654952:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.656877:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.656938:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273032960 00000100:00100000:1.0:1746065139.656944:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273032960 00002000:00100000:1.0:1746065139.656980:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1f80 x1830881273032960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.656988:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1f80 with x1830881273032960 ext(0->4095) 00000100:00100000:2.0:1746065139.656998:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267720960:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.657011:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.657036:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:2005:x1830881273032704:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2241us (2442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.657043:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14450 00002000:00010000:1.0:1746065139.657186:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a1f80 00000100:00100000:1.0:1746065139.657203:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13680 00000100:00100000:1.0:1746065139.657290:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273032960:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.657926:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273032960:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 638us (1052us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.657941:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13680 00002000:00100000:1.0:1746065139.657946:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1f80 x1830881273032960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.657953:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1f80 with x1830881273032960 ext(0->4095) 00002000:00010000:1.0:1746065139.657956:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a1f80 00000100:00100000:0.0:1746065139.659476:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.659573:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273033088 00000100:00100000:3.0:1746065139.659579:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273033088 00000100:00100000:3.0:1746065139.659652:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30479 00000100:00100000:3.0:1746065139.659659:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+99:1795:x1830881273033088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.659675:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.659699:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6083 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.659720:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.659730:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.659731:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.659734:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.659756:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.659765:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.659775:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267721088:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.659849:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.661640:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267721088:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.661659:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.661671:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065139.661699:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1795:x1830881273033088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2040us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.661705:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30479 00000100:00100000:0.0:1746065139.662077:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.662146:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.662313:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273033216 00000100:00100000:2.0:1746065139.662318:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273033216 00010000:00010000:2.0:1746065139.662339:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.662357:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14451 00000100:00100000:2.0:1746065139.662363:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273033216:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.662374:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.662388:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.662397:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.662413:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88010b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e607c expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.662425:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.662426:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.662431:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.662438:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.662461:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 99 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.662480:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267721216:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.662521:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.662644:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273033344 00000100:00100000:3.0:1746065139.662647:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273033344 00000100:00100000:3.0:1746065139.662661:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30480 00000100:00100000:3.0:1746065139.662665:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273033344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.662676:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.662682:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e608a expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.662694:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.662699:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.662700:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.662702:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 101 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.662713:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.662720:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.662726:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267721344:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.662742:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.664391:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267721216:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.664405:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.664428:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273033216:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2065us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.664439:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14451 00000100:00100000:3.0:1746065139.664566:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267721344:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.664579:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 101 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.664590:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065139.664607:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1791:x1830881273033344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1941us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.664615:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30480 00000100:00100000:0.0:1746065139.667214:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.667285:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273033600 00000100:00100000:1.0:1746065139.667292:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273033600 00002000:00100000:1.0:1746065139.667326:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253ca80 x1830881273033600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.667334:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253ca80 with x1830881273033600 ext(0->4095) 00010000:00010000:1.0:1746065139.667341:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.667353:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.667358:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253ca80 00000100:00100000:1.0:1746065139.667513:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2930 00000100:00100000:1.0:1746065139.667519:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2005:x1830881273033600:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.667977:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2005:x1830881273033600:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 457us (768us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.667983:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2930 00002000:00100000:1.0:1746065139.667988:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253ca80 x1830881273033600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.667995:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253ca80 with x1830881273033600 ext(0->4095) 00010000:00010000:1.0:1746065139.667999:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.668008:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.668013:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253ca80 00000100:00100000:0.0:1746065139.671533:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.671671:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.671761:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273033728 00000100:00100000:3.0:1746065139.671769:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273033728 00000100:00100000:3.0:1746065139.671814:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30481 00000100:00100000:3.0:1746065139.671821:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273033728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.671833:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.671847:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6091 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.671865:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.671870:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.671875:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065139.671878:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.671905:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.671914:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.671922:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065139.671972:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273033728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 152us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.671977:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30481 00000100:00100000:2.0:1746065139.672621:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273033856 00000100:00100000:2.0:1746065139.672625:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273033856 00010000:00010000:2.0:1746065139.672640:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.672668:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14452 00000100:00100000:2.0:1746065139.672673:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2004:x1830881273033856:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.672680:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.672694:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.672703:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.672779:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880112 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6083 expref: 101 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.672800:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.672801:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.672806:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.672813:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.672831:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 100 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.672842:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.672852:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267721600:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.672914:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.674956:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267721600:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.674972:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.675013:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273033856:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2339us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.675021:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14452 00000100:00100000:0.0:1746065139.675495:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.675594:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273034112 00000100:00100000:1.0:1746065139.675599:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273034112 00002000:00100000:1.0:1746065139.675627:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253f480 x1830881273034112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.675636:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253f480 with x1830881273034112 ext(0->4095) 00010000:00010000:1.0:1746065139.675642:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.675653:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.675658:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253f480 00000100:00100000:1.0:1746065139.675714:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2931 00000100:00100000:1.0:1746065139.675719:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273034112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.675897:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273034112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 176us (402us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.675902:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2931 00002000:00100000:1.0:1746065139.675907:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253f480 x1830881273034112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.675913:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253f480 with x1830881273034112 ext(0->4095) 00010000:00010000:1.0:1746065139.675918:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.675946:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 100 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.675951:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253f480 00000100:00100000:0.0:1746065139.677663:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.677774:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.677837:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273034240 00000100:00100000:1.0:1746065139.677842:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273034240 00000100:00100000:1.0:1746065139.677881:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30482 00000100:00100000:1.0:1746065139.677886:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273034240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.677897:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.677911:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6098 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.677917:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273034368 00000100:00100000:2.0:1746065139.677921:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273034368 00010000:00010000:1.0:1746065139.677946:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.677950:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 102 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.677952:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.677957:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065139.677960:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 102 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.677969:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14453 00000100:00100000:2.0:1746065139.677974:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:2003:x1830881273034368:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.677981:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.677988:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.677995:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 102 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.677999:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 102 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.678005:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 102 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.678020:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880119 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e608a expref: 102 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.678300:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.678302:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.678308:0:9560:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.678315:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.678333:0:9560:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.678342:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 5 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.678352:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267721856:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.678396:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.678426:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2003:x1830881273034368:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 451us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.678432:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14453 00000100:00100000:1.0:1746065139.678656:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.679782:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267721856:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.679795:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd200, rc 0) 00000100:00100000:1.0:1746065139.679831:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273034240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1944us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.679837:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30482 00000100:00100000:2.0:1746065139.679970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.680023:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273034624 00000100:00100000:1.0:1746065139.680028:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273034624 00002000:00100000:1.0:1746065139.680054:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072978000 x1830881273034624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.680062:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978000 with x1830881273034624 ext(0->4095) 00010000:00010000:1.0:1746065139.680068:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.680107:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.680114:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978000 00000100:00100000:1.0:1746065139.680127:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2932 00000100:00100000:1.0:1746065139.680132:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273034624:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.680225:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273034624:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 93us (255us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.680230:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2932 00002000:00100000:1.0:1746065139.680234:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072978000 x1830881273034624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.680240:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978000 with x1830881273034624 ext(0->4095) 00010000:00010000:1.0:1746065139.680244:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.680252:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.680256:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978000 00000100:00100000:0.0:1746065139.683459:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.683509:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273034752 00000100:00100000:2.0:1746065139.683518:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273034752 00010000:00010000:2.0:1746065139.683543:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.683575:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14454 00000100:00100000:2.0:1746065139.683581:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273034752:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.683597:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.683617:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.683631:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.683648:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880120 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6091 expref: 6 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.683670:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.683671:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.683677:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.683688:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.683711:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.683720:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267721984:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.683806:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.686514:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267721984:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.686530:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.686566:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273034752:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2984us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.686575:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14454 00000100:00100000:0.0:1746065139.687569:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.687625:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273035008 00000100:00100000:1.0:1746065139.687632:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273035008 00002000:00100000:1.0:1746065139.687665:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e0380 x1830881273035008/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.687673:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0380 with x1830881273035008 ext(0->4095) 00002000:00010000:1.0:1746065139.687679:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e0380 00000100:00100000:1.0:1746065139.687708:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13681 00000100:00100000:1.0:1746065139.687715:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273035008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.687824:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273035008:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 109us (257us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.687829:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13681 00002000:00100000:1.0:1746065139.687835:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e0380 x1830881273035008/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.687841:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0380 with x1830881273035008 ext(0->4095) 00002000:00010000:1.0:1746065139.687844:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e0380 00000100:00100000:0.0:1746065139.692435:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.692543:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273035136 00000100:00100000:1.0:1746065139.692552:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273035136 00000100:00100000:1.0:1746065139.692595:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30483 00000100:00100000:1.0:1746065139.692602:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273035136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065139.692617:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.692636:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e609f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.692661:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.692667:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.692669:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.692672:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.692701:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.692712:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.692722:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267722112:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065139.693368:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.695002:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267722112:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065139.695028:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.695041:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd400, rc 0) 00000100:00100000:1.0:1746065139.695099:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273035136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2480us (2654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.695106:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30483 00000100:00100000:0.0:1746065139.697649:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.697709:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273035264 00000100:00100000:2.0:1746065139.697716:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273035264 00010000:00010000:2.0:1746065139.697743:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 100 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.697832:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14455 00000100:00100000:2.0:1746065139.697840:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2005:x1830881273035264:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.697851:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.697866:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 100 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.697877:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 100 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.697895:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f880127 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6098 expref: 100 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.697921:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.697923:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.697940:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.697948:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.697975:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.697985:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267722240:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.698812:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.699010:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.699076:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273035392 00000100:00100000:2.0:1746065139.699100:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273035392 00000100:00100000:2.0:1746065139.699126:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30484 00000100:00100000:2.0:1746065139.699360:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273035392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.699372:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.699382:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60a6 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.699399:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.699410:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.699411:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.699414:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.699433:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.699443:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.699450:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072978700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267722368:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.699485:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.701899:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267722240:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.701916:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.701973:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:2005:x1830881273035264:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4134us (4329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.701981:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14455 00000100:00100000:2.0:1746065139.702191:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072978700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267722368:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.702207:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 100 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.702221:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065139.702242:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:1791:x1830881273035392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3111us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.702249:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30484 00000100:00100000:0.0:1746065139.704671:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.705228:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273035648 00000100:00100000:2.0:1746065139.705235:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273035648 00002000:00100000:2.0:1746065139.705273:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e2d80 x1830881273035648/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.705287:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2d80 with x1830881273035648 ext(0->4095) 00010000:00010000:2.0:1746065139.705294:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.705306:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.705311:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e2d80 00000100:00100000:2.0:1746065139.705404:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2933 00000100:00100000:2.0:1746065139.705410:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273035648:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.705672:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273035648:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 261us (1009us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.705679:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2933 00002000:00100000:2.0:1746065139.705684:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e2d80 x1830881273035648/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.705691:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2d80 with x1830881273035648 ext(0->4095) 00010000:00010000:2.0:1746065139.705695:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.705702:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.705707:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e2d80 00000100:00100000:0.0:1746065139.708870:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.709115:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273035776 00000100:00100000:3.0:1746065139.709123:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273035776 00010000:00010000:3.0:1746065139.709153:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.709177:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14456 00000100:00100000:3.0:1746065139.709184:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273035776:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.709195:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.709210:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.709220:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.709239:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88012e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e609f expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.709269:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.709271:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.709277:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.709284:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.709311:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.709321:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267722496:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.709388:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.712269:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.712327:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273036032 00000100:00100000:2.0:1746065139.712335:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273036032 00002000:00100000:2.0:1746065139.712368:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e0e00 x1830881273036032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065139.712377:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267722496:192.168.202.8@tcp:105: 00002000:00100000:2.0:1746065139.712377:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0e00 with x1830881273036032 ext(0->4095) 00002000:00010000:2.0:1746065139.712381:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e0e00 00010000:00010000:3.0:1746065139.712391:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.712410:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13682 00000100:00100000:2.0:1746065139.712417:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273036032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.712423:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273035776:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3239us (3560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.712431:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14456 00000100:00100000:2.0:1746065139.712622:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273036032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 204us (358us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.712627:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13682 00002000:00100000:2.0:1746065139.712631:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e0e00 x1830881273036032/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.712637:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0e00 with x1830881273036032 ext(0->4095) 00002000:00010000:2.0:1746065139.712640:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e0e00 00000100:00100000:2.0:1746065139.723605:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.723904:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273036160 00000100:00100000:0.0:1746065139.723912:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273036160 00000100:00100000:0.0:1746065139.723964:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30485 00000100:00100000:0.0:1746065139.723972:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273036160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065139.723986:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.724001:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60ad expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.724024:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.724031:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065139.724032:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065139.724035:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.724057:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.724067:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 99 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065139.724077:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267722624:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065139.724171:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.729779:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267722624:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.729807:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.729823:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f846600, rc 0) 00000100:00100000:2.0:1746065139.729873:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273036160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5901us (6276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.729881:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30485 00000100:00100000:0.0:1746065139.732263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.732954:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273036288 00000100:00100000:2.0:1746065139.732963:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273036288 00002000:00100000:2.0:1746065139.733000:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d1e3b80 x1830881273036288/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.733009:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3b80 with x1830881273036288 ext(0->7) 00010000:00010000:2.0:1746065139.733016:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 100 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.733030:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 100 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.733035:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e3b80 00000100:00100000:2.0:1746065139.733067:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2934 00000100:00100000:2.0:1746065139.733073:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+100:2004:x1830881273036288:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065139.733956:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:2004:x1830881273036288:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 880us (1697us total) trans 4294972113 rc 0/0 00000100:00100000:0.0:1746065139.733962:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2934 00002000:00100000:0.0:1746065139.733968:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d1e3b80 x1830881273036288/t4294972113(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/448 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.733975:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3b80 with x1830881273036288 ext(0->7) 00010000:00010000:0.0:1746065139.733980:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.733990:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065139.734010:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e3b80 00000100:00100000:0.0:1746065139.748360:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.748423:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273036416 00000100:00100000:3.0:1746065139.748431:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273036416 00010000:00010000:3.0:1746065139.748461:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.748495:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14457 00000100:00100000:3.0:1746065139.748501:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:2004:x1830881273036416:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.748514:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.748528:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.748538:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.748555:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880135 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60a6 expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.748581:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.748584:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.748590:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.748597:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.748621:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.748630:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267722752:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.748706:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.752363:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.752523:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273036544 00000100:00100000:2.0:1746065139.752530:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273036544 00000100:00100000:0.0:1746065139.753277:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267722752:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065139.753292:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065139.753325:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:2004:x1830881273036416:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4824us (4972us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.753334:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14457 00000100:00100000:2.0:1746065139.753462:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30486 00000100:00100000:2.0:1746065139.753470:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+101:1791:x1830881273036544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.753484:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.753499:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60b4 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.753520:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.753526:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.753528:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.753531:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 102 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.753555:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.753565:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.753575:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267722880:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.753628:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.756172:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.756342:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273036800 00000100:00100000:2.0:1746065139.756349:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273036800 00002000:00100000:2.0:1746065139.756383:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e1f80 x1830881273036800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.756392:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1f80 with x1830881273036800 ext(0->4095) 00010000:00010000:2.0:1746065139.756399:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.756411:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.756416:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e1f80 00000100:00100000:2.0:1746065139.756443:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2935 00000100:00100000:2.0:1746065139.756449:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273036800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.756462:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267722880:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.756481:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 102 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.756492:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:3.0:1746065139.756520:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:1791:x1830881273036544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3052us (4165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.756526:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30486 00000100:00100000:2.0:1746065139.756533:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273036800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 84us (368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.756540:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2935 00002000:00100000:2.0:1746065139.756544:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e1f80 x1830881273036800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.756551:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1f80 with x1830881273036800 ext(0->4095) 00010000:00010000:2.0:1746065139.756555:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.756562:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.756567:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e1f80 00000100:00100000:0.0:1746065139.758754:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.759148:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273036928 00000100:00100000:2.0:1746065139.759155:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273036928 00010000:00010000:2.0:1746065139.759181:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.759203:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14458 00000100:00100000:2.0:1746065139.759209:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273036928:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.759219:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.759233:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.759244:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.759261:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f846600/0x392ae0376f88013c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ad expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.759387:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.759390:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.759397:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.759408:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.759436:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.759447:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267723008:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.759511:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.761221:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267723008:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.761235:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.761262:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273036928:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2052us (2513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.761271:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14458 00000100:00100000:0.0:1746065139.762290:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.762365:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273037184 00000100:00100000:1.0:1746065139.762371:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273037184 00002000:00100000:1.0:1746065139.762399:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf9f80 x1830881273037184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.762408:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9f80 with x1830881273037184 ext(0->4095) 00002000:00010000:1.0:1746065139.762412:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf9f80 00000100:00100000:1.0:1746065139.762525:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13683 00000100:00100000:1.0:1746065139.762532:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:2002:x1830881273037184:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065139.762867:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:2002:x1830881273037184:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 333us (577us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.762872:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13683 00002000:00100000:1.0:1746065139.762878:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf9f80 x1830881273037184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.762885:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9f80 with x1830881273037184 ext(0->4095) 00002000:00010000:1.0:1746065139.762887:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf9f80 00000100:00100000:0.0:1746065139.765243:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.765435:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273037312 00000100:00100000:3.0:1746065139.765442:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273037312 00000100:00100000:3.0:1746065139.765473:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30487 00000100:00100000:3.0:1746065139.765478:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273037312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.765490:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.765503:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60bb expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.765528:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.765664:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.765666:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.765670:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.765696:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 101 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.765707:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 101 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.765718:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267723136:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.765950:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.768838:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267723136:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.768862:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.768876:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065139.768913:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273037312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3433us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.768923:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30487 00000100:00100000:0.0:1746065139.772070:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.772234:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273037440 00000100:00100000:1.0:1746065139.772242:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273037440 00002000:00100000:1.0:1746065139.772275:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fafaa00 x1830881273037440/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.772284:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafaa00 with x1830881273037440 ext(0->7) 00010000:00010000:1.0:1746065139.772292:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.772305:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 102 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.772312:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fafaa00 00000100:00100000:1.0:1746065139.772342:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2936 00000100:00100000:1.0:1746065139.772349:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+102:2004:x1830881273037440:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746065139.774181:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+104:2004:x1830881273037440:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1829us (2114us total) trans 4294972114 rc 0/0 00000100:00100000:1.0:1746065139.774192:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2936 00002000:00100000:1.0:1746065139.774199:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009fafaa00 x1830881273037440/t4294972114(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/448 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.774207:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafaa00 with x1830881273037440 ext(0->7) 00010000:00010000:1.0:1746065139.774213:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 104 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.774225:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 104 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.774230:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fafaa00 00000100:00100000:1.0:1746065139.778406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.780017:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273037568 00000100:00100000:2.0:1746065139.780026:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273037568 00010000:00010000:2.0:1746065139.780145:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 104 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.780197:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14459 00000100:00100000:2.0:1746065139.780205:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+104:2003:x1830881273037568:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.780223:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065139.780235:0:7200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1746065138 -> 1746065139 00002000:00010000:2.0:1746065139.780238:0:7200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1746065138 -> 1746065139 00010000:00010000:2.0:1746065139.780243:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 104 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.780257:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 104 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.780280:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880143 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60b4 expref: 104 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.780304:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.780306:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.780312:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.780319:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.780347:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.780361:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267723264:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.780453:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.782799:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.783069:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273037696 00000100:00100000:3.0:1746065139.783076:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273037696 00000100:00100000:3.0:1746065139.783142:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30488 00000100:00100000:3.0:1746065139.783148:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+104:1791:x1830881273037696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.783162:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.783175:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60c2 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.783197:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.783203:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.783205:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.783207:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 105 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.783230:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.783239:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.783249:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267723392:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.783315:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.784200:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267723264:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.784215:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.784251:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+105:2003:x1830881273037568:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4046us (5852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.784258:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14459 00000100:00100000:0.0:1746065139.784480:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.784548:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273037952 00000100:00100000:1.0:1746065139.784553:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273037952 00002000:00100000:1.0:1746065139.784900:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fafb800 x1830881273037952/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.784908:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafb800 with x1830881273037952 ext(0->4095) 00010000:00010000:1.0:1746065139.784913:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.784923:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.784940:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fafb800 00000100:00100000:1.0:1746065139.784963:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2937 00000100:00100000:1.0:1746065139.784968:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273037952:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.785054:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273037952:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 86us (574us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.785058:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2937 00002000:00100000:1.0:1746065139.785063:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fafb800 x1830881273037952/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065139.785274:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267723392:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.785290:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 104 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.785299:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065139.785318:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+104:1791:x1830881273037696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2170us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.785324:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30488 00002000:00100000:1.0:1746065139.785921:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafb800 with x1830881273037952 ext(0->4095) 00010000:00010000:1.0:1746065139.785936:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.785946:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.785951:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fafb800 00000100:00100000:0.0:1746065139.788336:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.788628:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273038080 00000100:00100000:2.0:1746065139.788636:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273038080 00010000:00010000:2.0:1746065139.788661:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.788693:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14460 00000100:00100000:2.0:1746065139.788700:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273038080:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.788712:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.788727:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.788737:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.788756:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88014a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60bb expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.789057:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.789059:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.789065:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 103 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.789072:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 103 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.789130:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 103 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.789142:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267723520:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.789703:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.790748:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267723520:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.790762:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.790796:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273038080:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2096us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.790804:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14460 00000100:00100000:0.0:1746065139.791611:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.791681:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273038336 00000100:00100000:1.0:1746065139.791689:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273038336 00002000:00100000:1.0:1746065139.791722:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fafa680 x1830881273038336/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.791730:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafa680 with x1830881273038336 ext(0->4095) 00002000:00010000:1.0:1746065139.791734:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fafa680 00000100:00100000:1.0:1746065139.791763:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13684 00000100:00100000:1.0:1746065139.791769:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+104:2005:x1830881273038336:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065139.792452:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+104:2005:x1830881273038336:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 681us (840us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.792459:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13684 00002000:00100000:1.0:1746065139.792465:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fafa680 x1830881273038336/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.792473:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafa680 with x1830881273038336 ext(0->4095) 00002000:00010000:1.0:1746065139.792475:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fafa680 00000100:00100000:0.0:1746065139.806666:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.806853:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273038464 00000100:00100000:3.0:1746065139.806861:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273038464 00000100:00100000:3.0:1746065139.806905:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30489 00000100:00100000:3.0:1746065139.806911:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273038464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.806924:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.806948:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60c9 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.806968:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 103 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.806974:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.806975:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.806978:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.807004:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 103 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.807014:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 103 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.807023:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267723648:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.807117:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.812071:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267723648:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.812127:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.812142:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065139.812191:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273038464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5279us (5532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.812198:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30489 00000100:00100000:0.0:1746065139.812954:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.813035:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273038592 00000100:00100000:1.0:1746065139.813042:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273038592 00002000:00100000:1.0:1746065139.813072:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009faf8700 x1830881273038592/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.813095:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf8700 with x1830881273038592 ext(0->7) 00010000:00010000:1.0:1746065139.813102:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 104 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.813112:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 104 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065139.813118:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009faf8700 00000100:00100000:1.0:1746065139.813146:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2938 00000100:00100000:1.0:1746065139.813152:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+104:2004:x1830881273038592:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065139.816296:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:2004:x1830881273038592:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 3137us (3336us total) trans 4294972115 rc 0/0 00000100:00100000:0.0:1746065139.816305:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2938 00002000:00100000:0.0:1746065139.816313:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009faf8700 x1830881273038592/t4294972115(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/448 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.816321:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf8700 with x1830881273038592 ext(0->7) 00010000:00010000:0.0:1746065139.816329:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 106 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.816342:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 106 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065139.816348:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009faf8700 00000100:00100000:0.0:1746065139.820247:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.820278:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273038720 00000100:00100000:0.0:1746065139.820285:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273038720 00010000:00010000:0.0:1746065139.820313:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 106 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065139.820340:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14461 00000100:00100000:0.0:1746065139.820346:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:2003:x1830881273038720:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065139.820358:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065139.820373:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 106 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.820384:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 106 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.820401:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880151 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c2 expref: 106 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065139.820415:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.820417:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.820423:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.820429:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.820606:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.820619:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267723776:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.820695:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.823644:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267723776:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.823661:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.823696:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+105:2003:x1830881273038720:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3349us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.823705:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14461 00000100:00100000:0.0:1746065139.823937:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.823994:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273038976 00000100:00100000:1.0:1746065139.824000:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273038976 00002000:00100000:1.0:1746065139.824031:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf9180 x1830881273038976/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.824038:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9180 with x1830881273038976 ext(0->4095) 00002000:00010000:1.0:1746065139.824042:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf9180 00000100:00100000:1.0:1746065139.824509:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13685 00000100:00100000:1.0:1746065139.824516:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273038976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.824609:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273038976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (684us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.824615:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13685 00002000:00100000:1.0:1746065139.824620:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf9180 x1830881273038976/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.824626:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9180 with x1830881273038976 ext(0->4095) 00002000:00010000:1.0:1746065139.824629:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf9180 00000100:00100000:0.0:1746065139.827394:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.827467:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273039104 00000100:00100000:3.0:1746065139.827475:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273039104 00000100:00100000:3.0:1746065139.827514:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30490 00000100:00100000:3.0:1746065139.827519:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+105:1795:x1830881273039104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.827532:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.827545:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60d0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.827565:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.827571:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.827573:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.827576:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 106 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.827603:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.827614:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.827624:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267723904:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.827691:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.828733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.828870:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273039232 00000100:00100000:2.0:1746065139.828874:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273039232 00000100:00100000:2.0:1746065139.828899:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30491 00000100:00100000:2.0:1746065139.828904:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:1791:x1830881273039232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.828913:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.828922:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60d7 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.828949:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.828953:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 108 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.828958:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.828960:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 108 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.828984:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 108 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.828994:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 108 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.829002:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:3.0:1746065139.829117:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267723904:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.829129:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 108 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.829136:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:2.0:1746065139.829311:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:1791:x1830881273039232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 405us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.829317:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30491 00000100:00100000:3.0:1746065139.829357:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:1795:x1830881273039104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1838us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.829362:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30490 00000100:00100000:0.0:1746065139.829520:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.831141:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273039360 00000100:00100000:1.0:1746065139.831149:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273039360 00010000:00010000:1.0:1746065139.831175:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.831207:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14462 00000100:00100000:1.0:1746065139.831213:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273039360:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.831225:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.831241:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.831252:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.831274:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880158 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60c9 expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.831291:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.831293:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.831298:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 106 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.831306:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 106 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.831328:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 106 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.831337:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 106 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.831346:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267724160:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.831409:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.835177:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.835350:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273039616 00000100:00100000:3.0:1746065139.835357:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273039616 00002000:00100000:3.0:1746065139.835392:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297aa00 x1830881273039616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.835401:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297aa00 with x1830881273039616 ext(0->4095) 00010000:00010000:3.0:1746065139.835409:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 107 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.835427:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 107 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.835433:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007297aa00 00000100:00100000:3.0:1746065139.835450:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2939 00000100:00100000:3.0:1746065139.835457:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:2004:x1830881273039616:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.835559:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:2004:x1830881273039616:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (388us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.835565:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2939 00002000:00100000:3.0:1746065139.835570:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297aa00 x1830881273039616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.835577:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297aa00 with x1830881273039616 ext(0->4095) 00010000:00010000:3.0:1746065139.835582:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 107 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065139.835589:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 107 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065139.835594:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007297aa00 00000100:00100000:1.0:1746065139.835791:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267724160:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.835805:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.835829:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273039360:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4616us (6308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.835835:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14462 00000100:00100000:0.0:1746065139.837131:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.837265:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273039744 00000100:00100000:3.0:1746065139.837270:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273039744 00000100:00100000:3.0:1746065139.837303:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30492 00000100:00100000:3.0:1746065139.837309:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273039744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.837319:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.837330:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60de expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.837350:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.837355:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.837361:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065139.837364:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.837386:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.837396:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.837403:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065139.837425:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273039744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.837430:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30492 00000100:00100000:0.0:1746065139.837790:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.837826:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273039872 00000100:00100000:1.0:1746065139.837830:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273039872 00010000:00010000:1.0:1746065139.837844:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 107 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.837869:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14463 00000100:00100000:1.0:1746065139.837874:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:2005:x1830881273039872:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.837881:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.837894:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 107 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.837902:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 107 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.837916:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88015f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d0 expref: 107 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.837935:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.837937:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.837941:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.837947:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.837962:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.837971:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 106 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.837979:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267724416:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.838017:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.843374:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.843623:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273040128 00000100:00100000:2.0:1746065139.843630:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273040128 00002000:00100000:2.0:1746065139.843667:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1f80 x1830881273040128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.843676:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1f80 with x1830881273040128 ext(0->4095) 00010000:00010000:2.0:1746065139.843683:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 107 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.843696:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 107 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.843702:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b1f80 00000100:00100000:2.0:1746065139.843799:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2940 00000100:00100000:2.0:1746065139.843806:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:2005:x1830881273040128:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.844192:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:2005:x1830881273040128:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 385us (823us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.844198:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2940 00002000:00100000:2.0:1746065139.844203:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1f80 x1830881273040128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.844210:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1f80 with x1830881273040128 ext(0->4095) 00010000:00010000:2.0:1746065139.844214:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 107 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.844223:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 107 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.844228:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b1f80 00000100:00100000:1.0:1746065139.844418:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267724416:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.844433:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.844456:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:2005:x1830881273039872:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6581us (6667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.844463:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14463 00000100:00100000:0.0:1746065139.846326:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.846392:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273040384 00000100:00100000:1.0:1746065139.846397:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273040384 00010000:00010000:1.0:1746065139.846416:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 106 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.846572:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14464 00000100:00100000:1.0:1746065139.846578:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:2002:x1830881273040384:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.846589:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.846603:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 106 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.846616:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 106 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.846632:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880166 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60d7 expref: 106 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.846643:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.846645:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.846650:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.846656:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.846678:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.846686:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267724544:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065139.847067:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.847369:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273040256 00000100:00100000:3.0:1746065139.847373:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273040256 00000100:00100000:3.0:1746065139.847400:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30493 00000100:00100000:3.0:1746065139.847405:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:1791:x1830881273040256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.847414:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.847422:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60e5 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.847440:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.847444:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.847446:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.847448:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 107 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.847461:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.847469:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 5 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065139.847476:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267724672:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065139.847531:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.847736:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267724544:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.847747:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.847762:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:2002:x1830881273040384:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1184us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.847768:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14464 00000100:00100000:3.0:1746065139.847811:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.849307:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.849484:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273040640 00000100:00100000:2.0:1746065139.849490:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273040640 00002000:00100000:2.0:1746065139.849518:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0700 x1830881273040640/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.849527:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0700 with x1830881273040640 ext(0->4095) 00010000:00010000:2.0:1746065139.849533:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.849544:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.849549:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b0700 00000100:00100000:2.0:1746065139.849564:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2941 00000100:00100000:2.0:1746065139.849571:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273040640:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.849681:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273040640:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 110us (376us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.849687:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2941 00002000:00100000:2.0:1746065139.849692:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0700 x1830881273040640/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.849699:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0700 with x1830881273040640 ext(0->4095) 00010000:00010000:2.0:1746065139.849703:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.849711:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.849716:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b0700 00000100:00100000:3.0:1746065139.850693:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267724672:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.850713:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.850724:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065139.850753:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:1791:x1830881273040256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3348us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.850759:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30493 00000100:00100000:0.0:1746065139.852712:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.852911:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273040768 00000100:00100000:3.0:1746065139.852919:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273040768 00000100:00100000:3.0:1746065139.852971:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30494 00000100:00100000:3.0:1746065139.852982:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:1795:x1830881273040768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.852998:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.853011:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60ec expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.853036:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.853041:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 107 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.853047:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.853050:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 107 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.853077:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 107 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.853110:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 107 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.853118:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065139.853159:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:1795:x1830881273040768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 182us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.853165:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30494 00000100:00100000:0.0:1746065139.853270:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.853613:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273040896 00000100:00100000:1.0:1746065139.853617:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273040896 00010000:00010000:1.0:1746065139.853633:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.853651:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14465 00000100:00100000:1.0:1746065139.853655:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273040896:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.853662:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.853675:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.853685:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.853699:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88016d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60de expref: 6 pid: 9560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.853710:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.853712:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.853716:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.853722:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.853739:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.853749:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 106 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.853759:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267724928:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.853805:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.857614:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267724928:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.857632:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.857678:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273040896:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4021us (4407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.857687:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14465 00000100:00100000:2.0:1746065139.858037:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.858097:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273041024 00000100:00100000:1.0:1746065139.858103:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273041024 00010000:00010000:1.0:1746065139.858123:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 107 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065139.858153:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14466 00000100:00100000:1.0:1746065139.858159:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+107:2005:x1830881273041024:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.858169:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.858184:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 107 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.858194:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 107 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.858212:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880174 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60e5 expref: 107 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065139.858489:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.858492:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.858499:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.858507:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.858531:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 106 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.858541:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267725056:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065139.858605:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.862214:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267725056:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065139.862237:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.862278:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:2005:x1830881273041024:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4118us (4240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.862288:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14466 00000100:00100000:0.0:1746065139.863983:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.864077:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273041280 00000100:00100000:2.0:1746065139.864112:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273041280 00002000:00100000:2.0:1746065139.864146:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1500 x1830881273041280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.864155:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1500 with x1830881273041280 ext(0->4095) 00002000:00010000:2.0:1746065139.864159:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b1500 00000100:00100000:2.0:1746065139.864184:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13686 00000100:00100000:2.0:1746065139.864191:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:2004:x1830881273041280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.864304:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:2004:x1830881273041280:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (326us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.864313:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13686 00002000:00100000:2.0:1746065139.864317:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1500 x1830881273041280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.864324:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1500 with x1830881273041280 ext(0->4095) 00002000:00010000:2.0:1746065139.864326:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b1500 00000100:00100000:0.0:1746065139.865828:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.867215:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273041408 00000100:00100000:2.0:1746065139.867223:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273041408 00000100:00100000:2.0:1746065139.867264:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30495 00000100:00100000:2.0:1746065139.867271:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273041408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.867284:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.867297:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60f3 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.867318:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 105 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.867324:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.867325:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.867328:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.867979:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 105 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.867992:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 105 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.868006:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267725184:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.868097:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.872775:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267725184:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.872800:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.872817:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065139.873374:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273041408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6100us (7546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.873382:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30495 00000100:00100000:0.0:1746065139.876959:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.877112:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273041536 00000100:00100000:2.0:1746065139.877120:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273041536 00002000:00100000:2.0:1746065139.877160:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800729b2d80 x1830881273041536/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.877170:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2d80 with x1830881273041536 ext(0->7) 00010000:00010000:2.0:1746065139.877178:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 106 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.877191:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 106 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.877197:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b2d80 00000100:00100000:2.0:1746065139.877215:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2942 00000100:00100000:2.0:1746065139.877221:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+106:2004:x1830881273041536:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746065139.879434:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2004:x1830881273041536:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2207us (2477us total) trans 4294972116 rc 0/0 00000100:00100000:2.0:1746065139.879443:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2942 00002000:00100000:2.0:1746065139.879450:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800729b2d80 x1830881273041536/t4294972116(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/448 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.879459:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2d80 with x1830881273041536 ext(0->7) 00010000:00010000:2.0:1746065139.879466:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 108 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.879479:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 108 pid: 9558 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065139.879485:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b2d80 00000100:00100000:1.0:1746065139.887376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.888061:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273041664 00000100:00100000:3.0:1746065139.888070:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273041664 00000100:00100000:3.0:1746065139.888120:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30496 00000100:00100000:3.0:1746065139.888126:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:1791:x1830881273041664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.888140:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.888153:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e60fa expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.888173:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.888178:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.888184:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065139.888187:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 109 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.888212:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.888221:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 109 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.888229:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065139.888264:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+109:1791:x1830881273041664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 139us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.888269:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30496 00000100:00100000:1.0:1746065139.888388:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.888937:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273041792 00000100:00100000:2.0:1746065139.888941:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273041792 00010000:00010000:2.0:1746065139.888956:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 109 pid: 9558 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065139.888972:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14467 00000100:00100000:2.0:1746065139.888976:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+109:2005:x1830881273041792:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.888982:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.888996:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 109 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.889004:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 109 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.889018:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88017b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60ec expref: 109 pid: 9558 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065139.889031:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.889032:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.889037:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.889043:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.889058:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.889067:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065139.889075:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267725440:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.889136:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.890350:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267725440:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.890362:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.890382:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2005:x1830881273041792:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1405us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.890389:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14467 00000100:00100000:0.0:1746065139.891244:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.891317:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273042048 00000100:00100000:3.0:1746065139.891323:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273042048 00002000:00100000:3.0:1746065139.891354:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc39f80 x1830881273042048/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.891363:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39f80 with x1830881273042048 ext(0->4095) 00010000:00010000:3.0:1746065139.891369:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.891379:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065139.891384:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc39f80 00000100:00100000:3.0:1746065139.891397:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2943 00000100:00100000:3.0:1746065139.891401:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273042048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.891829:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273042048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 426us (586us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.891834:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2943 00002000:00100000:3.0:1746065139.891839:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc39f80 x1830881273042048/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.891845:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39f80 with x1830881273042048 ext(0->4095) 00010000:00010000:3.0:1746065139.891849:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.891858:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065139.891863:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc39f80 00000100:00100000:0.0:1746065139.893769:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.893829:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273042176 00000100:00100000:2.0:1746065139.893835:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273042176 00010000:00010000:2.0:1746065139.893856:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065139.893887:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14468 00000100:00100000:2.0:1746065139.893893:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273042176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065139.893903:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.893916:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065139.893939:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065139.893957:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880182 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60f3 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065139.893969:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.893971:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.893977:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.893983:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.894006:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.894015:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267725568:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065139.894453:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.896810:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267725568:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.896829:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065139.896862:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273042176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2969us (3097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.896871:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14468 00000100:00100000:0.0:1746065139.897589:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.897647:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273042432 00000100:00100000:3.0:1746065139.897652:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273042432 00002000:00100000:3.0:1746065139.897686:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3ad80 x1830881273042432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.897700:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3ad80 with x1830881273042432 ext(0->4095) 00002000:00010000:3.0:1746065139.897704:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc3ad80 00000100:00100000:3.0:1746065139.897730:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13687 00000100:00100000:3.0:1746065139.897739:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2004:x1830881273042432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.897857:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2004:x1830881273042432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 117us (268us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.897862:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13687 00002000:00100000:3.0:1746065139.897867:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3ad80 x1830881273042432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.897874:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3ad80 with x1830881273042432 ext(0->4095) 00002000:00010000:3.0:1746065139.897876:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc3ad80 00000100:00100000:0.0:1746065139.901071:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.901400:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273042560 00000100:00100000:2.0:1746065139.901407:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273042560 00000100:00100000:2.0:1746065139.901481:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30497 00000100:00100000:2.0:1746065139.901488:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273042560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.901502:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.901515:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6101 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.901537:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.901544:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.901545:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.901548:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.901569:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.901579:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 107 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065139.901593:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267725696:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.901656:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.904197:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267725696:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065139.904205:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.904258:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273042688 00000100:00100000:3.0:1746065139.904263:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273042688 00010000:00010000:3.0:1746065139.904289:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 108 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065139.904316:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14469 00000100:00100000:3.0:1746065139.904322:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2005:x1830881273042688:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.904334:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065139.904540:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.904638:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 108 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.904649:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 108 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.904667:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880189 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e60fa expref: 108 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.904691:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.904693:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.904699:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.904706:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.904729:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.904739:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267725824:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.904801:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00010000:00010000:2.0:1746065139.905059:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:2.0:1746065139.905115:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273042560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3627us (4051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.905122:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30497 00000100:00100000:0.0:1746065139.907729:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.907979:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273042944 00000100:00100000:1.0:1746065139.907986:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273042944 00002000:00100000:1.0:1746065139.908024:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3b480 x1830881273042944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.908033:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3b480 with x1830881273042944 ext(0->4095) 00002000:00010000:1.0:1746065139.908037:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc3b480 00000100:00100000:1.0:1746065139.908065:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13688 00000100:00100000:1.0:1746065139.908072:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273042944:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.908193:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273042944:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 122us (470us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.908199:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13688 00002000:00100000:1.0:1746065139.908204:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3b480 x1830881273042944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.908210:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3b480 with x1830881273042944 ext(0->4095) 00002000:00010000:1.0:1746065139.908212:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc3b480 00000100:00100000:0.0:1746065139.908457:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.908490:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273043072 00000100:00100000:2.0:1746065139.908494:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273043072 00000100:00100000:2.0:1746065139.908571:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30498 00000100:00100000:2.0:1746065139.908577:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:1791:x1830881273043072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.908585:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.908597:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6108 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.908614:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267725824:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065139.908614:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.908620:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.908622:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.908624:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 109 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.908627:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.908646:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+109:2005:x1830881273042688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4325us (4442us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065139.908647:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.908653:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14469 00010000:00010000:2.0:1746065139.908656:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065139.908665:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267725952:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.908709:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.911003:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.911075:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273043200 00000100:00100000:3.0:1746065139.911110:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273043200 00000100:00100000:3.0:1746065139.911150:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30499 00000100:00100000:3.0:1746065139.911157:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+109:1795:x1830881273043200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.911171:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.911183:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e610f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.911201:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.911205:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 110 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.911210:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.911212:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 110 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065139.911301:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267725952:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.911318:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 110 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.911327:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065139.911368:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+110:1791:x1830881273043072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2791us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.911374:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30498 00010000:00010000:3.0:1746065139.912421:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 109 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.912434:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 109 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.912443:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065139.912465:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+109:1795:x1830881273043200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1309us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.912470:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30499 00000100:00100000:0.0:1746065139.913765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.914046:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273043328 00000100:00100000:3.0:1746065139.914052:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273043328 00010000:00010000:3.0:1746065139.914074:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065139.914125:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14470 00000100:00100000:3.0:1746065139.914132:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273043328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.914142:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.914156:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.914166:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.914188:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880190 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6101 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.914212:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.914214:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.914219:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 108 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.914225:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 108 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.914247:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 108 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.914257:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 108 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065139.914267:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267726208:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.914453:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.917564:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.917658:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273043584 00000100:00100000:2.0:1746065139.917666:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273043584 00002000:00100000:2.0:1746065139.917700:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5f80 x1830881273043584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.917709:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5f80 with x1830881273043584 ext(0->4095) 00010000:00010000:2.0:1746065139.917716:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 109 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065139.917732:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 109 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065139.917737:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5f80 00000100:00100000:2.0:1746065139.917753:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2944 00000100:00100000:2.0:1746065139.917760:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+109:2004:x1830881273043584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.917858:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+109:2004:x1830881273043584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (300us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.917864:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2944 00002000:00100000:2.0:1746065139.917868:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5f80 x1830881273043584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.917874:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5f80 with x1830881273043584 ext(0->4095) 00010000:00010000:2.0:1746065139.917878:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 109 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065139.917885:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 109 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065139.917890:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5f80 00000100:00100000:3.0:1746065139.917981:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267726208:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.917999:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.918037:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273043328:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3902us (4271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.918044:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14470 00000100:00100000:0.0:1746065139.920412:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.923795:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273043712 00000100:00100000:3.0:1746065139.923804:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273043712 00010000:00010000:3.0:1746065139.923838:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 109 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065139.923870:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14471 00000100:00100000:3.0:1746065139.923877:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+109:2004:x1830881273043712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.923888:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.923909:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 109 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.923922:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 109 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.923951:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880197 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6108 expref: 109 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.923978:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.923980:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.923986:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 108 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.923992:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 108 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.924021:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 108 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.924031:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267726336:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.924126:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.930652:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267726336:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.930670:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.930714:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2004:x1830881273043712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6837us (10307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.930723:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14471 00000100:00100000:0.0:1746065139.931118:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.931266:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273043968 00000100:00100000:1.0:1746065139.931272:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273043968 00002000:00100000:1.0:1746065139.931302:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76d80 x1830881273043968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.931310:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76d80 with x1830881273043968 ext(0->4095) 00002000:00010000:1.0:1746065139.931313:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea76d80 00000100:00100000:1.0:1746065139.931869:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13689 00000100:00100000:1.0:1746065139.931877:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2004:x1830881273043968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065139.932040:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2004:x1830881273043968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 163us (921us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.932046:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13689 00002000:00100000:1.0:1746065139.932052:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76d80 x1830881273043968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.932059:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76d80 with x1830881273043968 ext(0->4095) 00002000:00010000:1.0:1746065139.932062:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea76d80 00000100:00100000:0.0:1746065139.934246:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.934634:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273044096 00000100:00100000:3.0:1746065139.934643:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273044096 00000100:00100000:3.0:1746065139.934691:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30500 00000100:00100000:3.0:1746065139.934697:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273044096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065139.934710:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065139.934723:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6116 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.934746:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.934752:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.934754:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.934756:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.934783:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.934793:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 107 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065139.934803:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267726464:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065139.934875:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.938552:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267726464:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065139.938577:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.938592:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065139.938639:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273044096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3941us (4397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.938646:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30500 00000100:00100000:0.0:1746065139.941865:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065139.941909:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.941963:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273044224 00000100:00100000:3.0:1746065139.941969:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273044224 00010000:00010000:3.0:1746065139.942003:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 108 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065139.942036:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14472 00000100:00100000:3.0:1746065139.942043:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2005:x1830881273044224:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.942058:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.942076:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 108 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065139.942274:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273044352 00000100:00100000:2.0:1746065139.942279:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273044352 00000100:00100000:2.0:1746065139.942312:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30501 00000100:00100000:2.0:1746065139.942317:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+109:1791:x1830881273044352:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.942328:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.942339:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e611d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.942450:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 108 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065139.942510:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.942516:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.942520:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065139.942523:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 110 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.942549:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.942560:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 110 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.942567:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:2.0:1746065139.942609:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+110:1791:x1830881273044352:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 291us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.942614:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30501 00010000:00010000:3.0:1746065139.942657:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88019e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e610f expref: 109 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.942668:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.942669:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.942674:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.942680:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.942697:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.942707:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065139.942716:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267726720:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.943321:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.947798:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267726720:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.947815:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.947858:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2005:x1830881273044224:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5815us (5998us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.947868:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14472 00000100:00100000:2.0:1746065139.947918:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.948116:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273044608 00000100:00100000:3.0:1746065139.948122:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273044608 00002000:00100000:3.0:1746065139.948151:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a0000 x1830881273044608/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.948161:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0000 with x1830881273044608 ext(0->4095) 00010000:00010000:3.0:1746065139.948167:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.948178:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065139.948183:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a0000 00000100:00100000:3.0:1746065139.948405:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2945 00000100:00100000:3.0:1746065139.948412:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273044608:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065139.948714:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273044608:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 301us (793us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065139.948720:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2945 00002000:00100000:3.0:1746065139.948725:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a0000 x1830881273044608/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065139.948732:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0000 with x1830881273044608 ext(0->4095) 00010000:00010000:3.0:1746065139.948736:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.948749:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065139.948754:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a0000 00000100:00100000:2.0:1746065139.958254:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.958346:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273044736 00000100:00100000:3.0:1746065139.958353:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273044736 00010000:00010000:3.0:1746065139.958383:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065139.958413:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14473 00000100:00100000:3.0:1746065139.958419:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273044736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.958430:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.958446:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.958456:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.961042:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8801a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6116 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.961069:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.961071:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.961077:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.961100:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.961136:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.961148:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267726848:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.961234:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.963668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.963770:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273044992 00000100:00100000:2.0:1746065139.963778:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273044992 00002000:00100000:2.0:1746065139.963812:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75f80 x1830881273044992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.963821:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881273044992 ext(0->4095) 00002000:00010000:2.0:1746065139.963826:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea75f80 00000100:00100000:2.0:1746065139.963844:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13690 00000100:00100000:2.0:1746065139.963850:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2004:x1830881273044992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.963975:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2004:x1830881273044992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 125us (312us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.963981:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13690 00002000:00100000:2.0:1746065139.963986:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75f80 x1830881273044992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.963993:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881273044992 ext(0->4095) 00002000:00010000:2.0:1746065139.963996:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea75f80 00000100:00100000:3.0:1746065139.964275:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267726848:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.964300:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.964362:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273044736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5942us (6113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.964370:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14473 00000100:00100000:0.0:1746065139.971633:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.972007:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273045120 00000100:00100000:2.0:1746065139.972015:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273045120 00000100:00100000:2.0:1746065139.972229:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30502 00000100:00100000:2.0:1746065139.972236:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273045120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.972251:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.972265:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6124 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.972286:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.972292:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.972294:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.972296:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.972323:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 107 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.972333:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 107 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065139.972342:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267726976:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.972788:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065139.974465:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267726976:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.974485:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.974497:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065139.974523:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273045120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2288us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.974529:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30502 00000100:00100000:0.0:1746065139.975647:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065139.975733:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273045248 00000100:00100000:1.0:1746065139.975740:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273045248 00002000:00100000:1.0:1746065139.975771:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009ea77800 x1830881273045248/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065139.975779:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77800 with x1830881273045248 ext(0->7) 00010000:00010000:1.0:1746065139.975786:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 108 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065139.975797:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 108 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065139.975802:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea77800 00000100:00100000:1.0:1746065139.975827:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2946 00000100:00100000:1.0:1746065139.975832:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+108:2003:x1830881273045248:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065139.976744:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+110:2003:x1830881273045248:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 909us (1098us total) trans 4294972117 rc 0/0 00000100:00100000:0.0:1746065139.976750:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2946 00002000:00100000:0.0:1746065139.976756:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009ea77800 x1830881273045248/t4294972117(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 496/448 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065139.976763:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77800 with x1830881273045248 ext(0->7) 00010000:00010000:0.0:1746065139.976767:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 110 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065139.976776:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 110 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065139.976785:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea77800 00000100:00100000:0.0:1746065139.981498:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.981593:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273045376 00000100:00100000:3.0:1746065139.981600:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273045376 00010000:00010000:3.0:1746065139.981630:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 110 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065139.981657:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14474 00000100:00100000:3.0:1746065139.981663:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+110:2003:x1830881273045376:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.981677:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.981693:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 110 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.981703:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 110 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.981722:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e611d expref: 110 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.981751:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.981753:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.981760:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.981767:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.981797:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.981806:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267727104:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.981871:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.984642:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.984692:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273045504 00000100:00100000:2.0:1746065139.984698:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273045504 00000100:00100000:2.0:1746065139.984727:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30503 00000100:00100000:2.0:1746065139.984732:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+110:1791:x1830881273045504:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.984745:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.984758:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e612b expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.984779:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.984785:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.984786:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065139.984789:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 111 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.984809:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.984818:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065139.984827:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267727232:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.984889:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.985223:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267727104:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.985234:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.985255:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+111:2003:x1830881273045376:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3592us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.985262:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14474 00000100:00100000:2.0:1746065139.987845:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267727232:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065139.987868:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 110 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.987883:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065139.987985:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+110:1791:x1830881273045504:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3251us (3347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065139.987994:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30503 00000100:00100000:0.0:1746065139.989430:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.989547:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273045760 00000100:00100000:2.0:1746065139.989554:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273045760 00002000:00100000:2.0:1746065139.989584:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76680 x1830881273045760/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.989601:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76680 with x1830881273045760 ext(0->4095) 00010000:00010000:2.0:1746065139.989608:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065139.989618:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065139.989624:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76680 00000100:00100000:2.0:1746065139.990446:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2947 00000100:00100000:2.0:1746065139.990454:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273045760:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065139.990561:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273045760:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 108us (1138us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.990567:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2947 00002000:00100000:2.0:1746065139.990572:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea76680 x1830881273045760/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.990579:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76680 with x1830881273045760 ext(0->4095) 00010000:00010000:2.0:1746065139.990584:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065139.990593:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065139.990598:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76680 00000100:00100000:0.0:1746065139.992350:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065139.992737:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273045888 00000100:00100000:3.0:1746065139.992744:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273045888 00010000:00010000:3.0:1746065139.992768:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065139.992808:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14475 00000100:00100000:3.0:1746065139.992814:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273045888:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065139.992824:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065139.992839:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.992850:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.992868:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6124 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065139.992897:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.992898:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065139.992906:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 109 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.992913:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 109 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.992951:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 109 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065139.993030:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267727360:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065139.993324:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800729fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.996213:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267727360:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065139.996229:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.996268:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273045888:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3453us (3920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.996277:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14475 00000100:00100000:1.0:1746065139.996350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.996391:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273046144 00000100:00100000:2.0:1746065139.996397:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273046144 00002000:00100000:2.0:1746065139.996425:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5500 x1830881273046144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.996433:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5500 with x1830881273046144 ext(0->4095) 00002000:00010000:2.0:1746065139.996437:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff5500 00000100:00100000:2.0:1746065139.996450:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13691 00000100:00100000:2.0:1746065139.996454:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+110:2005:x1830881273046144:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065139.996559:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+110:2005:x1830881273046144:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 104us (210us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065139.996564:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13691 00002000:00100000:2.0:1746065139.996569:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5500 x1830881273046144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065139.996575:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5500 with x1830881273046144 ext(0->4095) 00002000:00010000:2.0:1746065139.996577:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff5500 00000100:00100000:0.0:1746065139.999203:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065139.999310:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273046272 00000100:00100000:2.0:1746065139.999317:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273046272 00000100:00100000:2.0:1746065139.999363:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30504 00000100:00100000:2.0:1746065139.999369:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273046272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065139.999385:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065139.999402:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6132 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.999427:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 109 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.999438:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.999440:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065139.999442:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.999466:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 109 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065139.999477:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 109 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065139.999487:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267727488:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065139.999573:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.001992:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267727488:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065140.001993:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065140.002015:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.002030:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065140.002064:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273046272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2694us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.002072:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30504 00000100:00100000:3.0:1746065140.002215:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273046400 00000100:00100000:3.0:1746065140.002221:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273046400 00002000:00100000:3.0:1746065140.002269:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009ea76300 x1830881273046400/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.002277:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76300 with x1830881273046400 ext(0->7) 00000100:00080000:1.0:1746065140.002278:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746065140.002282:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 110 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.002293:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 110 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.002299:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76300 00000100:00100000:3.0:1746065140.002506:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2948 00000100:00100000:3.0:1746065140.002513:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+110:2004:x1830881273046400:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065140.004590:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+112:2004:x1830881273046400:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2072us (2594us total) trans 4294972118 rc 0/0 00000100:00100000:0.0:1746065140.004599:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2948 00002000:00100000:0.0:1746065140.004607:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009ea76300 x1830881273046400/t4294972118(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.004614:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76300 with x1830881273046400 ext(0->7) 00010000:00010000:0.0:1746065140.004622:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 112 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.004634:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 112 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.004639:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea76300 00000100:00100000:0.0:1746065140.009643:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.009731:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.010512:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273046656 00000100:00100000:3.0:1746065140.010520:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273046656 00010000:00010000:3.0:1746065140.010548:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 112 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.010574:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14476 00000100:00100000:3.0:1746065140.010580:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+112:2002:x1830881273046656:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.010592:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.010607:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 112 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.010618:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 112 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.010636:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8801ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e612b expref: 112 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.010784:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273046528 00000100:00100000:2.0:1746065140.010789:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273046528 00000100:00100000:2.0:1746065140.010810:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30505 00000100:00100000:2.0:1746065140.010816:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+112:1791:x1830881273046528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.010830:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.010839:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6139 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.010854:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.010859:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.010864:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.010867:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.010894:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.010905:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.010912:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.010913:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.010918:0:9560:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.010933:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.010949:0:9560:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.010964:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.010974:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267727744:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.011032:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00010000:00010000:3.0:1746065140.011315:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.011337:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+113:2002:x1830881273046656:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 756us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.011343:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14476 00000100:00100000:0.0:1746065140.014456:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.014537:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273046912 00000100:00100000:1.0:1746065140.014544:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273046912 00002000:00100000:1.0:1746065140.014582:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939180 x1830881273046912/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.014591:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939180 with x1830881273046912 ext(0->4095) 00010000:00010000:1.0:1746065140.014598:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.014609:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.014624:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939180 00000100:00100000:1.0:1746065140.014640:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2949 00000100:00100000:1.0:1746065140.014645:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273046912:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.014740:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273046912:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (291us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.014745:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2949 00002000:00100000:1.0:1746065140.014749:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939180 x1830881273046912/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.014756:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939180 with x1830881273046912 ext(0->4095) 00010000:00010000:1.0:1746065140.014759:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.014767:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.014772:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939180 00000100:00100000:2.0:1746065140.014839:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267727744:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.014855:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065140.014884:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+112:1791:x1830881273046528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4068us (5248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.014889:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30505 00000100:00080000:0.0:1746065140.015632:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065140.016732:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.016789:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273047040 00000100:00100000:3.0:1746065140.016796:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273047040 00010000:00010000:3.0:1746065140.016822:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.016854:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14477 00000100:00100000:3.0:1746065140.016860:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273047040:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.016870:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.016887:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.016896:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.016919:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8801c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6132 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.016944:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.016946:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.016951:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 111 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.016958:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 111 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.016986:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 111 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.016996:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267727872:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.018249:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8100c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.018483:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267727872:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065140.018494:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065140.018528:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273047040:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1668us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.018536:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14477 00000100:00100000:0.0:1746065140.019153:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.019217:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273047296 00000100:00100000:1.0:1746065140.019221:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273047296 00002000:00100000:1.0:1746065140.019248:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b100 x1830881273047296/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.019258:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b100 with x1830881273047296 ext(0->4095) 00002000:00010000:1.0:1746065140.019262:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93b100 00000100:00100000:1.0:1746065140.019286:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13692 00000100:00100000:1.0:1746065140.019292:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+112:2005:x1830881273047296:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.019389:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+112:2005:x1830881273047296:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 96us (237us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.019394:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13692 00002000:00100000:1.0:1746065140.019399:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b100 x1830881273047296/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.019405:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b100 with x1830881273047296 ext(0->4095) 00002000:00010000:1.0:1746065140.019407:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93b100 00000100:00100000:0.0:1746065140.022777:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.023574:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273047424 00000100:00100000:2.0:1746065140.023583:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273047424 00000100:00100000:2.0:1746065140.023621:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30506 00000100:00100000:2.0:1746065140.023627:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273047424:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.023641:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.023654:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6140 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.023675:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 111 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.023681:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.023682:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.023685:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.023711:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 111 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.023721:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 111 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.023730:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267728000:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.023804:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.026358:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.026416:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273047552 00000100:00100000:3.0:1746065140.026423:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273047552 00002000:00100000:3.0:1746065140.026459:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f939c00 x1830881273047552/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.026468:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881273047552 ext(0->7) 00010000:00010000:3.0:1746065140.026475:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 112 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.026487:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 112 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.026496:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939c00 00000100:00100000:3.0:1746065140.026528:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2950 00000100:00100000:3.0:1746065140.026535:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+112:2003:x1830881273047552:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746065140.026686:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267728000:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.026707:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.026719:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065140.027063:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273047424:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3435us (4292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.027070:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30506 00000100:00100000:0.0:1746065140.027805:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2003:x1830881273047552:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1269us (1450us total) trans 4294972119 rc 0/0 00000100:00100000:0.0:1746065140.027811:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2950 00002000:00100000:0.0:1746065140.027816:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f939c00 x1830881273047552/t4294972119(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.027823:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881273047552 ext(0->7) 00010000:00010000:0.0:1746065140.027828:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.027837:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.027842:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939c00 00000100:00100000:0.0:1746065140.031336:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.031409:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273047680 00000100:00100000:2.0:1746065140.031418:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273047680 00010000:00010000:2.0:1746065140.031447:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.031483:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14478 00000100:00100000:2.0:1746065140.031489:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2002:x1830881273047680:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.031500:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.031517:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.031528:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.031544:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8801c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6139 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.031572:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.031574:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.031580:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.031586:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.031611:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.031622:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267728128:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.031693:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.037747:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.037829:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273047936 00000100:00100000:1.0:1746065140.037838:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273047936 00002000:00100000:1.0:1746065140.037874:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938380 x1830881273047936/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.037892:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938380 with x1830881273047936 ext(0->4095) 00002000:00010000:1.0:1746065140.037896:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938380 00000100:00100000:1.0:1746065140.037915:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13693 00000100:00100000:1.0:1746065140.037922:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273047936:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.038040:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273047936:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 118us (300us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.038045:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13693 00002000:00100000:1.0:1746065140.038050:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938380 x1830881273047936/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.038057:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938380 with x1830881273047936 ext(0->4095) 00002000:00010000:1.0:1746065140.038060:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938380 00000100:00100000:0.0:1746065140.038542:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.039149:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273048064 00000100:00100000:3.0:1746065140.039155:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273048064 00000100:00100000:3.0:1746065140.039186:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30507 00000100:00100000:3.0:1746065140.039192:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:1791:x1830881273048064:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.039201:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.039215:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6147 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.039235:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.039241:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.039242:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.039246:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 115 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.039271:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.039281:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.039292:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267728256:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.039383:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.039696:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267728128:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.039708:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.039735:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2002:x1830881273047680:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 8247us (8406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.039743:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14478 00000100:00100000:0.0:1746065140.040758:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.040831:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273048192 00000100:00100000:2.0:1746065140.040836:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273048192 00000100:00100000:2.0:1746065140.041248:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30508 00000100:00100000:2.0:1746065140.041255:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:1795:x1830881273048192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.041268:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.041280:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e614e expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.041298:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.041302:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 116 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.041307:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.041310:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 116 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.041333:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 116 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.041343:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 116 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.041352:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:2.0:1746065140.041379:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+116:1795:x1830881273048192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 125us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.041384:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30508 00000100:00100000:3.0:1746065140.041611:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267728256:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.041624:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 115 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.041632:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:0.0:1746065140.041638:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.041652:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:1791:x1830881273048064:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2460us (3110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.041657:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30507 00000100:00100000:2.0:1746065140.041989:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273048320 00000100:00100000:2.0:1746065140.041993:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273048320 00010000:00010000:2.0:1746065140.042009:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.042066:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14479 00000100:00100000:2.0:1746065140.042072:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273048320:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.042095:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.042113:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.042122:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.042138:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8801cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6140 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.042277:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.042279:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.042284:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.042291:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.042311:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.042321:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.042337:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267728512:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.042789:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.043957:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267728512:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.043969:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.043993:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273048320:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1921us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.044000:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14479 00000100:00100000:0.0:1746065140.044289:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.044448:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273048576 00000100:00100000:2.0:1746065140.044452:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273048576 00002000:00100000:2.0:1746065140.044479:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938700 x1830881273048576/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.044488:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938700 with x1830881273048576 ext(0->4095) 00010000:00010000:2.0:1746065140.044494:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.044505:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.044510:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938700 00000100:00100000:2.0:1746065140.044535:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2951 00000100:00100000:2.0:1746065140.044541:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2005:x1830881273048576:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.044636:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2005:x1830881273048576:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 94us (347us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.044644:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2951 00002000:00100000:2.0:1746065140.044650:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938700 x1830881273048576/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.044656:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938700 with x1830881273048576 ext(0->4095) 00010000:00010000:2.0:1746065140.044661:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.044670:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.044679:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938700 00000100:00100000:0.0:1746065140.046202:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.046363:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273048704 00000100:00100000:2.0:1746065140.046369:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273048704 00010000:00010000:2.0:1746065140.046388:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.046449:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14480 00000100:00100000:2.0:1746065140.046456:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2003:x1830881273048704:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.046467:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.046481:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.046490:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.046508:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8801d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6147 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.046656:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.046658:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.046664:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 114 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.046672:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 114 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.046697:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 114 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.046706:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267728640:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.047013:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.048631:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267728640:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.048646:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.048674:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2003:x1830881273048704:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2217us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.048682:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14480 00000100:00100000:0.0:1746065140.049059:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.049255:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273048960 00000100:00100000:1.0:1746065140.049261:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273048960 00002000:00100000:1.0:1746065140.049288:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93bb80 x1830881273048960/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.049296:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93bb80 with x1830881273048960 ext(0->4095) 00002000:00010000:1.0:1746065140.049301:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93bb80 00000100:00100000:1.0:1746065140.049325:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13694 00000100:00100000:1.0:1746065140.049331:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273048960:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.049451:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273048960:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 119us (392us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.049456:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13694 00002000:00100000:1.0:1746065140.049461:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93bb80 x1830881273048960/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.049467:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93bb80 with x1830881273048960 ext(0->4095) 00002000:00010000:1.0:1746065140.049470:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93bb80 00000100:00100000:0.0:1746065140.051510:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.051557:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273049088 00000100:00100000:3.0:1746065140.051562:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273049088 00000100:00100000:3.0:1746065140.051628:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30509 00000100:00100000:3.0:1746065140.051635:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273049088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.051645:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.051658:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6155 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.051678:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 113 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.051685:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.051686:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.051689:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.051713:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 113 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.051727:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 113 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.051818:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267728768:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.051884:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.052825:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267728768:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.052840:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.052850:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065140.052871:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273049088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1237us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.052877:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30509 00000100:00100000:0.0:1746065140.053546:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.053719:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273049216 00000100:00100000:2.0:1746065140.053723:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273049216 00010000:00010000:2.0:1746065140.053741:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 114 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.053759:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14481 00000100:00100000:2.0:1746065140.053765:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273049216:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.053775:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.053788:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 114 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.053798:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 114 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.053814:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f8801dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e614e expref: 114 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.053837:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.053839:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.053844:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.053851:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.053871:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.053880:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267728896:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.053934:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.056295:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.056344:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273049472 00000100:00100000:1.0:1746065140.056350:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273049472 00002000:00100000:1.0:1746065140.056381:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eaa00 x1830881273049472/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.056389:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eaa00 with x1830881273049472 ext(0->4095) 00002000:00010000:1.0:1746065140.056393:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5eaa00 00000100:00100000:1.0:1746065140.056419:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13695 00000100:00100000:1.0:1746065140.056426:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273049472:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.056518:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273049472:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 91us (228us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.056527:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13695 00002000:00100000:1.0:1746065140.056532:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eaa00 x1830881273049472/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.056539:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eaa00 with x1830881273049472 ext(0->4095) 00002000:00010000:1.0:1746065140.056541:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5eaa00 00000100:00100000:2.0:1746065140.056685:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267728896:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.056700:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.056721:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+113:2005:x1830881273049216:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2957us (3176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.056731:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14481 00000100:00100000:0.0:1746065140.058231:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.058436:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273049600 00000100:00100000:3.0:1746065140.058442:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273049600 00000100:00100000:3.0:1746065140.058479:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30510 00000100:00100000:3.0:1746065140.058485:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+113:1795:x1830881273049600:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.058494:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.058507:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e615c expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.058525:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.058535:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.058537:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.058540:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.058561:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.058571:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.058581:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267729024:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.058645:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.059693:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.059816:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273049728 00000100:00100000:1.0:1746065140.059824:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273049728 00000100:00100000:1.0:1746065140.059854:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30511 00000100:00100000:1.0:1746065140.059859:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:1791:x1830881273049728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.059866:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.059874:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6163 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.059886:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.059890:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 116 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.059894:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.059897:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 116 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.059917:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 116 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.059952:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 116 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.059965:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd000, rc 0) 00000100:00100000:1.0:1746065140.059990:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+116:1791:x1830881273049728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 131us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.060523:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30511 00000100:00100000:3.0:1746065140.060590:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267729024:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.060603:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 115 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.060611:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065140.060631:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:1795:x1830881273049600:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2147us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.060636:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30510 00000100:00100000:0.0:1746065140.061007:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.061109:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273049856 00000100:00100000:2.0:1746065140.061113:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273049856 00010000:00010000:2.0:1746065140.061130:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.061155:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14482 00000100:00100000:2.0:1746065140.061160:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273049856:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.061168:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.061182:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.061190:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.061206:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8801e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6155 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.061228:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.061229:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.061235:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.061242:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.061262:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.061272:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.061281:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267729280:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.061330:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.062657:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267729280:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.062668:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.062695:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273049856:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1535us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.062702:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14482 00000100:00100000:0.0:1746065140.063388:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.063491:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273050112 00000100:00100000:3.0:1746065140.063496:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273050112 00002000:00100000:3.0:1746065140.063526:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e9c00 x1830881273050112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.063540:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9c00 with x1830881273050112 ext(0->4095) 00010000:00010000:3.0:1746065140.063546:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.063557:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.063562:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e9c00 00000100:00100000:3.0:1746065140.063760:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2952 00000100:00100000:3.0:1746065140.063767:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2004:x1830881273050112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065140.063939:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2004:x1830881273050112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 171us (551us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.063945:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2952 00002000:00100000:3.0:1746065140.063950:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e9c00 x1830881273050112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.063957:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9c00 with x1830881273050112 ext(0->4095) 00010000:00010000:3.0:1746065140.063961:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.063969:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.063974:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e9c00 00000100:00100000:0.0:1746065140.065287:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.065334:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.065335:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273050240 00000100:00100000:2.0:1746065140.065340:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273050240 00010000:00010000:2.0:1746065140.065360:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.065378:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14483 00000100:00100000:2.0:1746065140.065384:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2004:x1830881273050240:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.065392:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.065405:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.065414:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.065431:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8801eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e615c expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.065458:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.065460:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.065466:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.065473:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.065500:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.065547:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273050368 00000100:00100000:3.0:1746065140.065551:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273050368 00000100:00100000:3.0:1746065140.065572:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30512 00000100:00100000:3.0:1746065140.065577:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273050368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.065586:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.065594:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e616a expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.065609:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.065614:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.065615:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.065617:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.065631:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.065639:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.065649:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267729536:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.065693:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00010000:00010000:2.0:1746065140.065787:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.065796:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267729408:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.065820:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.067421:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267729536:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.067439:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.067453:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065140.067476:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273050368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1899us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.067483:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30512 00000100:00100000:0.0:1746065140.067575:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.067612:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267729408:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.067621:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.067625:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273050624 00000100:00100000:3.0:1746065140.067628:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273050624 00000100:00100000:2.0:1746065140.067639:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2004:x1830881273050240:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2256us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.067646:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14483 00002000:00100000:3.0:1746065140.067649:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e8380 x1830881273050624/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.067656:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e8380 with x1830881273050624 ext(0->4095) 00010000:00010000:3.0:1746065140.067661:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.067670:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.067676:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e8380 00000100:00100000:3.0:1746065140.067687:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2953 00000100:00100000:3.0:1746065140.067691:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2004:x1830881273050624:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065140.068065:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2004:x1830881273050624:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 372us (489us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.068071:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2953 00002000:00100000:3.0:1746065140.068076:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5e8380 x1830881273050624/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.068113:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e8380 with x1830881273050624 ext(0->4095) 00010000:00010000:3.0:1746065140.068118:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.068126:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.068130:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e8380 00000100:00100000:0.0:1746065140.069525:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.069578:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273050752 00000100:00100000:3.0:1746065140.069583:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273050752 00000100:00100000:3.0:1746065140.069617:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30513 00000100:00100000:3.0:1746065140.069622:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:1791:x1830881273050752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746065140.069623:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065140.069632:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.069644:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6171 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.069726:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.069732:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.069738:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065140.069741:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 115 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.069765:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.069780:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 115 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.069788:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:2.0:1746065140.069840:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273050880 00000100:00100000:2.0:1746065140.069843:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273050880 00000100:00100000:3.0:1746065140.069857:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+116:1791:x1830881273050752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 234us (334us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065140.069857:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 116 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.069862:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30513 00000100:00100000:2.0:1746065140.069887:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14484 00000100:00100000:2.0:1746065140.069892:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2005:x1830881273050880:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.069899:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.069911:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 115 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.069920:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 115 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.069947:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8801f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6163 expref: 115 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.069958:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.069959:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.069963:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.069970:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.069987:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.069996:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.070010:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267729792:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.070051:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.071339:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267729792:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.071350:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.071371:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273050880:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1478us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.071376:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14484 00000100:00100000:0.0:1746065140.071752:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.071878:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273051136 00000100:00100000:3.0:1746065140.071882:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273051136 00002000:00100000:3.0:1746065140.071905:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eb480 x1830881273051136/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.071912:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eb480 with x1830881273051136 ext(0->4095) 00010000:00010000:3.0:1746065140.071917:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.071935:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.071941:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5eb480 00000100:00100000:3.0:1746065140.072019:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2954 00000100:00100000:3.0:1746065140.072026:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273051136:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.072147:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273051136:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 121us (395us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.072152:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2954 00002000:00100000:3.0:1746065140.072157:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f5eb480 x1830881273051136/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.072164:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5eb480 with x1830881273051136 ext(0->4095) 00010000:00010000:3.0:1746065140.072168:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.072176:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.072181:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5eb480 00000100:00100000:0.0:1746065140.073809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.073893:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273051264 00000100:00100000:2.0:1746065140.073898:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273051264 00010000:00010000:2.0:1746065140.073916:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.073955:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14485 00000100:00100000:2.0:1746065140.073962:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273051264:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.073970:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.073982:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.073992:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.074008:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8801f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e616a expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.074030:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.074033:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.074038:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.074045:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.074068:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.074079:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267729920:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.074162:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.075787:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267729920:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.075800:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.075825:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273051264:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1864us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.075833:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14485 00000100:00100000:0.0:1746065140.076765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.076826:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273051520 00000100:00100000:3.0:1746065140.076833:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273051520 00002000:00100000:3.0:1746065140.076863:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb65500 x1830881273051520/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.076872:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb65500 with x1830881273051520 ext(0->4095) 00002000:00010000:3.0:1746065140.076876:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb65500 00000100:00100000:1.0:1746065140.077122:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13696 00000100:00100000:1.0:1746065140.077132:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2004:x1830881273051520:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.077227:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2004:x1830881273051520:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 97us (463us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.077233:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13696 00002000:00100000:1.0:1746065140.077237:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb65500 x1830881273051520/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.077245:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb65500 with x1830881273051520 ext(0->4095) 00002000:00010000:1.0:1746065140.077248:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb65500 00000100:00100000:0.0:1746065140.078428:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.078501:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273051648 00000100:00100000:3.0:1746065140.078505:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273051648 00000100:00100000:3.0:1746065140.078585:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30514 00000100:00100000:3.0:1746065140.078591:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273051648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.078601:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.078615:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6178 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.078633:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.078644:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.078645:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.078648:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.078675:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.078685:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 113 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.078695:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267730048:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.078799:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.079756:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267730048:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.079772:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.079782:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065140.079805:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273051648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1213us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.079811:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30514 00000100:00100000:0.0:1746065140.080956:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.081664:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273051776 00000100:00100000:2.0:1746065140.081670:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273051776 00010000:00010000:2.0:1746065140.081695:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.081762:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14486 00000100:00100000:2.0:1746065140.081768:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273051776:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.081780:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.081794:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.081809:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.081828:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880200 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6171 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.082121:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.082123:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.082130:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.082137:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.082165:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.082175:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267730176:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.082248:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.084461:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.084556:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273052032 00000100:00100000:1.0:1746065140.084563:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273052032 00002000:00100000:1.0:1746065140.084593:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb66a00 x1830881273052032/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.084601:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb66a00 with x1830881273052032 ext(0->4095) 00002000:00010000:1.0:1746065140.084605:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb66a00 00000100:00100000:1.0:1746065140.084623:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13697 00000100:00100000:1.0:1746065140.084629:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273052032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.084731:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273052032:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 101us (275us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.084738:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13697 00002000:00100000:1.0:1746065140.084743:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb66a00 x1830881273052032/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.084749:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb66a00 with x1830881273052032 ext(0->4095) 00002000:00010000:1.0:1746065140.084752:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb66a00 00000100:00100000:2.0:1746065140.085241:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267730176:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.085256:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.085278:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+113:2005:x1830881273051776:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3511us (4327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.085286:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14486 00000100:00100000:0.0:1746065140.086660:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.086794:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273052160 00000100:00100000:3.0:1746065140.086801:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273052160 00000100:00100000:3.0:1746065140.086835:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30515 00000100:00100000:3.0:1746065140.086840:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+113:1795:x1830881273052160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.086854:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.086867:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e617f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.086889:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.086895:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.086896:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.086899:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.086922:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.086943:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.086954:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267730304:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.087065:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.087517:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.087575:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273052288 00000100:00100000:1.0:1746065140.087579:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273052288 00000100:00100000:1.0:1746065140.087635:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30516 00000100:00100000:1.0:1746065140.087641:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:1791:x1830881273052288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.087647:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.087654:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6186 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.087665:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.087669:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 116 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.087673:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.087675:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 116 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.087693:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 116 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.087702:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 116 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.087715:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:1.0:1746065140.087747:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+116:1791:x1830881273052288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 106us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.087751:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30516 00000100:00100000:3.0:1746065140.088697:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267730304:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.088711:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 115 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.088719:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:0.0:1746065140.088785:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.088949:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:1795:x1830881273052160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2107us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.088958:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30515 00000100:00100000:2.0:1746065140.089055:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273052416 00000100:00100000:2.0:1746065140.089060:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273052416 00010000:00010000:2.0:1746065140.089077:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.089117:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14487 00000100:00100000:2.0:1746065140.089122:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273052416:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.089298:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.089314:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.089323:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.089341:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880207 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6178 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.089360:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.089365:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.089370:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.089377:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.089398:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.089408:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.089416:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267730560:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.089472:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.090934:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267730560:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.090944:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.090974:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273052416:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1852us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.090981:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14487 00000100:00100000:0.0:1746065140.091751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.091855:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273052672 00000100:00100000:3.0:1746065140.091861:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273052672 00002000:00100000:3.0:1746065140.091889:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64a80 x1830881273052672/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.091898:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64a80 with x1830881273052672 ext(0->4095) 00010000:00010000:3.0:1746065140.091904:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.091914:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.091920:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64a80 00000100:00100000:3.0:1746065140.091954:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2955 00000100:00100000:3.0:1746065140.091960:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2005:x1830881273052672:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.092063:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2005:x1830881273052672:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (312us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.092068:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2955 00002000:00100000:3.0:1746065140.092074:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64a80 x1830881273052672/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.092109:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64a80 with x1830881273052672 ext(0->4095) 00010000:00010000:3.0:1746065140.092114:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.092127:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.092132:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64a80 00000100:00100000:0.0:1746065140.093665:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.093840:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273052800 00000100:00100000:3.0:1746065140.093845:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273052800 00000100:00100000:1.0:1746065140.094456:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30517 00000100:00100000:1.0:1746065140.094464:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273052800:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.094476:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.094488:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e618d expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.094509:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.094512:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.094517:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065140.094520:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.094543:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.094552:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.094560:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfde00, rc 0) 00000100:00100000:1.0:1746065140.094586:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273052800:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 124us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.094592:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30517 00000100:00100000:0.0:1746065140.095177:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.095446:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273052928 00000100:00100000:2.0:1746065140.095450:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273052928 00010000:00010000:2.0:1746065140.095466:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.095697:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14488 00000100:00100000:2.0:1746065140.095703:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2005:x1830881273052928:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.095710:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.095724:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.095734:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.095748:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88020e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e617f expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.095761:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.095763:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.095767:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.095772:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.095790:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.095800:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.095809:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267730816:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.096165:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.097475:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267730816:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.097488:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.097512:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273052928:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1809us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.097520:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14488 00000100:00100000:0.0:1746065140.097685:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.097755:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273053184 00000100:00100000:1.0:1746065140.097759:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273053184 00002000:00100000:1.0:1746065140.097785:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3d880 x1830881273053184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.097793:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3d880 with x1830881273053184 ext(0->4095) 00010000:00010000:1.0:1746065140.097799:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.097807:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.097812:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3d880 00000100:00100000:1.0:1746065140.097836:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2956 00000100:00100000:1.0:1746065140.097841:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273053184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.097955:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273053184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 113us (269us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.097960:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2956 00002000:00100000:1.0:1746065140.097965:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3d880 x1830881273053184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.097972:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3d880 with x1830881273053184 ext(0->4095) 00010000:00010000:1.0:1746065140.097976:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.097988:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.097993:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3d880 00000100:00100000:0.0:1746065140.100365:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.100537:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273053312 00000100:00100000:3.0:1746065140.100542:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273053312 00000100:00100000:3.0:1746065140.100582:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30518 00000100:00100000:3.0:1746065140.100589:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:1791:x1830881273053312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.100600:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.100612:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6194 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.100631:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746065140.100654:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.100792:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273053440 00000100:00100000:2.0:1746065140.100796:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273053440 00010000:00010000:2.0:1746065140.100810:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 116 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.100838:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14489 00000100:00100000:2.0:1746065140.100843:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+116:2003:x1830881273053440:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.100854:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.100881:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.100888:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065140.100891:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 116 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.101071:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 116 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.101100:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 116 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.101115:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880215 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6186 expref: 116 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.101191:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.101202:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 115 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.101213:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.101214:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.101219:0:9560:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.101224:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.101238:0:9560:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.101247:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 5 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.101256:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267731072:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.101314:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065140.101495:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.101517:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2003:x1830881273053440:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 672us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.101523:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14489 00000100:00100000:0.0:1746065140.103231:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.103295:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273053696 00000100:00100000:1.0:1746065140.103299:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273053696 00000100:00100000:3.0:1746065140.103308:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267731072:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.103320:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00002000:00100000:1.0:1746065140.103324:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3f480 x1830881273053696/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.103332:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3f480 with x1830881273053696 ext(0->4095) 00010000:00010000:1.0:1746065140.103337:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.103345:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:1791:x1830881273053312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2757us (2986us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065140.103348:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.103351:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30518 00002000:00010000:1.0:1746065140.103353:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3f480 00000100:00100000:1.0:1746065140.103379:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2957 00000100:00100000:1.0:1746065140.103385:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273053696:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.103465:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273053696:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 79us (237us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.103469:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2957 00002000:00100000:1.0:1746065140.103474:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3f480 x1830881273053696/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.103480:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3f480 with x1830881273053696 ext(0->4095) 00010000:00010000:1.0:1746065140.103485:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.103493:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.103498:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3f480 00000100:00100000:0.0:1746065140.106821:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.106974:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273053824 00000100:00100000:2.0:1746065140.106982:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273053824 00010000:00010000:2.0:1746065140.107014:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.107048:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14490 00000100:00100000:2.0:1746065140.107055:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273053824:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.107068:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.107111:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.107122:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.107146:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f88021c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e618d expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.107167:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.107169:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.107176:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.107184:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.107214:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.107225:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267731200:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.107310:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.109103:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267731200:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.109119:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.109144:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273053824:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2090us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.109152:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14490 00000100:00100000:0.0:1746065140.110382:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.110436:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273054080 00000100:00100000:1.0:1746065140.110444:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273054080 00002000:00100000:1.0:1746065140.110599:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3f800 x1830881273054080/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.110607:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3f800 with x1830881273054080 ext(0->4095) 00002000:00010000:1.0:1746065140.110611:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3f800 00000100:00100000:1.0:1746065140.110639:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13698 00000100:00100000:1.0:1746065140.110645:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2004:x1830881273054080:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.110752:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2004:x1830881273054080:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 106us (373us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.110757:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13698 00002000:00100000:1.0:1746065140.110761:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3f800 x1830881273054080/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.110768:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3f800 with x1830881273054080 ext(0->4095) 00002000:00010000:1.0:1746065140.110770:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3f800 00000100:00100000:0.0:1746065140.112775:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.112947:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273054208 00000100:00100000:3.0:1746065140.112953:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273054208 00000100:00100000:3.0:1746065140.112997:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30519 00000100:00100000:3.0:1746065140.113004:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273054208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.113015:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.113028:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e619b expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.113050:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.113056:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.113057:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.113060:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.113117:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.113128:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 113 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.113139:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267731328:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.113209:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.115597:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267731328:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.115626:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.115638:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065140.115668:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273054208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2665us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.115678:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30519 00000100:00100000:0.0:1746065140.115933:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.116013:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273054336 00000100:00100000:2.0:1746065140.116019:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273054336 00010000:00010000:2.0:1746065140.116038:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.116061:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14491 00000100:00100000:2.0:1746065140.116067:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273054336:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.116076:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.116114:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.116125:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.116141:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880223 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6194 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.116153:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.116155:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.116159:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.116166:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.116187:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.116196:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267731456:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.116256:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.120718:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267731456:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.120737:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.120793:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+113:2005:x1830881273054336:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4725us (4868us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.120802:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14491 00000100:00100000:0.0:1746065140.121428:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.121470:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.121537:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273054720 00000100:00100000:2.0:1746065140.121542:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273054720 00002000:00100000:2.0:1746065140.121571:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3ed80 x1830881273054720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.121579:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3ed80 with x1830881273054720 ext(0->4095) 00002000:00010000:2.0:1746065140.121583:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3ed80 00000100:00100000:2.0:1746065140.121596:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13699 00000100:00100000:2.0:1746065140.121601:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273054720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.121705:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273054720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 104us (234us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.121711:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13699 00002000:00100000:2.0:1746065140.121715:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3ed80 x1830881273054720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.121721:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3ed80 with x1830881273054720 ext(0->4095) 00002000:00010000:2.0:1746065140.121724:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3ed80 00000100:00100000:3.0:1746065140.122499:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273054464 00000100:00100000:3.0:1746065140.122503:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273054464 00000100:00100000:3.0:1746065140.123064:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30520 00000100:00100000:3.0:1746065140.123071:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+113:1791:x1830881273054464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.123124:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.123143:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61a2 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.123166:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.123173:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.123174:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.123177:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.123200:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.123211:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.123221:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267731584:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.123279:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.123609:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.123663:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273054848 00000100:00100000:1.0:1746065140.123667:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273054848 00000100:00100000:1.0:1746065140.123689:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30521 00000100:00100000:1.0:1746065140.123694:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:1795:x1830881273054848:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.123701:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.123707:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61a9 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.123718:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.123721:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 116 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.123725:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.123728:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 116 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.123744:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 116 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.123753:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 116 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.123760:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc600, rc 0) 00000100:00100000:1.0:1746065140.123781:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+116:1795:x1830881273054848:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 87us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.123786:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30521 00000100:00100000:3.0:1746065140.125346:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267731584:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.125367:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 115 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.125378:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065140.125417:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:1791:x1830881273054464:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2346us (3990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.125423:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30520 00000100:00100000:0.0:1746065140.125865:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.126210:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273054976 00000100:00100000:2.0:1746065140.126216:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273054976 00010000:00010000:2.0:1746065140.126237:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.126271:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14492 00000100:00100000:2.0:1746065140.126277:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273054976:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.126286:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.126301:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.126312:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.126329:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88022a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e619b expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.126342:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.126344:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.126350:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.126357:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.126381:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.126391:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.126404:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267731840:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.126466:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.128032:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267731840:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.128046:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.128241:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273054976:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1962us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.128248:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14492 00000100:00100000:0.0:1746065140.128679:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.128763:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273055232 00000100:00100000:1.0:1746065140.128769:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273055232 00002000:00100000:1.0:1746065140.128796:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3fb80 x1830881273055232/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.128804:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3fb80 with x1830881273055232 ext(0->4095) 00010000:00010000:1.0:1746065140.128810:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.128820:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.128824:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3fb80 00000100:00100000:1.0:1746065140.128850:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2958 00000100:00100000:1.0:1746065140.128855:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2004:x1830881273055232:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.128965:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2004:x1830881273055232:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 109us (286us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.128970:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2958 00002000:00100000:1.0:1746065140.128975:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3fb80 x1830881273055232/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.128981:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3fb80 with x1830881273055232 ext(0->4095) 00010000:00010000:1.0:1746065140.128985:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.128994:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.128999:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3fb80 00000100:00100000:0.0:1746065140.131195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.131271:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273055360 00000100:00100000:2.0:1746065140.131278:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273055360 00010000:00010000:2.0:1746065140.131300:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.131320:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14493 00000100:00100000:2.0:1746065140.131325:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+115:2004:x1830881273055360:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.131334:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.131348:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.131358:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.131376:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880231 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a2 expref: 115 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.131387:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.131389:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.131395:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.131402:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.131426:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 114 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.131436:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267731968:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.132301:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.133853:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267731968:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.133869:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065140.133895:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.133909:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2004:x1830881273055360:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2583us (2718us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.133917:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14493 00000100:00100000:3.0:1746065140.133988:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273055616 00000100:00100000:3.0:1746065140.133994:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273055616 00002000:00100000:3.0:1746065140.134022:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3c380 x1830881273055616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.134031:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3c380 with x1830881273055616 ext(0->4095) 00002000:00010000:3.0:1746065140.134035:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3c380 00000100:00100000:3.0:1746065140.134049:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13700 00000100:00100000:3.0:1746065140.134055:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273055616:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.134166:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273055616:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 111us (270us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.134171:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13700 00002000:00100000:3.0:1746065140.134176:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3c380 x1830881273055616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.134183:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3c380 with x1830881273055616 ext(0->4095) 00002000:00010000:3.0:1746065140.134185:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3c380 00000100:00100000:0.0:1746065140.135707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.135826:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273055744 00000100:00100000:3.0:1746065140.135830:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273055744 00000100:00100000:3.0:1746065140.135866:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30522 00000100:00100000:3.0:1746065140.135871:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273055744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.135887:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.135900:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61b0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.135921:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 113 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.135940:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.135942:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.135945:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.135968:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 113 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.135977:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 113 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.135987:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267732096:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.136054:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.137454:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267732096:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.137471:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.137482:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065140.137516:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273055744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1644us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.137522:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30522 00000100:00100000:0.0:1746065140.137855:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.137916:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273055872 00000100:00100000:2.0:1746065140.137921:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273055872 00010000:00010000:2.0:1746065140.137948:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.138147:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14494 00000100:00100000:2.0:1746065140.138153:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273055872:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.138161:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.138175:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.138188:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.138203:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880238 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61a9 expref: 114 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.138212:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.138214:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.138219:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.138225:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.138242:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.138249:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267732224:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.138299:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.139405:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267732224:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.139417:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.139436:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+113:2005:x1830881273055872:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1284us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.139443:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14494 00000100:00100000:0.0:1746065140.140163:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.140203:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273056128 00000100:00100000:3.0:1746065140.140208:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273056128 00002000:00100000:3.0:1746065140.140233:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130178380 x1830881273056128/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.140239:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130178380 with x1830881273056128 ext(0->4095) 00002000:00010000:3.0:1746065140.140243:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130178380 00000100:00100000:3.0:1746065140.140264:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13701 00000100:00100000:3.0:1746065140.140269:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273056128:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.140354:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273056128:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 85us (191us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.140360:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13701 00002000:00100000:3.0:1746065140.140364:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130178380 x1830881273056128/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.140371:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130178380 with x1830881273056128 ext(0->4095) 00002000:00010000:3.0:1746065140.140373:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130178380 00000100:00100000:0.0:1746065140.141181:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.141231:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273056256 00000100:00100000:3.0:1746065140.141235:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273056256 00000100:00100000:3.0:1746065140.141255:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30523 00000100:00100000:3.0:1746065140.141260:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+113:1795:x1830881273056256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.141269:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.141280:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61b7 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.141307:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.141314:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.141315:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.141318:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.141445:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.141457:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.141467:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267732352:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.141524:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.142384:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267732352:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.142400:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 114 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.142409:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065140.142439:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:1795:x1830881273056256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1177us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.142445:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30523 00000100:00100000:0.0:1746065140.142538:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.142594:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273056384 00000100:00100000:3.0:1746065140.142598:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273056384 00010000:00010000:3.0:1746065140.142614:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.142642:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14495 00000100:00100000:3.0:1746065140.142647:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273056384:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.142654:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.142668:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.142675:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.142690:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88023f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b0 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.142702:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.142704:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.142708:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.142714:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.142733:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.142741:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267732480:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.142775:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.144342:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267732480:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.144353:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.144384:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273056384:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1736us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.144391:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14495 00000100:00100000:0.0:1746065140.144851:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.145002:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273056640 00000100:00100000:3.0:1746065140.145006:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273056640 00002000:00100000:3.0:1746065140.145029:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b480 x1830881273056640/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.145037:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b480 with x1830881273056640 ext(0->4095) 00002000:00010000:3.0:1746065140.145042:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017b480 00000100:00100000:3.0:1746065140.145134:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13702 00000100:00100000:3.0:1746065140.145140:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2004:x1830881273056640:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065140.145239:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2004:x1830881273056640:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (388us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.145244:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13702 00002000:00100000:3.0:1746065140.145249:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017b480 x1830881273056640/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.145256:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b480 with x1830881273056640 ext(0->4095) 00002000:00010000:3.0:1746065140.145258:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017b480 00000100:00100000:0.0:1746065140.149595:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.149774:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273056768 00000100:00100000:3.0:1746065140.149781:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273056768 00000100:00100000:3.0:1746065140.149816:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30524 00000100:00100000:3.0:1746065140.149822:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273056768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.149837:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.149852:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61be expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.149877:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.149883:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.149884:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.149888:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.149915:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 113 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.149938:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 113 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.149947:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267732608:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.151209:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.157963:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267732608:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.157989:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.158004:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065140.158050:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273056768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8227us (8461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.158061:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30524 00000100:00100000:0.0:1746065140.160758:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.161020:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273056896 00000100:00100000:3.0:1746065140.161027:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273056896 00002000:00100000:3.0:1746065140.161063:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88013017b100 x1830881273056896/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.161071:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b100 with x1830881273056896 ext(0->7) 00010000:00010000:3.0:1746065140.162150:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.162168:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 114 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.162175:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017b100 00000100:00100000:3.0:1746065140.162194:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2959 00000100:00100000:3.0:1746065140.162201:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+114:2005:x1830881273056896:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065140.163585:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+116:2005:x1830881273056896:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1380us (2830us total) trans 4294972120 rc 0/0 00000100:00100000:0.0:1746065140.163594:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2959 00002000:00100000:0.0:1746065140.163602:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88013017b100 x1830881273056896/t4294972120(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.163617:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017b100 with x1830881273056896 ext(0->7) 00010000:00010000:0.0:1746065140.163623:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 116 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.163635:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 116 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.163640:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017b100 00000001:00080000:0.0:1746065140.166117:0:10896:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294972120 is committed 00000100:00100000:0.0:1746065140.167990:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.169986:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273057024 00000100:00100000:3.0:1746065140.169997:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273057024 00010000:00010000:3.0:1746065140.170034:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.170077:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14496 00000100:00100000:3.0:1746065140.170112:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273057024:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.170124:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.170140:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.170155:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.170172:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880246 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61b7 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.170187:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.170195:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.170201:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.170208:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.170235:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.170245:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267732736:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.170328:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.171728:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267732736:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.171741:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.171768:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2005:x1830881273057024:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1657us (3782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.171775:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14496 00000100:00100000:0.0:1746065140.172848:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.172932:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273057280 00000100:00100000:1.0:1746065140.172937:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273057280 00002000:00100000:1.0:1746065140.172967:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130179500 x1830881273057280/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.172981:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130179500 with x1830881273057280 ext(0->4095) 00002000:00010000:1.0:1746065140.172984:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130179500 00000100:00100000:1.0:1746065140.172997:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13703 00000100:00100000:1.0:1746065140.173001:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273057280:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.173643:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273057280:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 639us (796us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.173649:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13703 00002000:00100000:1.0:1746065140.173655:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130179500 x1830881273057280/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.173662:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130179500 with x1830881273057280 ext(0->4095) 00002000:00010000:1.0:1746065140.173665:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130179500 00000100:00100000:0.0:1746065140.177032:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.177175:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273057408 00000100:00100000:3.0:1746065140.177183:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273057408 00000100:00100000:3.0:1746065140.177218:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30525 00000100:00100000:3.0:1746065140.177225:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:1795:x1830881273057408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.177239:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.177253:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61c5 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.177277:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.177283:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.177285:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.177288:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.177313:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.177323:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 5 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.177334:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267732864:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.177405:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.179285:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.181101:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267732864:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.181125:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.181140:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065140.181176:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:1795:x1830881273057408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3951us (4151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.181183:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30525 00000100:00100000:3.0:1746065140.181207:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273057536 00000100:00100000:3.0:1746065140.181213:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273057536 00000100:00100000:3.0:1746065140.181236:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30526 00000100:00100000:3.0:1746065140.181242:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:1791:x1830881273057536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.181405:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.181416:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61cc expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.181434:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.181438:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.181442:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.181444:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.181466:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.181474:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.181480:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065140.181744:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:1791:x1830881273057536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 501us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.181751:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30526 00000100:00100000:0.0:1746065140.182063:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.182185:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273057664 00000100:00100000:3.0:1746065140.182189:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273057664 00010000:00010000:3.0:1746065140.182202:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.182218:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14497 00000100:00100000:3.0:1746065140.182223:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273057664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.182230:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.182245:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.182254:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.182268:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88024d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61be expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.182280:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.182281:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.182286:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.182293:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.182309:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.182318:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.182328:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267733120:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.182605:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.185998:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.186065:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273057920 00000100:00100000:1.0:1746065140.186073:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273057920 00002000:00100000:1.0:1746065140.186127:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130178e00 x1830881273057920/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065140.186130:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267733120:192.168.202.8@tcp:105: 00002000:00100000:1.0:1746065140.186137:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130178e00 with x1830881273057920 ext(0->4095) 00010000:00010000:1.0:1746065140.186146:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 7 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.186147:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065140.186158:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 7 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.186164:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130178e00 00000100:00100000:3.0:1746065140.186183:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273057664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3958us (4121us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.186191:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14497 00000100:00100000:1.0:1746065140.186197:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2960 00000100:00100000:1.0:1746065140.186204:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273057920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.186298:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273057920:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 94us (306us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.186303:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2960 00002000:00100000:1.0:1746065140.186307:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130178e00 x1830881273057920/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.186313:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130178e00 with x1830881273057920 ext(0->4095) 00010000:00010000:1.0:1746065140.186317:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 7 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.186325:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 7 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.186330:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130178e00 00000100:00100000:2.0:1746065140.190404:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.190517:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.190586:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273058048 00000100:00100000:0.0:1746065140.190594:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273058048 00000100:00100000:0.0:1746065140.190626:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30527 00000100:00100000:0.0:1746065140.190632:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273058048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065140.190646:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065140.190795:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273058176 00000100:00100000:3.0:1746065140.190799:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273058176 00010000:00010000:3.0:1746065140.190814:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 7 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.190841:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14498 00000100:00100000:3.0:1746065140.190845:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273058176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.190853:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.190872:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 7 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.190875:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61d3 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.190882:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 7 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.190899:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880254 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61c5 expref: 7 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.191150:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.191156:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.191166:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065140.191169:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.191197:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.191209:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.191216:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.191217:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.191222:0:9558:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.191228:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.191244:0:9558:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.191253:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065140.191263:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267733376:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065140.191330:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065140.192011:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.192050:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273058176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1202us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.192056:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14498 00000100:00100000:2.0:1746065140.192845:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267733376:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.192856:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6c800, rc 0) 00000100:00100000:2.0:1746065140.193034:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273058048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2400us (2635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.193041:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30527 00000100:00100000:2.0:1746065140.196000:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.196166:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273058432 00000100:00100000:0.0:1746065140.196174:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273058432 00002000:00100000:0.0:1746065140.196203:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a0700 x1830881273058432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.196211:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0700 with x1830881273058432 ext(0->4095) 00010000:00010000:0.0:1746065140.196218:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.196230:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.196235:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a0700 00000100:00100000:0.0:1746065140.196262:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2961 00000100:00100000:0.0:1746065140.196268:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273058432:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065140.196378:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273058432:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 109us (381us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065140.196383:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2961 00002000:00100000:0.0:1746065140.196389:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a0700 x1830881273058432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.196396:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0700 with x1830881273058432 ext(0->4095) 00010000:00010000:0.0:1746065140.196400:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.196408:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.196417:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a0700 00000100:00100000:0.0:1746065140.198172:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.198232:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.198295:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273058688 00000100:00100000:3.0:1746065140.198300:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273058688 00010000:00010000:3.0:1746065140.198321:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.198348:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14499 00000100:00100000:3.0:1746065140.198353:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273058688:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.198361:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.198373:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.198382:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.198397:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88025b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61cc expref: 6 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.198409:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.198410:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.198416:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.198426:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.198447:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.198456:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267733504:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.198504:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.198670:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273058560 00000100:00100000:2.0:1746065140.198673:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273058560 00000100:00100000:2.0:1746065140.198691:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30528 00000100:00100000:2.0:1746065140.198695:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:1791:x1830881273058560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.198703:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.198710:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61da expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.198722:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.198727:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.198728:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.198731:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.198743:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.198752:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.198764:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267733632:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.198786:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.201316:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267733632:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.201339:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.201353:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064c00, rc 0) 00000100:00100000:2.0:1746065140.201754:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:1791:x1830881273058560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3056us (3584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.201762:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30528 00000100:00100000:3.0:1746065140.201904:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.201905:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267733504:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065140.201915:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065140.201949:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273058688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3595us (3715us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.201956:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14499 00000100:00100000:1.0:1746065140.202755:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273058944 00000100:00100000:1.0:1746065140.202763:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273058944 00002000:00100000:1.0:1746065140.202795:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e888380 x1830881273058944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.202804:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e888380 with x1830881273058944 ext(0->4095) 00010000:00010000:1.0:1746065140.202811:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.202822:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.202828:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e888380 00000100:00100000:1.0:1746065140.202854:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2962 00000100:00100000:1.0:1746065140.202859:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273058944:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.202963:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273058944:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 103us (1060us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.202968:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2962 00002000:00100000:1.0:1746065140.202973:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e888380 x1830881273058944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.202980:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e888380 with x1830881273058944 ext(0->4095) 00010000:00010000:1.0:1746065140.202984:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.202992:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.202997:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e888380 00000100:00100000:0.0:1746065140.207260:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.207359:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273059072 00000100:00100000:2.0:1746065140.207367:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273059072 00010000:00010000:2.0:1746065140.207395:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.207427:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14500 00000100:00100000:2.0:1746065140.207433:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273059072:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.207444:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.207459:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.207468:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.207489:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f880262 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61d3 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.207504:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.207505:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.207510:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.207517:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.207540:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.207549:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267733760:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.207611:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.210402:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267733760:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.210420:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.210453:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273059072:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3020us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.210461:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14500 00000100:00100000:0.0:1746065140.211286:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.211384:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273059328 00000100:00100000:1.0:1746065140.211391:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273059328 00002000:00100000:1.0:1746065140.211625:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f1500 x1830881273059328/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.211635:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f1500 with x1830881273059328 ext(0->4095) 00002000:00010000:1.0:1746065140.211639:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f1500 00000100:00100000:1.0:1746065140.211722:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13704 00000100:00100000:1.0:1746065140.211730:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273059328:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.212066:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273059328:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 333us (776us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.212073:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13704 00002000:00100000:1.0:1746065140.212078:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f1500 x1830881273059328/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.212389:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f1500 with x1830881273059328 ext(0->4095) 00002000:00010000:1.0:1746065140.212391:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f1500 00000100:00100000:0.0:1746065140.213376:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.214423:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273059456 00000100:00100000:2.0:1746065140.214430:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273059456 00000100:00100000:2.0:1746065140.214732:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30529 00000100:00100000:2.0:1746065140.214739:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273059456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.214755:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.214769:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61e1 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.214790:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.214795:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.214797:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.214800:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.214822:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.214832:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.215852:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267733888:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.215938:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.217452:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267733888:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.217472:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.217484:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064600, rc 0) 00000100:00100000:2.0:1746065140.217509:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273059456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2771us (4135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.217519:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30529 00000100:00100000:0.0:1746065140.221191:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.221265:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273059584 00000100:00100000:2.0:1746065140.221272:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273059584 00010000:00010000:2.0:1746065140.221298:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.221336:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14501 00000100:00100000:2.0:1746065140.221342:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273059584:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.221356:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.221371:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.221382:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.221399:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064c00/0x392ae0376f880269 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61da expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.221437:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.221439:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.221446:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.221453:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.221481:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.221492:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267734016:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.221546:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.222023:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.222099:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273059712 00000100:00100000:2.0:1746065140.222103:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273059712 00000100:00100000:2.0:1746065140.222121:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30530 00000100:00100000:2.0:1746065140.222126:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:1791:x1830881273059712:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.222137:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.222145:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61e8 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.222158:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.222164:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.222165:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.222167:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.222187:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.222195:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.222203:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267734144:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.222239:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.224176:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267734144:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065140.224191:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065140.224196:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.224207:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065a00, rc 0) 00000100:00100000:3.0:1746065140.224237:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:1791:x1830881273059712:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2110us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.224243:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30530 00000100:00100000:1.0:1746065140.224255:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273059968 00000100:00100000:1.0:1746065140.224261:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273059968 00002000:00100000:1.0:1746065140.224290:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0380 x1830881273059968/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.224299:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0380 with x1830881273059968 ext(0->4095) 00010000:00010000:1.0:1746065140.224305:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.224315:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.224321:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f0380 00000100:00100000:1.0:1746065140.224333:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2963 00000100:00100000:1.0:1746065140.224338:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273059968:12345-192.168.202.8@tcp:3:ldlm_bl.0 00000100:00100000:1.0:1746065140.224432:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273059968:12345-192.168.202.8@tcp:3:ldlm_bl.0 Request processed in 93us (242us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.224437:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2963 00002000:00100000:1.0:1746065140.224442:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0380 x1830881273059968/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.224455:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0380 with x1830881273059968 ext(0->4095) 00010000:00010000:1.0:1746065140.224459:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.224468:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.224473:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f0380 00000100:00100000:2.0:1746065140.224673:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267734016:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.224685:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.224714:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273059584:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3371us (3528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.224721:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14501 00000100:00100000:0.0:1746065140.228030:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.228301:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273060096 00000100:00100000:2.0:1746065140.228308:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273060096 00010000:00010000:2.0:1746065140.228334:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.228514:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14502 00000100:00100000:2.0:1746065140.228521:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273060096:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.228533:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.228548:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.228559:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.228577:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064600/0x392ae0376f880270 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e1 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.228658:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.228660:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.228667:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.228674:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.228708:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.228723:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267734272:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.228775:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.230543:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267734272:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.230555:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.230585:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273060096:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2063us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.230592:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14502 00000100:00100000:0.0:1746065140.231370:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.231525:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273060352 00000100:00100000:2.0:1746065140.231530:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273060352 00002000:00100000:2.0:1746065140.231557:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3100 x1830881273060352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.231567:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3100 with x1830881273060352 ext(0->4095) 00002000:00010000:2.0:1746065140.231570:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f3100 00000100:00100000:2.0:1746065140.231584:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13705 00000100:00100000:2.0:1746065140.231590:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273060352:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.231679:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273060352:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 89us (311us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.231685:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13705 00002000:00100000:2.0:1746065140.231689:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3100 x1830881273060352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.231702:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3100 with x1830881273060352 ext(0->4095) 00002000:00010000:2.0:1746065140.231705:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f3100 00000100:00100000:0.0:1746065140.233409:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.236157:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273060480 00000100:00100000:3.0:1746065140.236167:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273060480 00000100:00100000:3.0:1746065140.236207:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30531 00000100:00100000:3.0:1746065140.236214:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273060480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.236227:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.236239:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61ef expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.236268:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.236274:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.236275:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.236279:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.236301:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.236310:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.236320:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267734400:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.236393:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065140.236485:0:8891:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065140.238353:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267734400:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.238374:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.238386:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065140.238413:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273060480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2200us (5009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.238418:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30531 00000100:00100000:0.0:1746065140.238990:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.239075:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273060608 00000100:00100000:1.0:1746065140.239102:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273060608 00002000:00100000:1.0:1746065140.239134:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8801306f2680 x1830881273060608/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.239142:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2680 with x1830881273060608 ext(0->7) 00010000:00010000:1.0:1746065140.239152:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.239165:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.239170:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f2680 00000100:00100000:1.0:1746065140.239686:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2964 00000100:00100000:1.0:1746065140.239693:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273060608:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065140.240890:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273060608:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1194us (1897us total) trans 4294972121 rc 0/0 00000100:00100000:0.0:1746065140.240897:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2964 00002000:00100000:0.0:1746065140.240903:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8801306f2680 x1830881273060608/t4294972121(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.240911:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2680 with x1830881273060608 ext(0->7) 00010000:00010000:0.0:1746065140.240918:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.240942:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.240947:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f2680 00000100:00100000:0.0:1746065140.242745:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.242825:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273060736 00000100:00100000:2.0:1746065140.242832:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273060736 00010000:00010000:2.0:1746065140.242857:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.242889:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14503 00000100:00100000:2.0:1746065140.242895:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273060736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.242906:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.242919:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.242944:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.242963:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880277 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61e8 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.243011:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.243013:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.243019:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.243026:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.243052:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.243062:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267734528:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.243577:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.244831:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267734528:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.244844:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.244877:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273060736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1982us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.244967:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14503 00000100:00100000:0.0:1746065140.245079:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.245290:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273060992 00000100:00100000:2.0:1746065140.245296:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273060992 00002000:00100000:2.0:1746065140.245321:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f1180 x1830881273060992/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.245329:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f1180 with x1830881273060992 ext(0->4095) 00002000:00010000:2.0:1746065140.245332:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f1180 00000100:00100000:2.0:1746065140.245356:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13706 00000100:00100000:2.0:1746065140.245361:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273060992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065140.245459:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273060992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 97us (380us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.245464:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13706 00002000:00100000:2.0:1746065140.245468:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f1180 x1830881273060992/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.245481:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f1180 with x1830881273060992 ext(0->4095) 00002000:00010000:2.0:1746065140.245483:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f1180 00000100:00100000:0.0:1746065140.248884:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.248964:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.249053:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273061120 00000100:00100000:3.0:1746065140.249061:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273061120 00000100:00100000:3.0:1746065140.249110:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273061248 00000100:00100000:3.0:1746065140.249112:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273061248 00000100:00100000:3.0:1746065140.249509:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30532 00000100:00100000:1.0:1746065140.249588:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30533 00000100:00100000:3.0:1746065140.249589:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:1795:x1830881273061120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:1.0:1746065140.249594:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:1791:x1830881273061248:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.249602:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.249602:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.249615:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61f6 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.249615:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e61fd expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.249636:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.249770:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.249771:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.249775:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 10 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.249796:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.249800:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 10 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.249805:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.249808:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 10 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.249825:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.249836:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.249846:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267734656:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.249847:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 10 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.249855:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 10 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.249862:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:1.0:1746065140.249895:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:1791:x1830881273061248:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 301us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.249900:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30533 00000100:00100000:3.0:1746065140.250266:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.251112:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267734656:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.251125:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.251139:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065140.251161:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1795:x1830881273061120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1574us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.251167:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30532 00000100:00100000:0.0:1746065140.251582:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.251652:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273061376 00000100:00100000:2.0:1746065140.251658:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273061376 00010000:00010000:2.0:1746065140.251678:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.251750:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14504 00000100:00100000:2.0:1746065140.251757:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273061376:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.251766:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.251780:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.251790:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.251809:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88027e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61ef expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.251844:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.251846:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.251851:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.251858:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.251891:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.251901:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.251908:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267734912:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.251966:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.253421:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267734912:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.253434:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.253456:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273061376:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1700us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.253462:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14504 00000100:00100000:0.0:1746065140.253523:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.253612:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273061632 00000100:00100000:2.0:1746065140.253617:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273061632 00002000:00100000:2.0:1746065140.253639:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f2300 x1830881273061632/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.253647:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2300 with x1830881273061632 ext(0->4095) 00010000:00010000:2.0:1746065140.253653:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.253663:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.253669:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f2300 00000100:00100000:2.0:1746065140.253800:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2965 00000100:00100000:2.0:1746065140.253811:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273061632:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.253911:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273061632:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 104us (387us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.253917:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2965 00002000:00100000:2.0:1746065140.253931:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f2300 x1830881273061632/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.253939:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2300 with x1830881273061632 ext(0->4095) 00010000:00010000:2.0:1746065140.253943:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.253952:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.253957:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f2300 00000100:00100000:0.0:1746065140.255252:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.255290:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.255353:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273061888 00000100:00100000:3.0:1746065140.255357:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273061888 00000100:00100000:2.0:1746065140.255431:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273061760 00000100:00100000:2.0:1746065140.255435:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273061760 00010000:00010000:2.0:1746065140.255448:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.255466:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14505 00000100:00100000:2.0:1746065140.255471:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273061760:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.255479:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.255491:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.255504:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.255520:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880285 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61f6 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.255534:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.255536:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.255541:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.255547:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.255570:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.255579:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267735040:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.255630:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30534 00000100:00100000:3.0:1746065140.255636:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273061888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.255645:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.255654:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6204 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.255668:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.255674:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.255675:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.255678:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.255693:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.255700:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.255711:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267735168:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.256190:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.256479:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.258337:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.258391:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267735168:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.258409:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.258421:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065140.258459:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273061888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2823us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.258465:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30534 00000100:00100000:2.0:1746065140.258994:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267735040:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.259004:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.259026:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273061760:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3555us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.259034:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14505 00000100:00100000:2.0:1746065140.259396:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273062144 00000100:00100000:2.0:1746065140.259401:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273062144 00002000:00100000:2.0:1746065140.259430:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a4380 x1830881273062144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.259438:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4380 with x1830881273062144 ext(0->4095) 00010000:00010000:2.0:1746065140.259444:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.259454:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.259460:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a4380 00000100:00100000:2.0:1746065140.259484:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2966 00000100:00100000:2.0:1746065140.259490:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2002:x1830881273062144:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746065140.259604:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2002:x1830881273062144:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 113us (1271us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.259610:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2966 00002000:00100000:2.0:1746065140.259614:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a4380 x1830881273062144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.259621:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4380 with x1830881273062144 ext(0->4095) 00010000:00010000:2.0:1746065140.259625:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.259634:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.259639:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a4380 00000100:00100000:0.0:1746065140.262963:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.263124:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.263182:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273062400 00000100:00100000:3.0:1746065140.263184:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273062272 00000100:00100000:3.0:1746065140.263190:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273062272 00000100:00100000:2.0:1746065140.263190:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273062400 00010000:00010000:2.0:1746065140.263219:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 9 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.263223:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30535 00000100:00100000:3.0:1746065140.263229:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1791:x1830881273062272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.263299:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.263312:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e620b expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.263324:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14506 00000100:00100000:2.0:1746065140.263329:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2003:x1830881273062400:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.263333:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.263337:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.263338:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.263342:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065140.263345:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 10 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.263357:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.263366:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.263378:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.263380:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f88028c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e61fd expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.263388:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.263395:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.263396:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.263401:0:9558:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.263407:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.263421:0:9558:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.263430:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.263439:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267735424:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.263578:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.263591:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.263601:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2003:x1830881273062400:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 271us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.263608:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14506 00000100:00100000:3.0:1746065140.264903:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267735424:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.264917:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065140.264964:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:1791:x1830881273062272:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1734us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.264973:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30535 00000100:00100000:0.0:1746065140.265437:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.265516:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273062656 00000100:00100000:3.0:1746065140.265520:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273062656 00002000:00100000:3.0:1746065140.265550:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a4700 x1830881273062656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.265558:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4700 with x1830881273062656 ext(0->4095) 00010000:00010000:3.0:1746065140.265565:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.265575:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.265580:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a4700 00000100:00100000:3.0:1746065140.265607:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2967 00000100:00100000:3.0:1746065140.265613:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273062656:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.265709:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273062656:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 96us (272us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.265714:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2967 00002000:00100000:3.0:1746065140.265719:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a4700 x1830881273062656/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.265726:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4700 with x1830881273062656 ext(0->4095) 00010000:00010000:3.0:1746065140.265730:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.265741:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.265746:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a4700 00000100:00100000:0.0:1746065140.266947:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.267015:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273062784 00000100:00100000:2.0:1746065140.267020:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273062784 00010000:00010000:2.0:1746065140.267042:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.267061:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14507 00000100:00100000:2.0:1746065140.267067:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273062784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.267077:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.267110:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.267119:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.267137:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880293 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6204 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.267161:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.267163:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.267169:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.267176:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.267203:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.267214:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267735552:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.267281:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.268646:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267735552:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.268659:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.268683:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273062784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1617us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.268693:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14507 00000100:00100000:0.0:1746065140.269170:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.269347:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273063040 00000100:00100000:3.0:1746065140.269352:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273063040 00002000:00100000:3.0:1746065140.269380:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a4000 x1830881273063040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.269388:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4000 with x1830881273063040 ext(0->4095) 00002000:00010000:3.0:1746065140.269391:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a4000 00000100:00100000:3.0:1746065140.269410:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13707 00000100:00100000:3.0:1746065140.269415:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273063040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.269502:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273063040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 88us (333us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.269506:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13707 00002000:00100000:3.0:1746065140.269509:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a4000 x1830881273063040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.269513:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a4000 with x1830881273063040 ext(0->4095) 00002000:00010000:3.0:1746065140.269514:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a4000 00000100:00100000:0.0:1746065140.271358:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.271423:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273063168 00000100:00100000:3.0:1746065140.271429:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273063168 00000100:00100000:3.0:1746065140.271674:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30536 00000100:00100000:3.0:1746065140.271680:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273063168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.271695:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.271708:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6212 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.271729:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.271736:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.271737:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.271740:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.271762:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.271772:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 7 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.271782:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267735680:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.272143:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.273833:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267735680:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.273852:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.273864:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065140.274410:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273063168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2728us (3054us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.274421:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30536 00000100:00100000:0.0:1746065140.274996:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.275140:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273063296 00000100:00100000:2.0:1746065140.275146:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273063296 00010000:00010000:2.0:1746065140.275169:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.275186:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14508 00000100:00100000:2.0:1746065140.275190:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273063296:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.275199:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.275214:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.275223:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.275241:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f88029a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e620b expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.275715:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.275717:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.275724:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.275731:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.275754:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.275764:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267735808:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.276237:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.277711:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267735808:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.277726:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.277903:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273063296:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2710us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.277912:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14508 00000100:00100000:3.0:1746065140.279690:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.279768:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.279837:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273063552 00000100:00100000:2.0:1746065140.279844:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273063552 00002000:00100000:2.0:1746065140.279877:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e888700 x1830881273063552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.279896:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e888700 with x1830881273063552 ext(0->4095) 00002000:00010000:2.0:1746065140.279901:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e888700 00000100:00100000:2.0:1746065140.279937:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13708 00000100:00100000:2.0:1746065140.279944:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273063552:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065140.280073:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273063680 00000100:00100000:0.0:1746065140.280076:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273063680 00000100:00100000:2.0:1746065140.280597:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273063552:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 653us (911us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.280604:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13708 00002000:00100000:2.0:1746065140.280609:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e888700 x1830881273063552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.280615:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e888700 with x1830881273063552 ext(0->4095) 00002000:00010000:2.0:1746065140.280618:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e888700 00000100:00100000:0.0:1746065140.280782:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30537 00000100:00100000:0.0:1746065140.280788:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:1791:x1830881273063680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065140.280796:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.280809:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6219 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.280828:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.280835:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.280836:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.280839:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.280861:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.280871:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065140.280881:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267735936:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065140.280950:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.283544:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267735936:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.283570:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.283584:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6c000, rc 0) 00000100:00100000:2.0:1746065140.283628:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:1791:x1830881273063680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2839us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.283635:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30537 00000100:00100000:0.0:1746065140.283754:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.283839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.283960:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273063936 00000100:00100000:3.0:1746065140.283966:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273063936 00010000:00010000:3.0:1746065140.283986:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.284005:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14509 00000100:00100000:3.0:1746065140.284010:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273063936:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.284019:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.284034:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.284038:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273063808 00000100:00100000:2.0:1746065140.284041:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273063808 00010000:00010000:3.0:1746065140.284044:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.284060:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8802a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6212 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.284072:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.284074:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.284079:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.284108:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.284134:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.284143:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267736064:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.284187:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.284227:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30538 00000100:00100000:2.0:1746065140.284233:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:1795:x1830881273063808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.284243:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.284251:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6220 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.284265:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.284270:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.284271:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.284273:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.284287:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.284297:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.284306:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267736192:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.284338:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.285282:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267736064:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.285289:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.285477:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273063936:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1465us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.285484:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14509 00000100:00100000:2.0:1746065140.286473:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267736192:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.286490:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.286501:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:2.0:1746065140.286534:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1795:x1830881273063808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2300us (2780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.286539:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30538 00000100:00100000:0.0:1746065140.286795:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.286955:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273064192 00000100:00100000:2.0:1746065140.286961:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273064192 00002000:00100000:2.0:1746065140.286985:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18c700 x1830881273064192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.286993:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18c700 with x1830881273064192 ext(0->4095) 00010000:00010000:2.0:1746065140.286999:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.287009:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.287015:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18c700 00000100:00100000:2.0:1746065140.287034:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2968 00000100:00100000:2.0:1746065140.287039:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273064192:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.287169:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273064192:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 129us (374us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.287174:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2968 00002000:00100000:2.0:1746065140.287178:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18c700 x1830881273064192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.287185:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18c700 with x1830881273064192 ext(0->4095) 00010000:00010000:2.0:1746065140.287189:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.287197:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.287202:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f18c700 00000100:00100000:0.0:1746065140.288914:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.289064:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273064320 00000100:00100000:2.0:1746065140.289070:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273064320 00010000:00010000:2.0:1746065140.289109:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.289473:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14510 00000100:00100000:2.0:1746065140.289482:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273064320:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.289492:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.289507:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.289516:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.289532:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f8802a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6219 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.289547:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.289548:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.289554:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.289561:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.289585:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.289595:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267736320:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.289652:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.292249:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.292409:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273064576 00000100:00100000:3.0:1746065140.292415:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273064576 00002000:00100000:3.0:1746065140.292445:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18e300 x1830881273064576/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.292453:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18e300 with x1830881273064576 ext(0->4095) 00002000:00010000:3.0:1746065140.292457:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f18e300 00000100:00100000:3.0:1746065140.292472:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13709 00000100:00100000:3.0:1746065140.292477:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273064576:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065140.292654:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267736320:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.292667:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.292712:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273064320:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3231us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.292719:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14510 00000100:00100000:3.0:1746065140.293107:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273064576:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 601us (836us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.293114:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13709 00002000:00100000:3.0:1746065140.293119:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f18e300 x1830881273064576/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.293125:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f18e300 with x1830881273064576 ext(0->4095) 00002000:00010000:3.0:1746065140.293128:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f18e300 00000100:00100000:0.0:1746065140.295253:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.295333:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273064704 00000100:00100000:2.0:1746065140.295340:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273064704 00000100:00100000:2.0:1746065140.295497:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30539 00000100:00100000:2.0:1746065140.295503:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273064704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.295515:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.295529:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6227 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.295551:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.295558:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.295559:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.295562:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.295585:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 7 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.295595:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 7 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.295605:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267736448:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.295986:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.297733:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267736448:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.297754:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.297767:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065140.297797:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273064704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2294us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.297803:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30539 00000100:00100000:0.0:1746065140.299323:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.299388:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273064832 00000100:00100000:2.0:1746065140.299394:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273064832 00010000:00010000:2.0:1746065140.299416:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.299527:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14511 00000100:00100000:2.0:1746065140.299533:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273064832:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.299542:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.299557:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.299566:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.299582:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8802af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6220 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.299823:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.299825:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.299832:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.299838:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.299865:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.299874:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267736576:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.300327:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.301787:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.301825:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267736576:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.301839:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.301870:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273064832:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2336us (2550us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.301878:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14511 00000100:00100000:3.0:1746065140.301952:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273065088 00000100:00100000:3.0:1746065140.301958:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273065088 00002000:00100000:3.0:1746065140.301990:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f729c00 x1830881273065088/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.301999:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729c00 with x1830881273065088 ext(0->4095) 00002000:00010000:3.0:1746065140.302003:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f729c00 00000100:00100000:3.0:1746065140.302248:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13710 00000100:00100000:3.0:1746065140.302256:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273065088:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065140.302353:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273065088:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (572us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.302359:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13710 00002000:00100000:3.0:1746065140.302364:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f729c00 x1830881273065088/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.302371:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729c00 with x1830881273065088 ext(0->4095) 00002000:00010000:3.0:1746065140.302374:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f729c00 00000100:00100000:0.0:1746065140.303733:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.304165:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273065216 00000100:00100000:2.0:1746065140.304170:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273065216 00000100:00100000:2.0:1746065140.304254:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30540 00000100:00100000:2.0:1746065140.304259:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:1791:x1830881273065216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.304271:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.304283:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e622e expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.304303:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.304308:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.304309:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.304312:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.304339:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.304349:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.304358:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267736704:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.304766:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.304949:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.305001:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273065344 00000100:00100000:1.0:1746065140.305004:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273065344 00000100:00100000:1.0:1746065140.305024:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30541 00000100:00100000:1.0:1746065140.305029:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1795:x1830881273065344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.305036:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.305044:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6235 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.305056:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.305060:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 10 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.305065:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.305067:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 10 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.305468:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 10 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.305480:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 10 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.305488:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd200, rc 0) 00000100:00100000:1.0:1746065140.305525:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:1795:x1830881273065344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 495us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.305531:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30541 00000100:00100000:3.0:1746065140.306882:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267736704:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.306898:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.306907:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:3.0:1746065140.306951:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1791:x1830881273065216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2692us (3222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.306957:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30540 00000100:00100000:0.0:1746065140.307520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.307559:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273065472 00000100:00100000:3.0:1746065140.307566:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273065472 00010000:00010000:3.0:1746065140.307584:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.307884:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14512 00000100:00100000:3.0:1746065140.307891:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273065472:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.307901:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.307916:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.307936:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.307953:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8802b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6227 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.307976:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.307977:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.307983:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.307989:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.308011:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.308020:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.308034:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267736960:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.309232:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.310564:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267736960:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.310577:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.310619:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273065472:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2727us (3098us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.310628:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14512 00000100:00100000:0.0:1746065140.310802:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.310820:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273065728 00000100:00100000:1.0:1746065140.310825:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273065728 00002000:00100000:1.0:1746065140.310850:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72b480 x1830881273065728/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.310857:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72b480 with x1830881273065728 ext(0->4095) 00010000:00010000:1.0:1746065140.310864:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.310879:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.310884:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72b480 00000100:00100000:1.0:1746065140.310910:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2969 00000100:00100000:1.0:1746065140.310916:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273065728:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.311029:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273065728:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (227us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.311035:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2969 00002000:00100000:1.0:1746065140.311040:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72b480 x1830881273065728/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.311047:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72b480 with x1830881273065728 ext(0->4095) 00010000:00010000:1.0:1746065140.311051:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.311059:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.311064:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72b480 00000100:00100000:0.0:1746065140.312321:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.312455:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273065856 00000100:00100000:3.0:1746065140.312461:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273065856 00010000:00010000:3.0:1746065140.312479:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.312511:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14513 00000100:00100000:3.0:1746065140.312517:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2002:x1830881273065856:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.312526:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.312540:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.312548:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.312564:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8802bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e622e expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.312575:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.312577:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.312583:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.312589:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.312612:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.312622:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267737088:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.313399:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.315662:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267737088:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.315678:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.315727:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2002:x1830881273065856:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3209us (3408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.315736:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14513 00000100:00100000:0.0:1746065140.315792:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.315861:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273066112 00000100:00100000:3.0:1746065140.315866:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273066112 00002000:00100000:3.0:1746065140.315893:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72aa00 x1830881273066112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.315902:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72aa00 with x1830881273066112 ext(0->4095) 00002000:00010000:3.0:1746065140.315906:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72aa00 00000100:00100000:3.0:1746065140.315931:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13711 00000100:00100000:3.0:1746065140.315937:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2003:x1830881273066112:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746065140.316024:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2003:x1830881273066112:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 87us (232us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.316035:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13711 00002000:00100000:3.0:1746065140.316040:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72aa00 x1830881273066112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.316046:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72aa00 with x1830881273066112 ext(0->4095) 00002000:00010000:3.0:1746065140.316049:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f72aa00 00000100:00100000:0.0:1746065140.317701:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.317774:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273066240 00000100:00100000:3.0:1746065140.317779:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273066240 00000100:00100000:3.0:1746065140.317801:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30542 00000100:00100000:3.0:1746065140.317806:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273066240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.317815:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.317826:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e623c expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.317845:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.317851:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.317852:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.317854:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.317874:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.317883:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 7 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.317895:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267737216:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.318425:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.319810:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267737216:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.319830:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.319842:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065140.319880:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273066240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2073us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.319887:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30542 00000100:00100000:0.0:1746065140.320385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.320442:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273066368 00000100:00100000:3.0:1746065140.320447:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273066368 00010000:00010000:3.0:1746065140.320465:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.320493:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14514 00000100:00100000:3.0:1746065140.320498:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273066368:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.320509:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.320524:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.320533:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.320555:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8802c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6235 expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.320567:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.320568:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.320573:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.320579:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.320598:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.320607:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267737344:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.320656:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.322455:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267737344:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.322469:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.322497:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273066368:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1998us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.322505:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14514 00000100:00100000:0.0:1746065140.322669:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.322754:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273066624 00000100:00100000:1.0:1746065140.322763:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273066624 00002000:00100000:1.0:1746065140.322792:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c323800 x1830881273066624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.322800:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323800 with x1830881273066624 ext(0->4095) 00002000:00010000:1.0:1746065140.322804:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c323800 00000100:00100000:1.0:1746065140.323265:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13712 00000100:00100000:1.0:1746065140.323272:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273066624:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.323374:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273066624:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (704us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.323380:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13712 00002000:00100000:1.0:1746065140.323384:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c323800 x1830881273066624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.323392:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323800 with x1830881273066624 ext(0->4095) 00002000:00010000:1.0:1746065140.323395:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c323800 00000100:00100000:0.0:1746065140.327283:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.327499:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273066752 00000100:00100000:3.0:1746065140.327507:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273066752 00000100:00100000:3.0:1746065140.327561:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30543 00000100:00100000:3.0:1746065140.327569:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:1795:x1830881273066752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.327586:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.327601:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6243 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.327624:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.327630:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.327631:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.327634:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.327657:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.327667:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.327677:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267737472:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.327733:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8100c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.327765:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.327797:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273066880 00000100:00100000:0.0:1746065140.327801:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273066880 00000100:00100000:0.0:1746065140.327816:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30544 00000100:00100000:0.0:1746065140.327821:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1791:x1830881273066880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065140.327827:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.327832:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e624a expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.327842:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.327845:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 10 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.327849:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065140.327851:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 10 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.327871:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 10 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.327882:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 10 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.327890:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6c200, rc 0) 00000100:00100000:0.0:1746065140.327908:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:1791:x1830881273066880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.327913:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30544 00000100:00100000:3.0:1746065140.329982:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267737472:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.330004:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.330016:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065140.330045:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1795:x1830881273066752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2478us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.330055:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30543 00000100:00100000:0.0:1746065140.331787:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.332074:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273067008 00000100:00100000:3.0:1746065140.332244:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273067008 00010000:00010000:3.0:1746065140.332271:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.332490:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14515 00000100:00100000:3.0:1746065140.332497:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273067008:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.332507:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.332526:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.332537:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.332554:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8802cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e623c expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.332808:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.332811:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.332817:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.332825:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.332852:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.332863:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.332872:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267737728:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.333518:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.337748:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267737728:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.337762:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.337953:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273067008:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5455us (6169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.337964:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14515 00000100:00100000:0.0:1746065140.338514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.338601:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273067264 00000100:00100000:1.0:1746065140.338606:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273067264 00002000:00100000:1.0:1746065140.338631:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c320700 x1830881273067264/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.338638:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320700 with x1830881273067264 ext(0->4095) 00010000:00010000:1.0:1746065140.338644:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.338653:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.338657:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c320700 00000100:00100000:1.0:1746065140.338675:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2970 00000100:00100000:1.0:1746065140.338681:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273067264:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.338792:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273067264:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 111us (279us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.338797:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2970 00002000:00100000:1.0:1746065140.338801:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c320700 x1830881273067264/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.338808:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c320700 with x1830881273067264 ext(0->4095) 00010000:00010000:1.0:1746065140.338811:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.338818:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.338823:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c320700 00000100:00100000:0.0:1746065140.341873:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.342057:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273067392 00000100:00100000:3.0:1746065140.342065:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273067392 00010000:00010000:3.0:1746065140.342119:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.342149:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14516 00000100:00100000:3.0:1746065140.342156:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273067392:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.342166:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.342181:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.342190:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.342799:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8802d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6243 expref: 9 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.342828:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.342831:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.342837:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.342845:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.342873:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.342883:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267737856:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.343619:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.345224:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267737856:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.345238:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.345268:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273067392:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3112us (3400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.345277:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14516 00000100:00100000:0.0:1746065140.346054:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.346130:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273067648 00000100:00100000:1.0:1746065140.346136:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273067648 00002000:00100000:1.0:1746065140.346164:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04a80 x1830881273067648/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.346172:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04a80 with x1830881273067648 ext(0->4095) 00002000:00010000:1.0:1746065140.346176:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04a80 00000100:00100000:1.0:1746065140.346202:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13713 00000100:00100000:1.0:1746065140.346208:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273067648:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.346303:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273067648:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (250us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.346308:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13713 00002000:00100000:1.0:1746065140.346313:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a04a80 x1830881273067648/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.346325:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a04a80 with x1830881273067648 ext(0->4095) 00002000:00010000:1.0:1746065140.346328:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a04a80 00000100:00100000:0.0:1746065140.347962:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.348010:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273067776 00000100:00100000:3.0:1746065140.348016:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273067776 00000100:00100000:3.0:1746065140.348055:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30545 00000100:00100000:3.0:1746065140.348060:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273067776:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.348071:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.348115:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6251 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.348141:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.348148:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.348149:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.348152:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.348177:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.348193:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 7 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.348203:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267737984:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.348397:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8100c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.349547:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267737984:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.349567:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.349577:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:2.0:1746065140.349612:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273067776:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1552us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.349619:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30545 00000100:00100000:0.0:1746065140.350542:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.350629:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273067904 00000100:00100000:3.0:1746065140.350635:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273067904 00002000:00100000:3.0:1746065140.350663:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009dc10e00 x1830881273067904/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.350671:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10e00 with x1830881273067904 ext(0->7) 00010000:00010000:3.0:1746065140.350677:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.350686:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 8 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.350696:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc10e00 00000100:00100000:3.0:1746065140.350798:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2971 00000100:00100000:3.0:1746065140.350805:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273067904:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065140.352249:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273067904:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1440us (1704us total) trans 4294972122 rc 0/0 00000100:00100000:0.0:1746065140.352258:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2971 00002000:00100000:0.0:1746065140.352264:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009dc10e00 x1830881273067904/t4294972122(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.352271:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc10e00 with x1830881273067904 ext(0->7) 00010000:00010000:0.0:1746065140.352278:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.352288:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.352294:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc10e00 00000100:00100000:0.0:1746065140.353580:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.353628:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273068032 00000100:00100000:3.0:1746065140.353634:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273068032 00010000:00010000:3.0:1746065140.353656:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.353712:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14517 00000100:00100000:3.0:1746065140.353720:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881273068032:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.353730:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.353743:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.353752:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.353770:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c200/0x392ae0376f8802d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e624a expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.353791:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.353792:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.353798:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.353806:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.353826:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.353833:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267738112:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.353886:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.354767:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267738112:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.354779:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.354802:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273068032:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1083us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.354809:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14517 00000100:00100000:0.0:1746065140.356477:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.356915:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273068288 00000100:00100000:2.0:1746065140.356932:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273068288 00002000:00100000:2.0:1746065140.356966:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc13100 x1830881273068288/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.356974:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc13100 with x1830881273068288 ext(0->4095) 00002000:00010000:2.0:1746065140.356979:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc13100 00000100:00100000:2.0:1746065140.357008:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13714 00000100:00100000:2.0:1746065140.357015:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273068288:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.358674:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273068288:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 116us (660us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.358685:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13714 00002000:00100000:2.0:1746065140.358694:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc13100 x1830881273068288/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.358703:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc13100 with x1830881273068288 ext(0->4095) 00002000:00010000:2.0:1746065140.358706:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc13100 00000100:00100000:0.0:1746065140.361367:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.361443:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273068544 00000100:00100000:2.0:1746065140.361450:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273068544 00002000:00100000:2.0:1746065140.361481:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc11500 x1830881273068544/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.361490:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc11500 with x1830881273068544 ext(0->4095) 00002000:00010000:2.0:1746065140.361494:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc11500 00000100:00100000:2.0:1746065140.361521:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13715 00000100:00100000:2.0:1746065140.361528:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273068544:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065140.361798:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273068544:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 270us (438us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.361804:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13715 00002000:00100000:2.0:1746065140.361809:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc11500 x1830881273068544/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.361816:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc11500 with x1830881273068544 ext(0->4095) 00002000:00010000:2.0:1746065140.361819:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc11500 00000100:00100000:2.0:1746065140.366407:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.366440:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.366477:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273068672 00000100:00100000:1.0:1746065140.366485:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273068672 00000100:00100000:1.0:1746065140.366527:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273068800 00000100:00100000:1.0:1746065140.366529:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273068800 00000100:00100000:1.0:1746065140.366542:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30546 00000100:00100000:1.0:1746065140.366548:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:1791:x1830881273068672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.366561:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065140.366570:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30547 00010000:00010000:1.0:1746065140.366574:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6258 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.366578:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:1795:x1830881273068800:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065140.366585:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.366591:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e625f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.366600:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.366607:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.366609:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.366612:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.366651:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.366655:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.366661:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065140.366668:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 12 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.366687:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.366697:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.366711:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267738240:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065140.366746:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.366758:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 12 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.366766:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6c800, rc 0) 00000100:00100000:1.0:1746065140.366784:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.366786:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:1795:x1830881273068800:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 210us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.366792:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30547 00000100:00100000:0.0:1746065140.370457:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.370484:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267738240:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.370506:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 11 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.370520:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00000100:00100000:1.0:1746065140.370568:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:1791:x1830881273068672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4019us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.370575:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30546 00000100:00100000:3.0:1746065140.370608:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273068928 00000100:00100000:3.0:1746065140.370613:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273068928 00010000:00010000:3.0:1746065140.370638:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.370656:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14518 00000100:00100000:3.0:1746065140.370661:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273068928:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.370669:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.370682:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.370691:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.370707:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8802e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6251 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.370719:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.370720:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.370725:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 10 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.370732:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 10 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.370753:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 10 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.370762:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 10 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.370770:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267738496:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.370804:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.371910:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267738496:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.371920:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.371956:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273068928:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1295us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.371962:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14518 00000100:00100000:0.0:1746065140.372428:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.372469:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273069184 00000100:00100000:2.0:1746065140.372474:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273069184 00002000:00100000:2.0:1746065140.372502:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f086a00 x1830881273069184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.372510:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086a00 with x1830881273069184 ext(0->4095) 00010000:00010000:2.0:1746065140.372516:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 11 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.372527:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 11 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.372532:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f086a00 00000100:00100000:2.0:1746065140.372553:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2972 00000100:00100000:2.0:1746065140.372557:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2005:x1830881273069184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.373022:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2005:x1830881273069184:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 463us (593us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.373027:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2972 00002000:00100000:2.0:1746065140.373032:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f086a00 x1830881273069184/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.373039:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f086a00 with x1830881273069184 ext(0->4095) 00010000:00010000:2.0:1746065140.373043:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 11 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.373052:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 11 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.373057:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f086a00 00000100:00100000:0.0:1746065140.377729:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.377867:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273069312 00000100:00100000:3.0:1746065140.377875:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273069312 00010000:00010000:3.0:1746065140.377903:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 11 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.377945:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14519 00000100:00100000:3.0:1746065140.377953:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2003:x1830881273069312:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.377964:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.377979:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 11 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.377990:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 11 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.378008:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8802e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6258 expref: 11 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.378033:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.378035:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.378041:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 10 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.378047:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 10 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.378072:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 10 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.378103:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267738624:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.378176:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.379825:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.379863:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273069568 00000100:00100000:1.0:1746065140.379867:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273069568 00002000:00100000:1.0:1746065140.379894:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084700 x1830881273069568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.379901:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084700 with x1830881273069568 ext(0->4095) 00002000:00010000:1.0:1746065140.379904:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f084700 00000100:00100000:3.0:1746065140.379934:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267738624:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065140.379937:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13716 00010000:00010000:3.0:1746065140.379945:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.379947:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2005:x1830881273069568:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.379965:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2003:x1830881273069312:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2015us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.379971:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14519 00000100:00100000:1.0:1746065140.380040:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273069568:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 96us (218us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.380046:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13716 00002000:00100000:1.0:1746065140.380051:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084700 x1830881273069568/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.380065:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084700 with x1830881273069568 ext(0->4095) 00002000:00010000:1.0:1746065140.380068:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f084700 00000100:00100000:2.0:1746065140.381319:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.381350:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273069696 00000100:00100000:1.0:1746065140.381353:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273069696 00000100:00100000:1.0:1746065140.381371:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30548 00000100:00100000:1.0:1746065140.381374:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273069696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.381380:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.381390:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6266 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.381405:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 9 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.381409:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.381410:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.381412:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.381426:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 9 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.381433:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 9 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.381439:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267738752:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.381486:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.382471:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267738752:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.382486:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.382500:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd400, rc 0) 00000100:00100000:1.0:1746065140.382530:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273069696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1154us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.382536:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30548 00000100:00100000:0.0:1746065140.382741:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.382873:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273069824 00000100:00100000:3.0:1746065140.382878:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273069824 00010000:00010000:3.0:1746065140.382894:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.382939:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14520 00000100:00100000:3.0:1746065140.382945:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273069824:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.382953:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.382966:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.382976:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.382991:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c800/0x392ae0376f8802ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e625f expref: 10 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.383003:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.383004:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.383009:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.383020:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.383039:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.383047:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267738880:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.383115:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.384521:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267738880:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.384531:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.384551:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273069824:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1606us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.384557:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14520 00000100:00100000:0.0:1746065140.384726:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.384912:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273070080 00000100:00100000:1.0:1746065140.384915:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273070080 00002000:00100000:1.0:1746065140.384952:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084a80 x1830881273070080/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.384961:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084a80 with x1830881273070080 ext(0->4095) 00002000:00010000:1.0:1746065140.384964:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f084a80 00000100:00100000:1.0:1746065140.385051:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13717 00000100:00100000:1.0:1746065140.385057:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273070080:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.385163:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273070080:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 106us (437us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.385168:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13717 00002000:00100000:1.0:1746065140.385173:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f084a80 x1830881273070080/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.385179:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f084a80 with x1830881273070080 ext(0->4095) 00002000:00010000:1.0:1746065140.385182:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f084a80 00000100:00100000:0.0:1746065140.386377:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.386446:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273070208 00000100:00100000:1.0:1746065140.386450:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273070208 00000100:00100000:1.0:1746065140.386473:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30549 00000100:00100000:1.0:1746065140.386478:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1795:x1830881273070208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.386489:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.386654:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e626d expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.386674:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.386681:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.386682:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.386685:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 10 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.386708:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.386718:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 5 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.386728:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267739008:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.386797:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.388244:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267739008:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.388264:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 10 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.388274:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd000, rc 0) 00000100:00100000:1.0:1746065140.388321:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:1795:x1830881273070208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1842us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.388331:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30549 00000100:00100000:2.0:1746065140.388526:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.388603:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273070336 00000100:00100000:3.0:1746065140.388607:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273070336 00010000:00010000:3.0:1746065140.388625:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.388652:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14521 00000100:00100000:3.0:1746065140.388657:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273070336:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.388666:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.388680:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.388690:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.388706:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8802f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6266 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.388715:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.388717:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.388722:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 9 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.388729:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 9 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.388750:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 9 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.388759:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267739136:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.388814:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.390272:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267739136:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.390284:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.390373:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273070336:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1713us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.390381:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14521 00000100:00100000:0.0:1746065140.390423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.390500:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273070592 00000100:00100000:1.0:1746065140.390505:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273070592 00002000:00100000:1.0:1746065140.390528:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1e300 x1830881273070592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.390536:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1e300 with x1830881273070592 ext(0->4095) 00002000:00010000:1.0:1746065140.390540:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1e300 00000100:00100000:1.0:1746065140.390554:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13718 00000100:00100000:1.0:1746065140.390560:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273070592:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.390706:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273070592:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 83us (220us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.390713:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13718 00002000:00100000:1.0:1746065140.390718:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1e300 x1830881273070592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.390725:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1e300 with x1830881273070592 ext(0->4095) 00002000:00010000:1.0:1746065140.390727:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1e300 00000100:00100000:0.0:1746065140.392037:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.392416:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273070720 00000100:00100000:1.0:1746065140.392422:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273070720 00000100:00100000:1.0:1746065140.392549:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30550 00000100:00100000:1.0:1746065140.392557:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273070720:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.392569:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.392582:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6274 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.392609:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 9 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.392621:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.392622:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.392626:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.392649:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 9 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.392707:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 9 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.392718:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267739264:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.392906:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.394286:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267739264:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.394304:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.394315:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00000100:00100000:1.0:1746065140.394465:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273070720:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1908us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.394473:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30550 00000100:00100000:0.0:1746065140.394957:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.395073:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273070848 00000100:00100000:1.0:1746065140.395102:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273070848 00002000:00100000:1.0:1746065140.395130:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072a1f100 x1830881273070848/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.395138:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f100 with x1830881273070848 ext(0->7) 00010000:00010000:1.0:1746065140.395143:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 10 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.395153:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 10 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.395159:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1f100 00000100:00100000:1.0:1746065140.395291:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2973 00000100:00100000:1.0:1746065140.395298:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881273070848:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065140.395918:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2004:x1830881273070848:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 619us (960us total) trans 4294972123 rc 0/0 00000100:00100000:0.0:1746065140.395936:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2973 00002000:00100000:0.0:1746065140.395941:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072a1f100 x1830881273070848/t4294972123(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.395949:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f100 with x1830881273070848 ext(0->7) 00010000:00010000:0.0:1746065140.395954:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.395964:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.395969:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1f100 00000100:00100000:0.0:1746065140.398808:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.399784:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273070976 00000100:00100000:3.0:1746065140.399792:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273070976 00010000:00010000:3.0:1746065140.399820:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.399860:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14522 00000100:00100000:3.0:1746065140.399866:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2004:x1830881273070976:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.399877:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.399893:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.399904:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.399933:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8802fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e626d expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.399956:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.399958:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.399965:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.399972:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.399995:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.400004:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267739392:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.400073:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.403996:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267739392:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.404015:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.404048:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2004:x1830881273070976:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4181us (5243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.404056:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14522 00000100:00100000:0.0:1746065140.405216:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.405335:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.405512:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273071360 00000100:00100000:1.0:1746065140.405519:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273071360 00000100:00100000:1.0:1746065140.405560:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30551 00000100:00100000:1.0:1746065140.405566:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:1791:x1830881273071360:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.405580:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.405597:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e627b expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.405612:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273071232 00000100:00100000:2.0:1746065140.405616:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273071232 00010000:00010000:1.0:1746065140.405619:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.405626:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.405627:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.405630:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065140.405635:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79e680 x1830881273071232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.405642:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79e680 with x1830881273071232 ext(0->4095) 00010000:00010000:2.0:1746065140.405647:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.405651:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.405654:0:27161:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065140.405659:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79e680 00010000:00010000:1.0:1746065140.405661:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.405670:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267739520:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.405683:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2974 00000100:00100000:2.0:1746065140.405688:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273071232:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.405726:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.405784:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273071232:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (447us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.405790:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2974 00002000:00100000:2.0:1746065140.405794:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79e680 x1830881273071232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.405801:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79e680 with x1830881273071232 ext(0->4095) 00010000:00010000:2.0:1746065140.405806:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.405815:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.405820:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79e680 00000100:00100000:1.0:1746065140.406810:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267739520:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.406830:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.406840:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfcc00, rc 0) 00000100:00100000:1.0:1746065140.406859:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:1791:x1830881273071360:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1293us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.406864:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30551 00000100:00100000:0.0:1746065140.407166:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.407269:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273071488 00000100:00100000:1.0:1746065140.407273:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273071488 00000100:00100000:1.0:1746065140.407300:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30552 00000100:00100000:1.0:1746065140.407305:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:1795:x1830881273071488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.407313:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.407320:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6282 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.407331:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.407336:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 13 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.407341:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.407344:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 13 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.407361:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 13 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.407369:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 13 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.407376:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:1.0:1746065140.407403:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:1795:x1830881273071488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 98us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.407407:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30552 00000100:00100000:0.0:1746065140.408147:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.408234:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273071616 00000100:00100000:3.0:1746065140.408238:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273071616 00010000:00010000:3.0:1746065140.408251:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.408270:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14523 00000100:00100000:3.0:1746065140.408274:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273071616:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.408280:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.408290:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.408297:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.408307:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880303 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6274 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.408316:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.408317:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.408321:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.408325:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.408339:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.408345:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.408352:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267739776:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.408587:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.409576:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.409647:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267739776:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.409658:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.409680:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273071616:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1405us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.409687:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14523 00000100:00100000:2.0:1746065140.409741:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273071872 00000100:00100000:2.0:1746065140.409745:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273071872 00002000:00100000:2.0:1746065140.409770:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79d180 x1830881273071872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.409778:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d180 with x1830881273071872 ext(0->4095) 00010000:00010000:2.0:1746065140.409784:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 13 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.409793:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 13 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.409798:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79d180 00000100:00100000:2.0:1746065140.409811:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2975 00000100:00100000:2.0:1746065140.409817:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2005:x1830881273071872:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.410279:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2005:x1830881273071872:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 461us (703us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.410285:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2975 00002000:00100000:2.0:1746065140.410291:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79d180 x1830881273071872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.410298:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d180 with x1830881273071872 ext(0->4095) 00010000:00010000:2.0:1746065140.410303:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 13 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.410311:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 13 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.410316:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79d180 00000100:00100000:0.0:1746065140.411863:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.411911:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273072000 00000100:00100000:3.0:1746065140.411916:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273072000 00010000:00010000:3.0:1746065140.411949:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 13 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.411983:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14524 00000100:00100000:3.0:1746065140.411989:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2004:x1830881273072000:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.411998:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.412013:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 13 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.412022:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 13 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.412038:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88030a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e627b expref: 13 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.412064:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.412065:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.412071:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.412077:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.412115:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.412124:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267739904:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.412179:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.413501:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267739904:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.413515:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.413608:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2004:x1830881273072000:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1618us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.413616:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14524 00000100:00100000:3.0:1746065140.414246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.414315:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273072256 00000100:00100000:2.0:1746065140.414320:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273072256 00002000:00100000:2.0:1746065140.414349:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e889180 x1830881273072256/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.414359:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889180 with x1830881273072256 ext(0->4095) 00002000:00010000:2.0:1746065140.414362:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e889180 00000100:00100000:2.0:1746065140.414391:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13719 00000100:00100000:2.0:1746065140.414397:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881273072256:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.414508:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881273072256:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 111us (263us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.414513:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13719 00002000:00100000:2.0:1746065140.414518:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e889180 x1830881273072256/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.414524:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889180 with x1830881273072256 ext(0->4095) 00002000:00010000:2.0:1746065140.414526:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e889180 00000100:00100000:0.0:1746065140.415569:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.415911:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273072384 00000100:00100000:3.0:1746065140.415916:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273072384 00000100:00100000:3.0:1746065140.416027:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30553 00000100:00100000:3.0:1746065140.416033:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273072384:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.416045:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.416058:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6289 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.416079:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 11 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.416111:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.416113:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.416116:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.416139:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 11 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.416148:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 11 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.416157:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267740032:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.416280:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.417388:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267740032:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.417406:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.417417:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065140.417443:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273072384:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1410us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.417452:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30553 00000100:00100000:0.0:1746065140.417556:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.417614:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273072512 00000100:00100000:3.0:1746065140.417618:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273072512 00010000:00010000:3.0:1746065140.417636:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.417664:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14525 00000100:00100000:3.0:1746065140.417670:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2004:x1830881273072512:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.417679:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.417694:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.417791:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.417807:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f880311 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6282 expref: 12 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.417829:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.417831:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.417836:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.417843:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.417863:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.417873:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267740160:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.418365:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.419374:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267740160:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.419384:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.419651:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2004:x1830881273072512:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1979us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.419658:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14525 00000100:00100000:0.0:1746065140.419824:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.419889:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273072768 00000100:00100000:3.0:1746065140.419893:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273072768 00002000:00100000:3.0:1746065140.419929:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79ed80 x1830881273072768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.419937:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ed80 with x1830881273072768 ext(0->4095) 00002000:00010000:3.0:1746065140.419941:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79ed80 00000100:00100000:3.0:1746065140.419965:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13720 00000100:00100000:3.0:1746065140.420020:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273072768:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.420386:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273072768:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 414us (561us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.420391:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13720 00002000:00100000:3.0:1746065140.420396:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79ed80 x1830881273072768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.420403:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ed80 with x1830881273072768 ext(0->4095) 00002000:00010000:3.0:1746065140.420406:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79ed80 00000100:00100000:0.0:1746065140.421726:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.421810:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273072896 00000100:00100000:3.0:1746065140.421814:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273072896 00000100:00100000:3.0:1746065140.421845:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30554 00000100:00100000:3.0:1746065140.421850:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:1795:x1830881273072896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.421859:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.421870:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6290 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.421888:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.421892:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.421893:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.421895:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 12 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.421913:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.421919:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.421940:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267740288:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.422134:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.422592:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267740288:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.422607:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 12 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.422622:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065140.422644:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:1795:x1830881273072896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 792us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.422649:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30554 00000100:00100000:0.0:1746065140.423244:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.423316:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273073024 00000100:00100000:3.0:1746065140.423320:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273073024 00010000:00010000:3.0:1746065140.423338:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.423368:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14526 00000100:00100000:3.0:1746065140.423374:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273073024:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.423382:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.423398:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.423407:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.423424:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880318 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6289 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.423448:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.423450:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.423456:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 11 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.423467:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 11 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.423488:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 11 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.423497:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267740416:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.423548:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.425700:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267740416:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.425715:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.425748:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273073024:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2374us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.425756:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14526 00000100:00100000:0.0:1746065140.426339:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.426378:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273073280 00000100:00100000:3.0:1746065140.426383:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273073280 00002000:00100000:3.0:1746065140.426410:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8ad80 x1830881273073280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.426418:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8ad80 with x1830881273073280 ext(0->4095) 00002000:00010000:3.0:1746065140.426421:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8ad80 00000100:00100000:3.0:1746065140.426443:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13721 00000100:00100000:3.0:1746065140.426448:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881273073280:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.426525:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881273073280:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 77us (188us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.426531:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13721 00002000:00100000:3.0:1746065140.426534:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8ad80 x1830881273073280/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.426538:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8ad80 with x1830881273073280 ext(0->4095) 00002000:00010000:3.0:1746065140.426540:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8ad80 00000100:00100000:0.0:1746065140.428650:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.428744:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273073408 00000100:00100000:3.0:1746065140.428751:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273073408 00000100:00100000:3.0:1746065140.428978:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30555 00000100:00100000:3.0:1746065140.428986:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273073408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.428999:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.429014:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6297 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.429038:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 11 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.429045:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.429047:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.429050:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.429074:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 11 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.429114:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 11 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.429130:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267740544:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.430304:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.432151:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267740544:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.432173:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.432198:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065140.432242:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273073408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3256us (3598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.432248:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30555 00000100:00100000:0.0:1746065140.432499:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.432939:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273073536 00000100:00100000:3.0:1746065140.432945:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273073536 00002000:00100000:3.0:1746065140.432971:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880124b88e00 x1830881273073536/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.432978:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88e00 with x1830881273073536 ext(0->7) 00010000:00010000:3.0:1746065140.432983:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 12 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.432993:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 12 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.432998:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b88e00 00000100:00100000:3.0:1746065140.433021:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2976 00000100:00100000:3.0:1746065140.433026:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2005:x1830881273073536:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065140.434677:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2005:x1830881273073536:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1644us (2173us total) trans 4294972124 rc 0/0 00000100:00100000:0.0:1746065140.434685:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2976 00002000:00100000:0.0:1746065140.434692:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880124b88e00 x1830881273073536/t4294972124(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.434700:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b88e00 with x1830881273073536 ext(0->7) 00010000:00010000:0.0:1746065140.434707:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 14 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.434719:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 14 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.434725:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b88e00 00000100:00100000:0.0:1746065140.440739:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.440859:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273073664 00000100:00100000:0.0:1746065140.440865:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.440867:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273073664 00010000:00010000:3.0:1746065140.440897:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 14 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.440944:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14527 00000100:00100000:3.0:1746065140.440951:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2003:x1830881273073664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065140.440961:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273073792 00010000:00010000:3.0:1746065140.440963:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065140.440965:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273073792 00010000:00010000:3.0:1746065140.440979:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 15 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.440984:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30556 00000100:00100000:2.0:1746065140.440988:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:1791:x1830881273073792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.440990:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 15 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.441000:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.441006:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88031f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6290 expref: 15 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.441009:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e629e expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.441020:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.441022:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.442152:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.442161:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.442173:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.442178:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.442180:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.442182:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 15 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.449047:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.449071:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.449371:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267740672:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065140.449371:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.449379:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.449385:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267740800:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.450230:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.450280:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.452619:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267740800:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.452645:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 15 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.452659:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:1.0:1746065140.452706:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:1791:x1830881273073792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 11717us (11840us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.452713:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30556 00000100:00100000:0.0:1746065140.453804:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.453819:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267740672:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.453830:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.453856:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273074048 00000100:00100000:3.0:1746065140.453859:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2003:x1830881273073664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 12909us (13128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.453862:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273074048 00000100:00100000:3.0:1746065140.453866:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14527 00002000:00100000:1.0:1746065140.453891:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0700 x1830881273074048/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.453900:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0700 with x1830881273074048 ext(0->4095) 00010000:00010000:1.0:1746065140.453906:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.453918:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.453938:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a0700 00000100:00100000:1.0:1746065140.453965:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2977 00000100:00100000:1.0:1746065140.453971:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273074048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.454109:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273074048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 137us (307us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.454115:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2977 00002000:00100000:1.0:1746065140.454120:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0700 x1830881273074048/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.454133:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0700 with x1830881273074048 ext(0->4095) 00010000:00010000:1.0:1746065140.454137:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.454146:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.454151:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a0700 00000100:00100000:0.0:1746065140.456959:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.457016:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273074176 00000100:00100000:3.0:1746065140.457023:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273074176 00010000:00010000:3.0:1746065140.457052:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.457240:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14528 00000100:00100000:3.0:1746065140.457248:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273074176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.457259:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.457273:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.457283:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.457299:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880326 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6297 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.457318:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.457320:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.457325:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 13 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.457332:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 13 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.457354:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 13 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.457363:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267740928:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.457961:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.458662:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267740928:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.458672:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.458689:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273074176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1443us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.458694:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14528 00000100:00100000:0.0:1746065140.459499:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.459566:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273074432 00000100:00100000:1.0:1746065140.459572:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273074432 00002000:00100000:1.0:1746065140.459602:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a1f80 x1830881273074432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.459611:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1f80 with x1830881273074432 ext(0->4095) 00002000:00010000:1.0:1746065140.459615:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a1f80 00000100:00100000:1.0:1746065140.459644:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13722 00000100:00100000:1.0:1746065140.459651:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2005:x1830881273074432:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.459747:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2005:x1830881273074432:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 96us (249us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.459753:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13722 00002000:00100000:1.0:1746065140.459758:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a1f80 x1830881273074432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.459765:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1f80 with x1830881273074432 ext(0->4095) 00002000:00010000:1.0:1746065140.459767:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a1f80 00000100:00100000:0.0:1746065140.461378:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.461614:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273074560 00000100:00100000:1.0:1746065140.461620:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273074560 00000100:00100000:1.0:1746065140.462061:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30557 00000100:00100000:1.0:1746065140.462068:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273074560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.462100:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.462114:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62a5 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.462137:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 13 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.462142:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.462143:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.462146:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.462168:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 13 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.462178:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 13 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.462187:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267741056:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.462460:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.468698:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267741056:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.468726:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.468742:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc600, rc 0) 00000100:00100000:1.0:1746065140.468791:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273074560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6722us (7415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.468798:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30557 00000100:00100000:0.0:1746065140.471704:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.473006:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273074688 00000100:00100000:1.0:1746065140.473015:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273074688 00002000:00100000:1.0:1746065140.473047:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d5a1500 x1830881273074688/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.473055:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1500 with x1830881273074688 ext(0->7) 00010000:00010000:1.0:1746065140.473063:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 14 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.473074:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 14 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.473104:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a1500 00000100:00100000:1.0:1746065140.473130:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2978 00000100:00100000:1.0:1746065140.473136:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2005:x1830881273074688:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065140.476052:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273074688:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2908us (4346us total) trans 4294972125 rc 0/0 00000100:00100000:0.0:1746065140.476062:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2978 00002000:00100000:0.0:1746065140.476069:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d5a1500 x1830881273074688/t4294972125(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.476078:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a1500 with x1830881273074688 ext(0->7) 00010000:00010000:0.0:1746065140.476099:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 16 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.476112:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 16 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.476118:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a1500 00000100:00100000:0.0:1746065140.481285:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.481334:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.481428:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273074816 00000100:00100000:1.0:1746065140.481436:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273074816 00000100:00100000:1.0:1746065140.481482:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30558 00000100:00100000:1.0:1746065140.481489:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:1791:x1830881273074816:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.481503:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.481519:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62ac expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.481540:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.481545:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.481551:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065140.481553:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 17 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.481581:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.481591:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 17 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.481598:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd200, rc 0) 00000100:00100000:1.0:1746065140.481634:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:1791:x1830881273074816:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.481640:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30558 00000100:00100000:3.0:1746065140.481815:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273074944 00000100:00100000:3.0:1746065140.481820:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273074944 00010000:00010000:3.0:1746065140.481837:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 17 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.481856:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14529 00000100:00100000:3.0:1746065140.481861:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2002:x1830881273074944:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.481871:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.481886:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 17 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.481896:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 17 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.481910:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88032d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e629e expref: 17 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.482160:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.482162:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.482167:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.482174:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.482193:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.482203:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.482213:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267741312:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.482750:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.483961:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.483990:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267741312:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.484004:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.484028:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273074944:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2168us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.484036:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14529 00000100:00100000:1.0:1746065140.484117:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273075200 00000100:00100000:1.0:1746065140.484122:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273075200 00002000:00100000:1.0:1746065140.484146:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a3800 x1830881273075200/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.484154:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3800 with x1830881273075200 ext(0->4095) 00010000:00010000:1.0:1746065140.484160:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.484169:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.484178:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a3800 00000100:00100000:1.0:1746065140.484201:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2979 00000100:00100000:1.0:1746065140.484207:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273075200:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.484291:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273075200:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 84us (334us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.484296:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2979 00002000:00100000:1.0:1746065140.484300:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a3800 x1830881273075200/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.484307:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3800 with x1830881273075200 ext(0->4095) 00010000:00010000:1.0:1746065140.484311:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.484318:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.484323:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a3800 00000100:00100000:0.0:1746065140.485638:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.485684:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.485729:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273075328 00000100:00100000:3.0:1746065140.485735:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273075328 00010000:00010000:3.0:1746065140.485756:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.485756:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273075456 00000100:00100000:1.0:1746065140.485760:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273075456 00000100:00100000:3.0:1746065140.485777:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14530 00000100:00100000:3.0:1746065140.485782:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273075328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065140.485783:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30559 00000100:00100000:1.0:1746065140.485788:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1795:x1830881273075456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.485791:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065140.485797:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.485804:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 7 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.485808:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62b3 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.485814:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 7 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.485830:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f880334 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62a5 expref: 8 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.485834:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.485839:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 15 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.485844:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.485847:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 7 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.485853:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.485855:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.485860:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 15 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.485867:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 15 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.485937:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 15 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.485947:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 15 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.485956:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 15 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.485958:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267741440:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.485964:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 15 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.485972:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267741568:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065140.486010:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.486067:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.487587:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.487663:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267741440:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.487682:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 7 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.487694:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfda00, rc 0) 00000100:00100000:1.0:1746065140.487720:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1795:x1830881273075456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1932us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.487727:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30559 00000100:00100000:1.0:1746065140.487752:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273075712 00000100:00100000:1.0:1746065140.487756:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273075712 00002000:00100000:1.0:1746065140.487777:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1c380 x1830881273075712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.487785:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1c380 with x1830881273075712 ext(0->4095) 00010000:00010000:1.0:1746065140.487790:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 16 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.487798:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 16 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.487803:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1c380 00000100:00100000:1.0:1746065140.487830:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2980 00000100:00100000:1.0:1746065140.487835:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273075712:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.487915:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273075712:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 80us (332us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.487933:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2980 00002000:00100000:1.0:1746065140.487938:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1c380 x1830881273075712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.487945:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1c380 with x1830881273075712 ext(0->4095) 00010000:00010000:1.0:1746065140.487949:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 16 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.487957:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 16 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.487963:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1c380 00000100:00100000:3.0:1746065140.488112:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267741568:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.488120:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.488141:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273075328:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2359us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.488148:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14530 00000100:00100000:0.0:1746065140.490451:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.490716:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273075840 00000100:00100000:3.0:1746065140.490722:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273075840 00010000:00010000:3.0:1746065140.490746:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 16 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.490780:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14531 00000100:00100000:3.0:1746065140.490786:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273075840:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.490796:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.490811:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 16 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065140.490834:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.490871:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273075968 00000100:00100000:1.0:1746065140.490875:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273075968 00000100:00100000:1.0:1746065140.490898:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30560 00000100:00100000:1.0:1746065140.490903:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:1791:x1830881273075968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.490914:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.490931:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 17 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.490935:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62ba expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.490947:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f88033b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ac expref: 18 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.490950:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.490955:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.490960:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.490963:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 17 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.490989:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.490999:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 17 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.491007:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.491008:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.491014:0:21550:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.491020:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.491039:0:21550:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.491048:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 5 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.491058:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267741824:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065140.491131:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77180 going to sleep for 11 seconds 00010000:00010000:3.0:1746065140.491609:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.491886:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881273075840:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1096us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.491894:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14531 00000100:00100000:1.0:1746065140.494031:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267741824:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065140.494043:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065140.494047:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfca00, rc 0) 00000100:00100000:1.0:1746065140.494107:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:1791:x1830881273075968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3203us (3271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.494115:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30560 00000100:00100000:2.0:1746065140.494395:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273076224 00000100:00100000:2.0:1746065140.494401:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273076224 00002000:00100000:2.0:1746065140.494437:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1d880 x1830881273076224/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.494466:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1d880 with x1830881273076224 ext(0->4095) 00010000:00010000:2.0:1746065140.494476:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.494488:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.494494:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1d880 00000100:00100000:2.0:1746065140.494518:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2981 00000100:00100000:2.0:1746065140.494525:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273076224:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.494636:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273076224:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 111us (594us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.494642:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2981 00002000:00100000:2.0:1746065140.494647:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1d880 x1830881273076224/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.494654:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1d880 with x1830881273076224 ext(0->4095) 00010000:00010000:2.0:1746065140.494659:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.494668:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.494678:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1d880 00000100:00100000:0.0:1746065140.497737:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.497817:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273076352 00000100:00100000:3.0:1746065140.497825:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273076352 00010000:00010000:3.0:1746065140.497854:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.497892:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14532 00000100:00100000:3.0:1746065140.497898:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273076352:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.497910:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.497933:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.497945:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.497964:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880342 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62b3 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.497993:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.497995:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.498001:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 15 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.498007:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 15 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.498032:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 15 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.498041:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267741952:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.498140:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.501664:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.501739:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273076608 00000100:00100000:1.0:1746065140.501747:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273076608 00002000:00100000:1.0:1746065140.501782:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1c700 x1830881273076608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.501791:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1c700 with x1830881273076608 ext(0->4095) 00002000:00010000:1.0:1746065140.501795:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1c700 00000100:00100000:1.0:1746065140.501826:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13723 00000100:00100000:1.0:1746065140.501833:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273076608:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065140.501862:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267741952:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.501877:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.502330:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273076352:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4429us (4598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.502338:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14532 00000100:00100000:1.0:1746065140.502587:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273076608:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 754us (930us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.502596:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13723 00002000:00100000:1.0:1746065140.502601:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1c700 x1830881273076608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.502608:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1c700 with x1830881273076608 ext(0->4095) 00002000:00010000:1.0:1746065140.502611:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1c700 00000100:00100000:0.0:1746065140.508238:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.508307:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273076736 00000100:00100000:1.0:1746065140.508315:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273076736 00000100:00100000:1.0:1746065140.508365:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30561 00000100:00100000:1.0:1746065140.508372:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273076736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.508387:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.508402:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62c1 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.508425:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 15 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.508432:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.508434:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.508437:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.508461:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 15 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.508471:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 15 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.508485:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267742080:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.508572:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.510216:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267742080:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.510240:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.510255:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:1.0:1746065140.510302:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273076736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1930us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.510309:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30561 00000100:00100000:0.0:1746065140.514833:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.515646:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273076864 00000100:00100000:1.0:1746065140.515655:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273076864 00002000:00100000:1.0:1746065140.515695:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009eb1f480 x1830881273076864/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.515705:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f480 with x1830881273076864 ext(0->7) 00010000:00010000:1.0:1746065140.515714:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 16 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.515727:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 16 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.515733:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1f480 00000100:00100000:1.0:1746065140.516983:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2982 00000100:00100000:1.0:1746065140.516993:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273076864:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065140.518790:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2004:x1830881273076864:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1796us (3962us total) trans 4294972126 rc 0/0 00000100:00100000:0.0:1746065140.518798:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2982 00002000:00100000:0.0:1746065140.518806:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009eb1f480 x1830881273076864/t4294972126(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.518814:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f480 with x1830881273076864 ext(0->7) 00010000:00010000:0.0:1746065140.518821:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 18 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.518834:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 18 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.518840:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1f480 00000100:00100000:0.0:1746065140.526183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.526563:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273076992 00000100:00100000:1.0:1746065140.526572:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273076992 00000100:00100000:1.0:1746065140.526621:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30562 00000100:00100000:1.0:1746065140.526629:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:1791:x1830881273076992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.526644:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.526659:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62c8 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.526680:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.526685:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.526691:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065140.526695:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 19 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.526722:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.526732:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 19 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.526741:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc400, rc 0) 00000100:00100000:1.0:1746065140.526792:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:1791:x1830881273076992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 163us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.526798:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30562 00000100:00100000:2.0:1746065140.527636:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.527846:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273077120 00000100:00100000:0.0:1746065140.527850:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273077120 00010000:00010000:0.0:1746065140.527870:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 19 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065140.527897:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14533 00000100:00100000:0.0:1746065140.527902:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2003:x1830881273077120:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065140.527909:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065140.527934:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 19 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.527944:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 19 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.527959:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f880349 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62ba expref: 19 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.528116:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.528118:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.528125:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.528131:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.528153:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.528161:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 5 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065140.528170:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267742336:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065140.528231:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.532281:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267742336:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065140.532298:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065140.532477:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2003:x1830881273077120:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4573us (4840us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.532486:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14533 00000100:00100000:2.0:1746065140.532867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.532930:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273077376 00000100:00100000:0.0:1746065140.532936:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273077376 00002000:00100000:0.0:1746065140.532966:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a3480 x1830881273077376/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.532974:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a3480 with x1830881273077376 ext(0->4095) 00010000:00010000:0.0:1746065140.532981:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.532992:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.532998:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a3480 00000100:00100000:0.0:1746065140.533010:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2983 00000100:00100000:0.0:1746065140.533015:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273077376:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065140.533150:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273077376:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 134us (283us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065140.533156:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2983 00002000:00100000:0.0:1746065140.533160:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a3480 x1830881273077376/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.533166:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a3480 with x1830881273077376 ext(0->4095) 00010000:00010000:0.0:1746065140.533170:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.533179:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.533184:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a3480 00000100:00100000:0.0:1746065140.535141:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.537426:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273077504 00000100:00100000:2.0:1746065140.537441:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273077504 00010000:00010000:2.0:1746065140.537474:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.537512:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14534 00000100:00100000:2.0:1746065140.537519:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273077504:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.537530:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.537544:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.537555:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.537578:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880350 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c1 expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.537804:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.537807:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.537813:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 17 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.537821:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 17 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.537849:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 17 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.537859:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267742464:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.538162:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.541369:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267742464:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.541387:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.541429:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273077504:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3910us (6292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.541438:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14534 00000100:00100000:0.0:1746065140.541809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.541897:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273077760 00000100:00100000:2.0:1746065140.541904:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273077760 00002000:00100000:2.0:1746065140.541945:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1fb80 x1830881273077760/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.541960:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1fb80 with x1830881273077760 ext(0->4095) 00002000:00010000:2.0:1746065140.541964:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1fb80 00000100:00100000:2.0:1746065140.541990:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13724 00000100:00100000:2.0:1746065140.541997:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273077760:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.542114:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273077760:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 117us (305us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.542119:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13724 00002000:00100000:2.0:1746065140.542124:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1fb80 x1830881273077760/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.542130:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1fb80 with x1830881273077760 ext(0->4095) 00002000:00010000:2.0:1746065140.542132:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1fb80 00000100:00100000:0.0:1746065140.543373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.543432:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273077888 00000100:00100000:1.0:1746065140.543436:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273077888 00000100:00100000:1.0:1746065140.543456:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30563 00000100:00100000:1.0:1746065140.543460:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273077888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.543467:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.543478:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62cf expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.543495:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 17 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.543499:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.543501:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.543503:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.543521:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 17 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.543527:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 17 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.543535:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267742592:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.543784:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.544677:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267742592:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.544693:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.544708:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfdc00, rc 0) 00000100:00100000:1.0:1746065140.544731:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273077888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1270us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.544736:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30563 00000100:00100000:0.0:1746065140.547135:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.547189:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273078016 00000100:00100000:2.0:1746065140.547197:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273078016 00010000:00010000:2.0:1746065140.547223:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 18 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.547330:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14535 00000100:00100000:1.0:1746065140.547395:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2004:x1830881273078016:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065140.547406:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065140.547423:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 18 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.547434:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 18 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.547452:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc400/0x392ae0376f880357 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62c8 expref: 18 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.547670:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.547672:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.547679:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.547691:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.547716:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065140.547787:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267742720:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065140.548065:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.550704:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267742720:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065140.550721:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.550755:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2004:x1830881273078016:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3417us (3625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.550763:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14535 00000100:00100000:0.0:1746065140.550821:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.551161:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273078272 00000100:00100000:1.0:1746065140.551166:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273078272 00002000:00100000:1.0:1746065140.551196:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f800 x1830881273078272/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.551205:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f800 with x1830881273078272 ext(0->4095) 00002000:00010000:1.0:1746065140.551210:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1f800 00000100:00100000:1.0:1746065140.551224:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13725 00000100:00100000:1.0:1746065140.551229:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273078272:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.551327:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273078272:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 97us (506us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.551333:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13725 00002000:00100000:1.0:1746065140.551338:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f800 x1830881273078272/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.551345:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f800 with x1830881273078272 ext(0->4095) 00002000:00010000:1.0:1746065140.551347:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1f800 00000100:00100000:0.0:1746065140.552827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.552866:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.552974:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273078400 00000100:00100000:2.0:1746065140.552980:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273078400 00000100:00100000:2.0:1746065140.553003:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273078528 00000100:00100000:2.0:1746065140.553005:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273078528 00000100:00100000:2.0:1746065140.553029:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30564 00000100:00100000:2.0:1746065140.553035:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:1791:x1830881273078400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.553049:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.553062:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62d6 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.553105:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.553112:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.553113:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.553116:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.553138:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.553147:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 5 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.553156:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267742848:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.553207:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.553328:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30565 00000100:00100000:1.0:1746065140.553335:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:1795:x1830881273078528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.553341:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.553346:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62dd expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.553357:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.553448:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 20 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.553454:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.553457:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 20 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.553476:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 20 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.553485:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 20 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.553493:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:1.0:1746065140.553517:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:1795:x1830881273078528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 183us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.553521:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30565 00000100:00100000:2.0:1746065140.555442:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267742848:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.555460:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.555470:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065140.555507:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:1791:x1830881273078400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2471us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.555513:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30564 00000100:00100000:0.0:1746065140.555724:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.555796:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273078656 00000100:00100000:2.0:1746065140.555801:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273078656 00010000:00010000:2.0:1746065140.555819:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.555850:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14536 00000100:00100000:2.0:1746065140.555856:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273078656:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.555865:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.555881:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.555891:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.555957:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfdc00/0x392ae0376f88035e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62cf expref: 6 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.555974:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.555978:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.555984:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 18 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.555991:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 18 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.556012:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 18 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.556021:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 18 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.556031:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267743104:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.556094:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.558053:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.558118:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267743104:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.558129:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.558164:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273078656:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2308us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.558170:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14536 00000100:00100000:3.0:1746065140.558498:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273078912 00000100:00100000:3.0:1746065140.558503:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273078912 00002000:00100000:3.0:1746065140.558533:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549df80 x1830881273078912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.558542:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549df80 with x1830881273078912 ext(0->4095) 00010000:00010000:3.0:1746065140.558548:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 19 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.558564:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 19 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.558570:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549df80 00000100:00100000:3.0:1746065140.558590:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2984 00000100:00100000:3.0:1746065140.558596:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2005:x1830881273078912:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.559457:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2005:x1830881273078912:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 860us (1407us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.559464:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2984 00002000:00100000:3.0:1746065140.559469:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549df80 x1830881273078912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.560222:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549df80 with x1830881273078912 ext(0->4095) 00010000:00010000:3.0:1746065140.560229:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 19 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.560240:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 19 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.560245:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549df80 00000100:00100000:0.0:1746065140.564862:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.565037:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273079040 00000100:00100000:2.0:1746065140.565045:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273079040 00010000:00010000:2.0:1746065140.565072:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 19 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.565344:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14537 00000100:00100000:2.0:1746065140.565351:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2002:x1830881273079040:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.565361:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.565375:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 19 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.565385:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 19 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.565405:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880365 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62d6 expref: 19 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.565438:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.565441:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.565447:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 18 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.565454:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 18 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.565479:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 18 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.566057:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267743232:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.566140:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.569064:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267743232:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.569102:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.569137:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2002:x1830881273079040:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3785us (4281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.569146:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14537 00000100:00100000:0.0:1746065140.569315:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.569464:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273079296 00000100:00100000:3.0:1746065140.569470:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273079296 00002000:00100000:3.0:1746065140.569500:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ea00 x1830881273079296/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.569508:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ea00 with x1830881273079296 ext(0->4095) 00002000:00010000:3.0:1746065140.569513:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549ea00 00000100:00100000:3.0:1746065140.569528:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13726 00000100:00100000:3.0:1746065140.569534:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2003:x1830881273079296:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746065140.569627:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2003:x1830881273079296:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 93us (314us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.569633:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13726 00002000:00100000:3.0:1746065140.569637:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ea00 x1830881273079296/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.569644:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ea00 with x1830881273079296 ext(0->4095) 00002000:00010000:3.0:1746065140.569647:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549ea00 00000100:00100000:0.0:1746065140.574409:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.574977:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273079424 00000100:00100000:2.0:1746065140.574985:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273079424 00000100:00100000:2.0:1746065140.575037:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30566 00000100:00100000:2.0:1746065140.575044:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273079424:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.575059:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.575073:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62e4 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.575122:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 17 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.575133:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.575135:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.575137:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.575161:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 17 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.575170:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 17 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.575179:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267743360:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.576939:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.577076:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267743360:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.577294:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.577305:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064000, rc 0) 00000100:00100000:2.0:1746065140.577346:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273079424:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2302us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.577354:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30566 00000100:00100000:0.0:1746065140.578136:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.578180:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273079552 00000100:00100000:3.0:1746065140.578186:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273079552 00010000:00010000:3.0:1746065140.578209:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 18 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.578227:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14538 00000100:00100000:3.0:1746065140.578232:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273079552:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.578241:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.578257:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 18 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.578266:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 18 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.578283:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88036c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62dd expref: 18 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.578298:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.578299:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.578305:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.578312:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.578335:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.578344:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267743488:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.578396:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.580224:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.580535:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273079680 00000100:00100000:2.0:1746065140.580541:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273079680 00000100:00100000:2.0:1746065140.580580:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30567 00000100:00100000:2.0:1746065140.580586:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:1791:x1830881273079680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.580601:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.580612:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62eb expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.580631:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.580637:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.580639:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.580641:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.580661:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.580669:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.580678:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267743616:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.580739:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.582212:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267743488:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.582229:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.582269:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2005:x1830881273079552:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4035us (4134us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.582278:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14538 00000100:00100000:1.0:1746065140.582518:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.582634:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267743616:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.582648:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 18 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.582660:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:3.0:1746065140.582683:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:1791:x1830881273079680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2097us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.582692:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30567 00000100:00100000:0.0:1746065140.582818:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273079936 00000100:00100000:0.0:1746065140.582824:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273079936 00002000:00100000:0.0:1746065140.582853:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5180 x1830881273079936/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.582862:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5180 with x1830881273079936 ext(0->4095) 00010000:00010000:0.0:1746065140.582868:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.582879:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.582884:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5180 00000100:00100000:0.0:1746065140.582898:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2985 00000100:00100000:0.0:1746065140.582904:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273079936:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065140.583020:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273079936:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 116us (503us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065140.583026:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2985 00002000:00100000:0.0:1746065140.583031:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff5180 x1830881273079936/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.583039:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5180 with x1830881273079936 ext(0->4095) 00010000:00010000:0.0:1746065140.583043:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.583052:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.583057:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5180 00000100:00100000:2.0:1746065140.586451:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.586473:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273080064 00000100:00100000:3.0:1746065140.586482:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273080064 00010000:00010000:3.0:1746065140.586510:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.586532:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14539 00000100:00100000:3.0:1746065140.586649:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273080064:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.586663:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.586680:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.586691:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.586709:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880373 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62e4 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.586734:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.586736:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.586742:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 17 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.586749:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 17 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.586776:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 17 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.586796:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267743744:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.587024:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.587192:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.587206:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273080192 00000100:00100000:3.0:1746065140.587210:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273080192 00000100:00100000:3.0:1746065140.587234:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30568 00000100:00100000:3.0:1746065140.587239:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273080192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.587249:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.587258:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62f2 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.587271:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 17 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.587275:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.587276:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.587278:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 7 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.587292:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 17 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.587302:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 17 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.587309:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267743872:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.587328:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.590106:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.590150:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273080448 00000100:00100000:2.0:1746065140.590157:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273080448 00002000:00100000:2.0:1746065140.590190:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ed80 x1830881273080448/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.590200:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ed80 with x1830881273080448 ext(0->4095) 00010000:00010000:2.0:1746065140.590208:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 18 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.590220:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 18 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.590226:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ed80 00000100:00100000:3.0:1746065140.590258:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267743744:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.590272:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.590311:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273080064:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3772us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.590319:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14539 00000100:00100000:2.0:1746065140.590450:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2986 00000100:00100000:2.0:1746065140.590457:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273080448:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.590495:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267743872:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.590508:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.590520:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065140.591553:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273080192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4311us (4527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.591559:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273080448:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 1102us (1458us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.591560:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30568 00000100:00100000:2.0:1746065140.591565:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2986 00002000:00100000:2.0:1746065140.591571:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ed80 x1830881273080448/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.591578:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ed80 with x1830881273080448 ext(0->4095) 00010000:00010000:2.0:1746065140.591583:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 18 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.591592:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 18 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.591597:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ed80 00000100:00100000:0.0:1746065140.594551:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.595343:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.595406:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273080704 00000100:00100000:2.0:1746065140.595414:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273080704 00010000:00010000:2.0:1746065140.595441:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 18 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.595469:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14540 00000100:00100000:2.0:1746065140.595682:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2004:x1830881273080704:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.595694:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.595709:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 18 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.595721:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 18 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.595739:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88037a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62eb expref: 18 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.595760:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.595762:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.595768:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.595775:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.595821:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.595831:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267744000:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.595897:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.596307:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273080576 00000100:00100000:3.0:1746065140.596311:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273080576 00000100:00100000:3.0:1746065140.596330:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30569 00000100:00100000:3.0:1746065140.596335:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:1791:x1830881273080576:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.596347:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.596356:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e62f9 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.596371:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.596378:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.596379:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.596382:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.596397:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.596407:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 5 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.596415:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267744128:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.597906:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.598246:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267744000:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.598260:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.598295:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2004:x1830881273080704:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2617us (2951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.598302:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14540 00000100:00100000:0.0:1746065140.598760:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.599035:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273080960 00000100:00100000:2.0:1746065140.599040:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273080960 00002000:00100000:2.0:1746065140.599069:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549f480 x1830881273080960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.599078:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549f480 with x1830881273080960 ext(0->4095) 00010000:00010000:2.0:1746065140.599111:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.599121:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.599127:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549f480 00000100:00100000:2.0:1746065140.599151:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2987 00000100:00100000:2.0:1746065140.599157:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273080960:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.599261:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273080960:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 104us (501us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.599266:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2987 00002000:00100000:2.0:1746065140.599272:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549f480 x1830881273080960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.599277:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549f480 with x1830881273080960 ext(0->4095) 00010000:00010000:2.0:1746065140.599282:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.599290:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.599295:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549f480 00000100:00100000:3.0:1746065140.600696:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267744128:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.600715:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 18 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.600729:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:3.0:1746065140.600764:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:1791:x1830881273080576:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4429us (6220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.600771:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30569 00000100:00100000:0.0:1746065140.603353:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.604048:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.604121:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273081216 00000100:00100000:2.0:1746065140.604128:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273081216 00010000:00010000:2.0:1746065140.604154:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.604174:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14541 00000100:00100000:2.0:1746065140.604180:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273081216:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.604189:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.604203:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.604212:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.604227:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880381 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f2 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.604990:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.604994:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.605003:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 17 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.605016:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 17 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.605017:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273081088 00000100:00100000:3.0:1746065140.605022:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273081088 00010000:00010000:2.0:1746065140.605045:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 18 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.605057:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267744256:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.605439:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30570 00000100:00100000:3.0:1746065140.605450:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:1795:x1830881273081088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.605462:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.605471:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6300 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.605486:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.605491:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.605492:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.605495:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.605508:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.605516:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 19 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.605523:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267744384:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.605573:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.605844:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.609536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.609636:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267744256:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.609651:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.609682:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267744384:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.609685:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273081216:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5504us (5637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.609694:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14541 00010000:00010000:3.0:1746065140.609701:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.609902:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065140.609940:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:1795:x1830881273081088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4490us (6860us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.609946:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30570 00000100:00100000:2.0:1746065140.610068:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273081344 00000100:00100000:2.0:1746065140.610074:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273081344 00010000:00010000:2.0:1746065140.610111:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 19 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.610130:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14542 00000100:00100000:2.0:1746065140.610136:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2004:x1830881273081344:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.610145:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.610161:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 19 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.610171:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 19 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.610189:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880388 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e62f9 expref: 19 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.610207:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.610208:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.610214:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 18 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.610221:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 18 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.610243:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 18 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.610253:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267744512:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.610288:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.611631:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267744512:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.611643:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.611663:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2004:x1830881273081344:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1528us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.611670:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14542 00000100:00100000:0.0:1746065140.612034:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.612141:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273081600 00000100:00100000:1.0:1746065140.612146:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273081600 00002000:00100000:1.0:1746065140.612171:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549d500 x1830881273081600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.612180:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d500 with x1830881273081600 ext(0->4095) 00002000:00010000:1.0:1746065140.612184:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549d500 00000100:00100000:1.0:1746065140.612204:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13727 00000100:00100000:1.0:1746065140.612208:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273081600:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.612283:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273081600:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 75us (250us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.612289:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13727 00002000:00100000:1.0:1746065140.612293:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549d500 x1830881273081600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.612300:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d500 with x1830881273081600 ext(0->4095) 00002000:00010000:1.0:1746065140.612302:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549d500 00000100:00100000:0.0:1746065140.617433:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.617491:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273081728 00000100:00100000:3.0:1746065140.617499:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273081728 00000100:00100000:3.0:1746065140.617530:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30571 00000100:00100000:3.0:1746065140.617536:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273081728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.617552:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.617565:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6307 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.617587:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 17 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.617593:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.617595:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.617598:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.617619:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 17 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.617628:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 17 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.617638:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267744640:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.619245:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.620769:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267744640:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.620795:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.620811:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065140.620847:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273081728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3309us (3420us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.620858:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30571 00000100:00100000:0.0:1746065140.621471:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.621568:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273081856 00000100:00100000:2.0:1746065140.621574:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273081856 00002000:00100000:2.0:1746065140.621605:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009549ca80 x1830881273081856/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.621619:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ca80 with x1830881273081856 ext(0->7) 00010000:00010000:2.0:1746065140.621624:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 18 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.621636:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 18 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.621641:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ca80 00000100:00100000:2.0:1746065140.621669:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2988 00000100:00100000:2.0:1746065140.621676:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2004:x1830881273081856:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065140.623669:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273081856:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1988us (2194us total) trans 4294972127 rc 0/0 00000100:00100000:0.0:1746065140.623677:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2988 00002000:00100000:0.0:1746065140.623685:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009549ca80 x1830881273081856/t4294972127(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.623693:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ca80 with x1830881273081856 ext(0->7) 00010000:00010000:0.0:1746065140.623700:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.623712:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065140.623717:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ca80 00000100:00100000:0.0:1746065140.625526:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.625592:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273081984 00000100:00100000:2.0:1746065140.625599:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273081984 00010000:00010000:2.0:1746065140.625620:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.625902:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14543 00000100:00100000:2.0:1746065140.625908:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2003:x1830881273081984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.625929:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.625943:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.625954:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.625972:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88038f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6300 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.626214:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.626217:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.626223:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.626231:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.626258:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.626268:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267744768:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.626520:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.629306:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267744768:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.629321:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.629387:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2003:x1830881273081984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3477us (3863us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.629395:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14543 00000100:00100000:0.0:1746065140.633035:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.633120:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273082240 00000100:00100000:2.0:1746065140.633141:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273082240 00002000:00100000:2.0:1746065140.633173:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549c380 x1830881273082240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.633182:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549c380 with x1830881273082240 ext(0->4095) 00002000:00010000:2.0:1746065140.633186:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549c380 00000100:00100000:2.0:1746065140.633238:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13728 00000100:00100000:2.0:1746065140.633243:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273082240:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746065140.633349:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273082240:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 105us (335us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.633355:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13728 00002000:00100000:2.0:1746065140.633360:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549c380 x1830881273082240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.633367:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549c380 with x1830881273082240 ext(0->4095) 00002000:00010000:2.0:1746065140.633369:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549c380 00000100:00100000:0.0:1746065140.634997:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.635033:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.635153:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273082368 00000100:00100000:3.0:1746065140.635158:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273082368 00000100:00100000:3.0:1746065140.635182:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273082496 00000100:00100000:3.0:1746065140.635184:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273082496 00000100:00100000:3.0:1746065140.635198:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30572 00000100:00100000:3.0:1746065140.635203:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:1795:x1830881273082368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.635213:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.635226:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e630e expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.635247:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.635254:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.635255:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.635258:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 21 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.635281:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.635291:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 5 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.635302:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267744896:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065140.635309:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30573 00000100:00100000:0.0:1746065140.635348:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1791:x1830881273082496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065140.635354:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.635360:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6315 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.635361:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00010000:00010000:0.0:1746065140.635369:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.635372:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 22 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.635377:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065140.635379:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 22 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.635401:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 22 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.635411:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 22 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.635418:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb68800, rc 0) 00000100:00100000:0.0:1746065140.635434:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:1791:x1830881273082496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 119us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.635438:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30573 00000100:00100000:3.0:1746065140.636966:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267744896:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.636981:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 21 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.636990:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:3.0:1746065140.637010:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1795:x1830881273082368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1808us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.637016:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30572 00000100:00100000:0.0:1746065140.637428:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.637525:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273082624 00000100:00100000:2.0:1746065140.637529:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273082624 00010000:00010000:2.0:1746065140.637544:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.637565:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14544 00000100:00100000:2.0:1746065140.637570:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273082624:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.637578:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.637595:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.637604:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.637620:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880396 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6307 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.637640:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.637642:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.637648:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 20 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.637654:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 20 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.637673:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 20 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.637683:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.637691:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267745152:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.637867:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.638741:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267745152:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.638749:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.638767:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273082624:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1197us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.638774:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14544 00000100:00100000:0.0:1746065140.639521:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.639610:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273082880 00000100:00100000:1.0:1746065140.639614:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273082880 00002000:00100000:1.0:1746065140.639641:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64000 x1830881273082880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.639650:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64000 with x1830881273082880 ext(0->4095) 00010000:00010000:1.0:1746065140.639655:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.639666:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.639671:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64000 00000100:00100000:1.0:1746065140.639696:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2989 00000100:00100000:1.0:1746065140.639702:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:2004:x1830881273082880:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.639785:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:2004:x1830881273082880:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 82us (265us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.639790:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2989 00002000:00100000:1.0:1746065140.639795:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64000 x1830881273082880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.639801:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64000 with x1830881273082880 ext(0->4095) 00010000:00010000:1.0:1746065140.639805:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.639813:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.639818:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb64000 00000100:00100000:0.0:1746065140.640977:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.641005:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.641019:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273083008 00000100:00100000:3.0:1746065140.641024:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273083008 00000100:00100000:3.0:1746065140.641101:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30574 00000100:00100000:3.0:1746065140.641106:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273083008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.641115:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.641125:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e631c expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.641142:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.641146:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.641152:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065140.641155:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.641236:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.641247:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.641254:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065140.641278:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273083008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 172us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.641284:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30574 00000100:00100000:2.0:1746065140.641319:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273083136 00000100:00100000:2.0:1746065140.641323:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273083136 00010000:00010000:2.0:1746065140.641338:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.641366:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14545 00000100:00100000:2.0:1746065140.641371:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4dce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:2002:x1830881273083136:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.641381:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.641392:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.641401:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.641414:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88039d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e630e expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.641686:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.641688:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.641694:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.641701:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.641720:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.641729:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.641739:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267745408:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.641939:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.642839:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267745408:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.642849:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.642880:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4dce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2002:x1830881273083136:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1508us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.642887:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14545 00000100:00100000:0.0:1746065140.643254:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.643371:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273083392 00000100:00100000:2.0:1746065140.643375:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273083392 00002000:00100000:2.0:1746065140.643396:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb65f80 x1830881273083392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.643404:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb65f80 with x1830881273083392 ext(0->4095) 00010000:00010000:2.0:1746065140.643481:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.643492:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.643497:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb65f80 00000100:00100000:2.0:1746065140.643516:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2990 00000100:00100000:2.0:1746065140.643522:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881273083392:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.643612:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881273083392:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 90us (358us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.643618:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2990 00002000:00100000:2.0:1746065140.643623:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb65f80 x1830881273083392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.643629:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb65f80 with x1830881273083392 ext(0->4095) 00010000:00010000:2.0:1746065140.643633:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.643642:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.643646:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb65f80 00000100:00100000:0.0:1746065140.645398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.645437:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.645479:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273083648 00000100:00100000:2.0:1746065140.645484:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273083648 00010000:00010000:2.0:1746065140.645503:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.645522:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14546 00000100:00100000:2.0:1746065140.645527:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273083648:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.645536:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.645549:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.645558:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.645575:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68800/0x392ae0376f8803a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6315 expref: 20 pid: 9560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.645580:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273083520 00000100:00100000:3.0:1746065140.645584:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273083520 00010000:00010000:2.0:1746065140.645601:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.645604:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065140.645605:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30575 00000100:00100000:3.0:1746065140.645609:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:1791:x1830881273083520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.645609:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.645617:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.645620:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.645625:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6323 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.645637:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.645642:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.645643:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.645646:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 21 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.646064:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.646069:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.646078:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 5 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.646140:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267745664:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.646198:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065140.646253:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 5 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.646262:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267745536:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.646282:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.647410:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267745664:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.647426:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 21 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.647436:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065140.647466:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1791:x1830881273083520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1856us (2072us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.647473:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30575 00000100:00100000:2.0:1746065140.648337:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267745536:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.648347:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.648379:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273083648:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2851us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.648386:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14546 00000100:00100000:0.0:1746065140.648596:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.648671:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273083904 00000100:00100000:3.0:1746065140.648675:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273083904 00002000:00100000:3.0:1746065140.648704:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2300 x1830881273083904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.648712:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2300 with x1830881273083904 ext(0->4095) 00010000:00010000:3.0:1746065140.648717:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.648727:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.648732:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b2300 00000100:00100000:3.0:1746065140.648761:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2991 00000100:00100000:3.0:1746065140.648767:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273083904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065140.648889:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273083904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 122us (294us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.648895:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2991 00002000:00100000:3.0:1746065140.648899:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2300 x1830881273083904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.648903:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2300 with x1830881273083904 ext(0->4095) 00010000:00010000:3.0:1746065140.648906:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.648912:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.648915:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b2300 00000100:00100000:0.0:1746065140.650539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.651385:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273084032 00000100:00100000:2.0:1746065140.651392:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273084032 00010000:00010000:2.0:1746065140.651418:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.651452:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14547 00000100:00100000:2.0:1746065140.651458:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273084032:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.651468:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.651482:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.651492:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.651509:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e631c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.651533:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.651535:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.651540:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.651547:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.651569:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.651579:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267745792:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.651651:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.653194:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267745792:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.653206:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065140.653227:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.653342:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273084288 00000100:00100000:3.0:1746065140.653347:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273084288 00002000:00100000:3.0:1746065140.653376:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b3480 x1830881273084288/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.653386:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b3480 with x1830881273084288 ext(0->4095) 00002000:00010000:3.0:1746065140.653389:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b3480 00000100:00100000:2.0:1746065140.653502:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273084032:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2043us (2964us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.653510:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14547 00000100:00100000:3.0:1746065140.653605:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13729 00000100:00100000:3.0:1746065140.653612:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2002:x1830881273084288:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746065140.653709:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2002:x1830881273084288:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 97us (482us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.653715:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13729 00002000:00100000:3.0:1746065140.653720:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b3480 x1830881273084288/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.653727:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b3480 with x1830881273084288 ext(0->4095) 00002000:00010000:3.0:1746065140.653729:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b3480 00000100:00100000:0.0:1746065140.654826:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.654896:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273084416 00000100:00100000:3.0:1746065140.654901:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273084416 00000100:00100000:3.0:1746065140.654943:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30576 00000100:00100000:3.0:1746065140.654948:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273084416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.654957:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.654969:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e632a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.654988:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.654994:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.654995:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.654997:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.655014:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.655020:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 19 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.655027:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267745920:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.655105:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.655891:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267745920:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.655908:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.655930:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:3.0:1746065140.655963:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273084416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1014us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.655968:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30576 00000100:00100000:0.0:1746065140.656345:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.656533:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273084544 00000100:00100000:2.0:1746065140.656537:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273084544 00010000:00010000:2.0:1746065140.656553:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.656570:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14548 00000100:00100000:2.0:1746065140.656575:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273084544:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.656581:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.656593:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.656602:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.656616:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8803b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6323 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.656624:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.656626:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.656630:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.656636:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.656653:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.656659:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267746048:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.656708:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.658298:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.658402:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267746048:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.658413:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.658451:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2004:x1830881273084544:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1876us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.658459:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14548 00000100:00100000:3.0:1746065140.658788:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273084800 00000100:00100000:3.0:1746065140.658793:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273084800 00002000:00100000:3.0:1746065140.658821:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2a00 x1830881273084800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.658831:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2a00 with x1830881273084800 ext(0->4095) 00002000:00010000:3.0:1746065140.658834:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b2a00 00000100:00100000:3.0:1746065140.658847:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13730 00000100:00100000:3.0:1746065140.658852:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273084800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065140.658979:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273084800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 126us (684us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.658985:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13730 00002000:00100000:3.0:1746065140.658990:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2a00 x1830881273084800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.658997:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2a00 with x1830881273084800 ext(0->4095) 00002000:00010000:3.0:1746065140.658999:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b2a00 00000100:00100000:0.0:1746065140.660813:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.661038:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273084928 00000100:00100000:3.0:1746065140.661044:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273084928 00000100:00100000:3.0:1746065140.661154:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30577 00000100:00100000:3.0:1746065140.661160:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:1795:x1830881273084928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.661171:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.661184:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6331 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.661204:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.661210:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.661212:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.661214:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 20 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.661235:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.661243:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 5 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.661252:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267746176:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.661306:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.662686:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267746176:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.662703:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 20 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.662718:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065140.662875:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:1795:x1830881273084928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1714us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.662889:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30577 00000100:00100000:0.0:1746065140.663039:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.663260:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273085056 00000100:00100000:3.0:1746065140.663265:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273085056 00010000:00010000:3.0:1746065140.663285:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.663314:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14549 00000100:00100000:3.0:1746065140.663320:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273085056:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.663328:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.663343:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.663352:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.663368:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8803b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e632a expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.663601:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.663604:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.663610:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.663622:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.663643:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 19 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.663654:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267746304:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.663706:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.663872:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.663958:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273085184 00000100:00100000:3.0:1746065140.663962:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273085184 00000100:00100000:3.0:1746065140.663996:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30578 00000100:00100000:3.0:1746065140.664002:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:1791:x1830881273085184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.664011:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.664020:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6338 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.664033:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 21 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.664039:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.664040:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.664043:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 21 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.664058:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 21 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.664071:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.664079:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267746432:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.664162:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.664736:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267746304:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.664745:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.664776:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273085056:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1456us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.664784:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14549 00000100:00100000:0.0:1746065140.665211:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.665354:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273085440 00000100:00100000:2.0:1746065140.665359:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273085440 00002000:00100000:2.0:1746065140.665385:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1c00 x1830881273085440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.665392:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1c00 with x1830881273085440 ext(0->4095) 00010000:00010000:2.0:1746065140.665398:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 22 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.665408:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 22 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.665413:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b1c00 00000100:00100000:2.0:1746065140.665439:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2992 00000100:00100000:2.0:1746065140.665444:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2004:x1830881273085440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065140.665528:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2004:x1830881273085440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 83us (317us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.665533:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2992 00002000:00100000:2.0:1746065140.665537:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1c00 x1830881273085440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.665544:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1c00 with x1830881273085440 ext(0->4095) 00010000:00010000:2.0:1746065140.665548:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 22 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.665555:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 22 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.665559:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b1c00 00000100:00100000:3.0:1746065140.666302:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267746432:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.666318:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 21 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.666328:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065140.666441:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1791:x1830881273085184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2437us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.666447:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30578 00000100:00100000:0.0:1746065140.667584:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.667852:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273085568 00000100:00100000:3.0:1746065140.667858:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273085568 00000100:00100000:3.0:1746065140.668058:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30579 00000100:00100000:3.0:1746065140.668065:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273085568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.668075:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.668115:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e633f expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.668133:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.668138:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.668143:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065140.668145:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.668168:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.668177:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.668184:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065140.668210:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273085568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 146us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.668215:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30579 00000100:00100000:0.0:1746065140.671185:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.671297:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273085696 00000100:00100000:3.0:1746065140.671303:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273085696 00010000:00010000:3.0:1746065140.671333:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.671363:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14550 00000100:00100000:3.0:1746065140.671369:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:2005:x1830881273085696:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.671382:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.671398:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.671408:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.671481:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8803c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6331 expref: 21 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.671507:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.671509:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.671516:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.671522:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.671548:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.671558:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.671567:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267746688:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.671693:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.672829:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267746688:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.672840:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.672968:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881273085696:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1598us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.672976:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14550 00000100:00100000:0.0:1746065140.673584:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.673721:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273085952 00000100:00100000:1.0:1746065140.673727:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273085952 00002000:00100000:1.0:1746065140.673755:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253ea00 x1830881273085952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.673764:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253ea00 with x1830881273085952 ext(0->4095) 00010000:00010000:1.0:1746065140.673771:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.673780:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.673786:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253ea00 00000100:00100000:1.0:1746065140.673889:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2993 00000100:00100000:1.0:1746065140.673896:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273085952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.674015:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273085952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 119us (432us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.674021:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2993 00002000:00100000:1.0:1746065140.674026:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253ea00 x1830881273085952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.674032:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253ea00 with x1830881273085952 ext(0->4095) 00010000:00010000:1.0:1746065140.674037:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.674046:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.674051:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253ea00 00000100:00100000:0.0:1746065140.675504:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.675546:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.675755:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273086208 00000100:00100000:3.0:1746065140.675761:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273086208 00010000:00010000:3.0:1746065140.675780:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.675797:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14551 00000100:00100000:3.0:1746065140.675803:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273086208:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.675811:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.675824:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.675833:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.675849:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f8803c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6338 expref: 20 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.675861:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.675863:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.675868:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.675875:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.675898:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.675908:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267746816:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.675980:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.676146:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273086080 00000100:00100000:1.0:1746065140.676153:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273086080 00000100:00100000:1.0:1746065140.676179:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30580 00000100:00100000:1.0:1746065140.676185:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:1791:x1830881273086080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.676194:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.676203:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6346 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.676223:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.676233:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.676234:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.676236:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 21 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.676252:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.676261:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 5 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.676268:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267746944:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.676312:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.678253:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267746944:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.678273:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 21 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.678285:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd200, rc 0) 00000100:00100000:3.0:1746065140.678299:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267746816:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.678307:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.678316:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1791:x1830881273086080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2131us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.678320:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:2004:x1830881273086208:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2518us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.678322:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30580 00000100:00100000:3.0:1746065140.678326:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14551 00000100:00100000:0.0:1746065140.679751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.679797:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273086464 00000100:00100000:1.0:1746065140.679802:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273086464 00002000:00100000:1.0:1746065140.679831:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253e680 x1830881273086464/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.679846:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253e680 with x1830881273086464 ext(0->4095) 00010000:00010000:1.0:1746065140.679857:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.679867:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.679873:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253e680 00000100:00100000:1.0:1746065140.679900:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2994 00000100:00100000:1.0:1746065140.679906:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273086464:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.680019:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273086464:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (271us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.680024:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2994 00002000:00100000:1.0:1746065140.680029:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253e680 x1830881273086464/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.680035:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253e680 with x1830881273086464 ext(0->4095) 00010000:00010000:1.0:1746065140.680039:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.680047:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.680052:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253e680 00000100:00100000:0.0:1746065140.682046:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.682106:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273086592 00000100:00100000:3.0:1746065140.682112:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273086592 00010000:00010000:3.0:1746065140.682137:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.682173:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14552 00000100:00100000:3.0:1746065140.682179:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273086592:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.682189:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.682205:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.682214:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.682237:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8803ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e633f expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.682250:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.682252:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.682258:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.682265:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.682289:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.682299:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267747072:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.682546:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.685486:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267747072:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.685502:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.685541:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273086592:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3361us (3499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.685549:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14552 00000100:00100000:0.0:1746065140.685620:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.685714:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273086848 00000100:00100000:2.0:1746065140.685721:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273086848 00002000:00100000:2.0:1746065140.685750:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253c380 x1830881273086848/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.685759:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253c380 with x1830881273086848 ext(0->4095) 00002000:00010000:2.0:1746065140.685762:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007253c380 00000100:00100000:2.0:1746065140.685777:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13731 00000100:00100000:2.0:1746065140.685783:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881273086848:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.685886:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881273086848:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (266us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.685891:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13731 00002000:00100000:2.0:1746065140.685896:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253c380 x1830881273086848/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.685903:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253c380 with x1830881273086848 ext(0->4095) 00002000:00010000:2.0:1746065140.685906:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007253c380 00000100:00100000:0.0:1746065140.692348:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.692406:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273086976 00000100:00100000:1.0:1746065140.692415:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273086976 00000100:00100000:1.0:1746065140.693205:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30581 00000100:00100000:1.0:1746065140.693214:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273086976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.693229:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.693243:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e634d expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.693265:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.693271:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.693272:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.693275:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.693297:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.693307:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 19 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.693316:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267747200:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.693725:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.695255:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267747200:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.695277:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.695289:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:1.0:1746065140.695332:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273086976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2118us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.695338:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30581 00000100:00100000:0.0:1746065140.697810:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.697900:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273087104 00000100:00100000:3.0:1746065140.697908:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273087104 00010000:00010000:3.0:1746065140.697949:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 20 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.697969:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14553 00000100:00100000:3.0:1746065140.697975:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881273087104:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.697987:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.698001:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 20 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.698010:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 20 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.698027:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8803d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6346 expref: 20 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.698341:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.698344:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.698350:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.698358:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.698384:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.698393:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267747328:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.699814:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.700205:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.700398:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273087232 00000100:00100000:1.0:1746065140.700404:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273087232 00000100:00100000:1.0:1746065140.700441:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30582 00000100:00100000:1.0:1746065140.700447:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:1791:x1830881273087232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.700458:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.700469:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6354 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.700487:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.700497:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.700498:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.700501:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 21 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.700521:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.700530:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065140.700538:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267747456:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.702591:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.702800:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.702991:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273087488 00000100:00100000:1.0:1746065140.702998:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273087488 00002000:00100000:1.0:1746065140.703029:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbfb80 x1830881273087488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.703038:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbfb80 with x1830881273087488 ext(0->4095) 00010000:00010000:1.0:1746065140.703044:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.703054:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.703059:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbfb80 00000100:00100000:0.0:1746065140.703351:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267747456:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065140.703372:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 21 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.703382:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfca00, rc 0) 00000100:00100000:1.0:1746065140.703452:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2995 00000100:00100000:1.0:1746065140.703460:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273087488:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746065140.703629:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267747328:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.703639:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065140.703785:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1791:x1830881273087232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3337us (3581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.703792:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30582 00000100:00100000:1.0:1746065140.703874:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273087488:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 414us (1075us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.703879:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2995 00002000:00100000:1.0:1746065140.703885:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbfb80 x1830881273087488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.703892:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbfb80 with x1830881273087488 ext(0->4095) 00010000:00010000:1.0:1746065140.703897:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.703905:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.703909:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbbfb80 00000100:00100000:3.0:1746065140.703982:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881273087104:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6005us (6176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.703991:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14553 00000100:00100000:0.0:1746065140.709701:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.709908:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273087616 00000100:00100000:3.0:1746065140.709916:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273087616 00010000:00010000:3.0:1746065140.709957:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.709980:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14554 00000100:00100000:3.0:1746065140.709986:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273087616:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.709996:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.710010:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.710020:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.710037:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8803dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e634d expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.710065:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.710066:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.710072:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.710078:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.710124:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.710134:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267747584:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.710209:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.712966:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267747584:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.712981:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.713014:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273087616:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3028us (3319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.713023:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14554 00000100:00100000:0.0:1746065140.713944:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.714021:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273087872 00000100:00100000:1.0:1746065140.714026:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273087872 00002000:00100000:1.0:1746065140.714056:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbc380 x1830881273087872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.714065:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc380 with x1830881273087872 ext(0->4095) 00002000:00010000:1.0:1746065140.714069:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbc380 00000100:00100000:2.0:1746065140.714671:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13732 00000100:00100000:2.0:1746065140.714678:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273087872:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065140.714771:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273087872:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (829us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.714776:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13732 00002000:00100000:2.0:1746065140.714781:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbc380 x1830881273087872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.714788:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc380 with x1830881273087872 ext(0->4095) 00002000:00010000:2.0:1746065140.714790:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbc380 00000100:00100000:0.0:1746065140.719350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.719506:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273088000 00000100:00100000:2.0:1746065140.719513:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273088000 00000100:00100000:2.0:1746065140.719553:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30583 00000100:00100000:2.0:1746065140.719559:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273088000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.719572:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.719584:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e635b expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.719605:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.719611:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.719612:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.719615:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.719636:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 19 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.719647:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 19 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.719656:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267747712:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.719716:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.722538:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267747712:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.722563:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.722577:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065140.722628:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273088000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3068us (3285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.722636:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30583 00000100:00100000:0.0:1746065140.723475:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.723613:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273088128 00000100:00100000:1.0:1746065140.723619:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273088128 00002000:00100000:1.0:1746065140.723649:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880094c90380 x1830881273088128/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.723662:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90380 with x1830881273088128 ext(0->7) 00010000:00010000:1.0:1746065140.723669:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 20 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.723681:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 20 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.723687:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c90380 00000100:00100000:1.0:1746065140.723713:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2996 00000100:00100000:1.0:1746065140.723719:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2005:x1830881273088128:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746065140.725379:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881273088128:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1656us (1935us total) trans 4294972128 rc 0/0 00000100:00100000:1.0:1746065140.725387:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2996 00002000:00100000:1.0:1746065140.725393:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880094c90380 x1830881273088128/t4294972128(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.725407:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90380 with x1830881273088128 ext(0->7) 00010000:00010000:1.0:1746065140.725413:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 22 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.725425:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 22 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.725430:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c90380 00000100:00100000:0.0:1746065140.727827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.727892:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273088256 00000100:00100000:3.0:1746065140.727900:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273088256 00010000:00010000:3.0:1746065140.727939:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 22 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.727974:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14555 00000100:00100000:3.0:1746065140.727981:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2004:x1830881273088256:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.727992:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.728008:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 22 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.728019:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 22 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.728037:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfca00/0x392ae0376f8803e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6354 expref: 22 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.728065:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.728067:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.728074:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.728101:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.728128:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.728139:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267747840:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.728212:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.731314:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267747840:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.731329:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.731373:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:2004:x1830881273088256:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3391us (3552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.731381:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14555 00000100:00100000:0.0:1746065140.732768:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.734673:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273088512 00000100:00100000:1.0:1746065140.734682:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273088512 00002000:00100000:1.0:1746065140.734718:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90700 x1830881273088512/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.734726:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90700 with x1830881273088512 ext(0->4095) 00002000:00010000:1.0:1746065140.734731:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90700 00000100:00100000:1.0:1746065140.734757:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13733 00000100:00100000:1.0:1746065140.734763:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273088512:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.734875:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273088512:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 112us (2353us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.734880:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13733 00002000:00100000:1.0:1746065140.734885:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90700 x1830881273088512/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.734891:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90700 with x1830881273088512 ext(0->4095) 00002000:00010000:1.0:1746065140.734893:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90700 00000100:00100000:0.0:1746065140.736045:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.736310:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273088640 00000100:00100000:3.0:1746065140.736316:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273088640 00000100:00100000:3.0:1746065140.736354:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30584 00000100:00100000:3.0:1746065140.736360:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:1791:x1830881273088640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.736372:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.736385:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6362 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.736405:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.736416:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.736417:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.736420:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 22 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.736443:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.736454:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.736463:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267747968:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.738111:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.738291:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267747968:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.738311:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 22 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.738322:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065140.738350:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:1791:x1830881273088640:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1990us (2307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.738358:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30584 00000100:00100000:0.0:1746065140.739066:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.739113:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.739155:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273088896 00000100:00100000:2.0:1746065140.739160:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273088896 00010000:00010000:2.0:1746065140.739182:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.739208:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14556 00000100:00100000:2.0:1746065140.739213:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273088896:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.739223:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.739237:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.739281:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.739298:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f8803ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e635b expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.739842:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273088768 00000100:00100000:3.0:1746065140.739846:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273088768 00000100:00100000:3.0:1746065140.739875:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30585 00000100:00100000:3.0:1746065140.739880:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:1795:x1830881273088768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.739892:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.739902:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6369 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.739915:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.739930:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.739935:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.739938:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.739960:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.739970:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.739976:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.739978:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.739982:0:9558:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.739988:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.740001:0:9558:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.740014:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.740025:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267748224:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.740537:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.741067:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.741418:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273088896:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2202us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.741427:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14556 00000100:00100000:3.0:1746065140.744599:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267748224:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.744615:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065140.744663:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:1795:x1830881273088768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4781us (5597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.744670:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30585 00000100:00100000:0.0:1746065140.747331:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.747400:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273089152 00000100:00100000:2.0:1746065140.747407:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273089152 00002000:00100000:2.0:1746065140.747444:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c93b80 x1830881273089152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.747454:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c93b80 with x1830881273089152 ext(0->4095) 00010000:00010000:2.0:1746065140.747462:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.747475:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.747482:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c93b80 00000100:00100000:2.0:1746065140.747510:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2997 00000100:00100000:2.0:1746065140.747517:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2005:x1830881273089152:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.747630:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2005:x1830881273089152:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 113us (305us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.747636:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2997 00002000:00100000:2.0:1746065140.747641:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c93b80 x1830881273089152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.747647:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c93b80 with x1830881273089152 ext(0->4095) 00010000:00010000:2.0:1746065140.747652:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.747661:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.747666:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c93b80 00000100:00100000:0.0:1746065140.757466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.757531:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273089280 00000100:00100000:2.0:1746065140.757539:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273089280 00010000:00010000:2.0:1746065140.757570:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.757734:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14557 00000100:00100000:2.0:1746065140.757743:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2005:x1830881273089280:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.757755:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.757772:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.757783:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.757802:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8803f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6362 expref: 23 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.759062:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.759066:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.759075:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 22 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.759095:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 22 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.759130:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 22 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.759141:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267748352:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.759756:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.762476:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267748352:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.762495:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.762552:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881273089280:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4810us (5092us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.762561:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14557 00000100:00100000:0.0:1746065140.766178:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.766263:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273089536 00000100:00100000:1.0:1746065140.766271:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273089536 00002000:00100000:1.0:1746065140.766306:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90000 x1830881273089536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.766315:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90000 with x1830881273089536 ext(0->4095) 00002000:00010000:1.0:1746065140.766320:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90000 00000100:00100000:1.0:1746065140.766354:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13734 00000100:00100000:1.0:1746065140.766361:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881273089536:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.766494:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2005:x1830881273089536:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 133us (323us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.766500:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13734 00002000:00100000:1.0:1746065140.766505:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c90000 x1830881273089536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.766512:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c90000 with x1830881273089536 ext(0->4095) 00002000:00010000:1.0:1746065140.766514:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c90000 00000100:00100000:1.0:1746065140.773965:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.774245:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273089664 00000100:00100000:3.0:1746065140.774254:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273089664 00000100:00100000:3.0:1746065140.774293:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30586 00000100:00100000:3.0:1746065140.774299:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273089664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.774313:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.774327:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6370 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.774350:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 21 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.774356:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.774357:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.774360:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.774389:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 21 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.774399:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 21 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.774409:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267748480:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.781044:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.781827:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267748480:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.781850:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.781866:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065140.781976:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273089664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7675us (8017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.781983:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30586 00000100:00100000:0.0:1746065140.790633:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.790780:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273089792 00000100:00100000:2.0:1746065140.790788:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273089792 00002000:00100000:2.0:1746065140.790826:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880094c92300 x1830881273089792/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.790835:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92300 with x1830881273089792 ext(0->7) 00010000:00010000:2.0:1746065140.790843:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 22 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.790860:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 22 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.790867:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c92300 00000100:00100000:2.0:1746065140.790897:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2998 00000100:00100000:2.0:1746065140.790903:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2004:x1830881273089792:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746065140.792500:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881273089792:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1594us (1871us total) trans 4294972129 rc 0/0 00000100:00100000:2.0:1746065140.792509:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2998 00002000:00100000:2.0:1746065140.792514:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880094c92300 x1830881273089792/t4294972129(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.792522:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92300 with x1830881273089792 ext(0->7) 00010000:00010000:2.0:1746065140.792529:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.792540:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.792546:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c92300 00000100:00100000:0.0:1746065140.798560:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.798662:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273089920 00000100:00100000:2.0:1746065140.798669:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273089920 00010000:00010000:2.0:1746065140.798698:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.798722:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14558 00000100:00100000:2.0:1746065140.798728:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2003:x1830881273089920:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.798740:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065140.798752:0:7200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1746065139 -> 1746065140 00002000:00010000:2.0:1746065140.798755:0:7200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1746065139 -> 1746065140 00010000:00010000:2.0:1746065140.798760:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.798771:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.798789:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8803f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6369 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.798978:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.798980:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.798987:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.798994:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.799023:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.799033:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267748608:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.799912:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.801185:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267748608:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.801200:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.801229:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2003:x1830881273089920:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2500us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.801237:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14558 00000100:00100000:0.0:1746065140.801937:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.802172:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.802217:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273090048 00000100:00100000:3.0:1746065140.802223:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273090048 00000100:00100000:3.0:1746065140.802254:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30587 00000100:00100000:3.0:1746065140.802259:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:1791:x1830881273090048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.802273:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.802285:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6377 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065140.802310:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273090304 00000100:00100000:1.0:1746065140.802313:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273090304 00002000:00100000:1.0:1746065140.802332:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a0000 x1830881273090304/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.802341:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0000 with x1830881273090304 ext(0->4095) 00002000:00010000:1.0:1746065140.802345:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a0000 00000100:00100000:1.0:1746065140.802365:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13735 00000100:00100000:1.0:1746065140.802369:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273090304:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065140.802454:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273090304:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 85us (282us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.802460:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13735 00002000:00100000:1.0:1746065140.802464:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a0000 x1830881273090304/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.802471:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0000 with x1830881273090304 ext(0->4095) 00002000:00010000:1.0:1746065140.802473:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a0000 00010000:00010000:3.0:1746065140.802522:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.802529:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.802531:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.802534:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.802554:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.802564:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 5 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.802573:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267748736:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.802621:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.804351:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267748736:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.804373:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.804384:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:3.0:1746065140.804413:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1791:x1830881273090048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2153us (2477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.804419:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30587 00000100:00100000:0.0:1746065140.805061:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.805161:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.805200:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273090560 00000100:00100000:0.0:1746065140.805206:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273090560 00010000:00010000:0.0:1746065140.805228:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065140.805255:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14559 00000100:00100000:0.0:1746065140.805261:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273090560:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065140.805271:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065140.805286:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.805296:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.805315:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8803ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6370 expref: 6 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.805332:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.805334:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.805339:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.805346:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.805369:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.805378:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267748864:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065140.805426:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.805632:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273090432 00000100:00100000:3.0:1746065140.805636:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273090432 00000100:00100000:3.0:1746065140.805656:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30588 00000100:00100000:3.0:1746065140.805661:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1795:x1830881273090432:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.805674:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.805682:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e637e expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.805697:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.805702:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.805704:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.805706:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.805719:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.805727:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.805734:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267748992:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.805755:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.809064:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.809142:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267748992:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.809165:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.809180:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:2.0:1746065140.809395:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267748864:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.809406:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.809686:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1795:x1830881273090432:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4023us (4626us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.809697:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30588 00000100:00100000:3.0:1746065140.809734:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273090816 00000100:00100000:3.0:1746065140.809738:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273090816 00002000:00100000:3.0:1746065140.809766:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a0e00 x1830881273090816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.809774:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0e00 with x1830881273090816 ext(0->4095) 00010000:00010000:3.0:1746065140.809780:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.809791:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.809796:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a0e00 00000100:00100000:3.0:1746065140.809817:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 2999 00000100:00100000:3.0:1746065140.809823:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273090816:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.810190:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273090560:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4928us (5027us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.810197:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14559 00000100:00100000:3.0:1746065140.810778:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273090816:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 954us (1720us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.810784:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 2999 00002000:00100000:3.0:1746065140.810790:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a0e00 x1830881273090816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.810797:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0e00 with x1830881273090816 ext(0->4095) 00010000:00010000:3.0:1746065140.810801:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.810814:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.810819:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a0e00 00000100:00100000:0.0:1746065140.813552:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.813634:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273090944 00000100:00100000:3.0:1746065140.813642:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273090944 00000100:00100000:3.0:1746065140.813993:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30589 00000100:00100000:3.0:1746065140.814001:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1791:x1830881273090944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.814015:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.814027:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6385 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.814048:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.814053:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.814058:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065140.814061:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.814121:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.814131:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.814139:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065140.814177:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1791:x1830881273090944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 178us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.814183:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30589 00000100:00100000:0.0:1746065140.814982:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.815442:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273091072 00000100:00100000:2.0:1746065140.815447:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273091072 00010000:00010000:2.0:1746065140.815465:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 26 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.815491:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14560 00000100:00100000:2.0:1746065140.815496:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273091072:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.815503:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.815518:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 26 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.815527:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 26 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.815542:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880406 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6377 expref: 26 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.815895:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.815898:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.815904:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.815912:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.815943:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.815954:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.815964:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267749248:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.816313:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.817928:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267749248:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.817943:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.817984:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273091072:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2488us (3002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.817992:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14560 00000100:00100000:0.0:1746065140.818847:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.818956:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273091328 00000100:00100000:3.0:1746065140.818962:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273091328 00002000:00100000:3.0:1746065140.818993:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a3100 x1830881273091328/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.819001:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a3100 with x1830881273091328 ext(0->4095) 00010000:00010000:3.0:1746065140.819007:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.819019:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065140.819024:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a3100 00000100:00100000:1.0:1746065140.819203:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3000 00000100:00100000:1.0:1746065140.819211:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273091328:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.819577:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273091328:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 366us (730us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.819583:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3000 00002000:00100000:1.0:1746065140.819589:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a3100 x1830881273091328/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.819596:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a3100 with x1830881273091328 ext(0->4095) 00010000:00010000:1.0:1746065140.819600:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065140.819608:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065140.819612:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a3100 00000100:00100000:0.0:1746065140.823996:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.824042:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.824452:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273091584 00000100:00100000:3.0:1746065140.824463:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273091584 00010000:00010000:3.0:1746065140.824490:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.824515:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14561 00000100:00100000:3.0:1746065140.824522:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2002:x1830881273091584:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.824532:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.824548:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.824558:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.824576:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f88040d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e637e expref: 25 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.824591:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.824593:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.824598:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.824606:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.824632:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.824642:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267749376:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.824703:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.824842:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273091456 00000100:00100000:2.0:1746065140.824846:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273091456 00000100:00100000:2.0:1746065140.824868:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30590 00000100:00100000:2.0:1746065140.824873:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273091456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.824883:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.824892:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e638c expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.824915:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.824929:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.824931:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.824933:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.824949:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.824958:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.824965:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267749504:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.824987:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.828317:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267749376:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.828333:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.828379:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2002:x1830881273091584:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3856us (4336us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.828388:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14561 00000100:00100000:0.0:1746065140.828682:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267749504:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065140.828699:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.828711:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:0.0:1746065140.828731:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273091456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3858us (4744us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.828738:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30590 00000100:00100000:1.0:1746065140.828751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.828826:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273091712 00000100:00100000:3.0:1746065140.828831:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273091712 00010000:00010000:3.0:1746065140.828849:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.828881:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14562 00000100:00100000:3.0:1746065140.828888:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2005:x1830881273091712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.828897:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.828910:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.828931:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.828948:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880414 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6385 expref: 24 pid: 9558 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.828960:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.828961:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.828967:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.828974:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.828996:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.829006:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267749632:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.829052:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.831668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.831743:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267749632:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.831756:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.831792:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2005:x1830881273091712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2905us (3042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.831800:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14562 00000100:00100000:1.0:1746065140.832067:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273091968 00000100:00100000:1.0:1746065140.832073:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273091968 00002000:00100000:1.0:1746065140.832127:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f982300 x1830881273091968/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.832136:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982300 with x1830881273091968 ext(0->4095) 00002000:00010000:1.0:1746065140.832140:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f982300 00000100:00100000:1.0:1746065140.832156:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13736 00000100:00100000:1.0:1746065140.832162:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273091968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.832260:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273091968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (597us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.832264:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13736 00002000:00100000:1.0:1746065140.832269:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f982300 x1830881273091968/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.832275:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982300 with x1830881273091968 ext(0->4095) 00002000:00010000:1.0:1746065140.832277:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f982300 00000100:00100000:0.0:1746065140.836603:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.838544:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273092096 00000100:00100000:0.0:1746065140.838550:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.838553:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273092096 00000100:00100000:2.0:1746065140.838582:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273092224 00000100:00100000:2.0:1746065140.838584:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273092224 00000100:00100000:0.0:1746065140.838594:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30591 00000100:00100000:2.0:1746065140.838600:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30592 00000100:00100000:0.0:1746065140.838602:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1795:x1830881273092096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:2.0:1746065140.838604:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1791:x1830881273092224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.838617:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.838624:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.838632:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e639a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.838632:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6393 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.838654:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.838660:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.838662:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.838665:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.838822:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.838827:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.838831:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065140.838834:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.838852:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.838855:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.838863:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 5 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065140.838872:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.838873:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267749760:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065140.838880:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb69600, rc 0) 00000100:00100000:0.0:1746065140.838907:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1795:x1830881273092096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 306us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.838916:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30591 00000100:00100000:2.0:1746065140.839176:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.840530:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267749760:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.840544:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.840554:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:2.0:1746065140.840576:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1791:x1830881273092224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1971us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.840581:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30592 00000100:00100000:0.0:1746065140.844381:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.844440:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273092352 00000100:00100000:3.0:1746065140.844451:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273092352 00010000:00010000:3.0:1746065140.844510:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.844548:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14563 00000100:00100000:3.0:1746065140.844554:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273092352:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.844567:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.844582:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.844592:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.844609:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88041b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e638c expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.845195:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.845197:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.845203:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.845210:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.845235:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.845244:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 24 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.845253:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267750016:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.845317:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.847284:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.847647:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267750016:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.847660:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.847689:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273092352:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3135us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.847698:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14563 00000100:00100000:2.0:1746065140.847802:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273092608 00000100:00100000:2.0:1746065140.847807:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273092608 00002000:00100000:2.0:1746065140.847836:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f983b80 x1830881273092608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.847850:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983b80 with x1830881273092608 ext(0->4095) 00010000:00010000:2.0:1746065140.847856:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.847868:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.847874:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f983b80 00000100:00100000:2.0:1746065140.847888:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3001 00000100:00100000:2.0:1746065140.847893:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273092608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065140.848002:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273092608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 108us (720us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.848007:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3001 00002000:00100000:2.0:1746065140.848012:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f983b80 x1830881273092608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.848019:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f983b80 with x1830881273092608 ext(0->4095) 00010000:00010000:2.0:1746065140.848023:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.848032:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.848037:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f983b80 00000100:00100000:0.0:1746065140.850112:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.850202:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273092736 00000100:00100000:3.0:1746065140.850209:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273092736 00010000:00010000:3.0:1746065140.850229:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.850811:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14564 00000100:00100000:3.0:1746065140.850819:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2003:x1830881273092736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.850833:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.850848:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.850859:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.850877:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880422 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e639a expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.850888:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.850890:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.850896:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 24 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.850902:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 24 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.850943:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 24 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.850953:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267750144:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.852724:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.854690:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.854908:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267750144:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.854932:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.854965:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2003:x1830881273092736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4146us (4857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.854974:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14564 00000100:00100000:1.0:1746065140.855339:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273092992 00000100:00100000:1.0:1746065140.855345:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273092992 00002000:00100000:1.0:1746065140.855375:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f982680 x1830881273092992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.855383:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982680 with x1830881273092992 ext(0->4095) 00002000:00010000:1.0:1746065140.855387:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f982680 00000100:00100000:1.0:1746065140.855414:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13737 00000100:00100000:1.0:1746065140.855420:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881273092992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.856140:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881273092992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 719us (1451us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.856146:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13737 00002000:00100000:1.0:1746065140.856153:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f982680 x1830881273092992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.856160:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f982680 with x1830881273092992 ext(0->4095) 00002000:00010000:1.0:1746065140.856163:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f982680 00000100:00100000:0.0:1746065140.857785:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.858292:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273093120 00000100:00100000:2.0:1746065140.858299:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273093120 00000100:00100000:2.0:1746065140.858470:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30593 00000100:00100000:2.0:1746065140.858476:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273093120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.858488:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.858500:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63a1 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.858520:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 23 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.858527:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.858528:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.858531:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.858552:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 23 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.858560:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 23 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.858569:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267750272:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.858862:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.860110:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267750272:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.860126:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.860135:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065140.860156:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273093120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1680us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.860162:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30593 00000100:00100000:0.0:1746065140.861286:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.861369:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273093248 00000100:00100000:3.0:1746065140.861375:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273093248 00010000:00010000:3.0:1746065140.861393:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 24 pid: 21550 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.861413:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14565 00000100:00100000:3.0:1746065140.861418:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2005:x1830881273093248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.861426:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.861439:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 24 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.861448:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 24 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.861462:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f880429 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6393 expref: 24 pid: 21550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.861483:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.861484:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.861490:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.861496:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.861515:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.861524:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267750400:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.861566:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.863696:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.863781:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267750400:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.863794:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.863820:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2005:x1830881273093248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2401us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.863828:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14565 00000100:00100000:1.0:1746065140.863981:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273093504 00000100:00100000:1.0:1746065140.863988:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273093504 00002000:00100000:1.0:1746065140.864016:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfb480 x1830881273093504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.864025:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfb480 with x1830881273093504 ext(0->4095) 00002000:00010000:1.0:1746065140.864029:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfb480 00000100:00100000:1.0:1746065140.864056:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13738 00000100:00100000:1.0:1746065140.864062:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273093504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065140.864179:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273093504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 116us (487us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.864184:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13738 00002000:00100000:1.0:1746065140.864188:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfb480 x1830881273093504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.864195:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfb480 with x1830881273093504 ext(0->4095) 00002000:00010000:1.0:1746065140.864198:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfb480 00000100:00100000:0.0:1746065140.865942:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.866929:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273093632 00000100:00100000:2.0:1746065140.866937:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273093632 00000100:00100000:2.0:1746065140.866975:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30594 00000100:00100000:2.0:1746065140.866981:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:1791:x1830881273093632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.866996:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.867011:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63a8 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.867034:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.867041:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.867042:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.867045:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.867067:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.867076:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 5 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065140.867110:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267750528:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.867176:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.867731:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.867799:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273093760 00000100:00100000:0.0:1746065140.867803:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273093760 00000100:00100000:0.0:1746065140.867831:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30595 00000100:00100000:0.0:1746065140.867835:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1795:x1830881273093760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065140.867842:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.867850:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63af expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.867861:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.867865:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.867869:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065140.867872:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.867891:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.867905:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.867912:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb68e00, rc 0) 00000100:00100000:0.0:1746065140.867952:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1795:x1830881273093760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 116us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.867957:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30595 00000100:00100000:0.0:1746065140.870807:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.870883:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267750528:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.870905:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.870929:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065140.870963:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1791:x1830881273093632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3982us (5028us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.870971:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30594 00000100:00100000:3.0:1746065140.871214:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273093888 00000100:00100000:3.0:1746065140.871220:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273093888 00010000:00010000:3.0:1746065140.871242:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.871262:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14566 00000100:00100000:3.0:1746065140.871267:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4f96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273093888:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.871277:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.871291:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.871301:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.871317:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880430 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a1 expref: 6 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.871341:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.871343:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.871349:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.871356:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.871380:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.871389:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 24 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.871399:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267750784:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.871447:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.876489:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.876789:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267750784:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.876804:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.876838:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4f96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273093888:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5569us (6038us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.876847:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14566 00000100:00100000:2.0:1746065140.877126:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273094144 00000100:00100000:2.0:1746065140.877132:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273094144 00002000:00100000:2.0:1746065140.877162:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf9180 x1830881273094144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.877171:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf9180 with x1830881273094144 ext(0->4095) 00010000:00010000:2.0:1746065140.877177:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.877189:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.877196:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fbf9180 00000100:00100000:2.0:1746065140.877405:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3002 00000100:00100000:2.0:1746065140.877411:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881273094144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065140.877511:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881273094144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 100us (1029us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.877517:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3002 00002000:00100000:2.0:1746065140.877522:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf9180 x1830881273094144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.877529:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf9180 with x1830881273094144 ext(0->4095) 00010000:00010000:2.0:1746065140.877534:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065140.877542:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065140.877548:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fbf9180 00000100:00100000:0.0:1746065140.880145:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.880224:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273094272 00000100:00100000:3.0:1746065140.880231:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273094272 00010000:00010000:3.0:1746065140.880254:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065140.880451:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14567 00000100:00100000:3.0:1746065140.880457:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2002:x1830881273094272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.880467:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.880480:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.880491:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.880509:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880437 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63a8 expref: 25 pid: 9635 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065140.880766:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.880768:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.880774:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 24 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.880781:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 24 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.880806:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 24 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.880815:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267750912:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.881194:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.884358:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267750912:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.884375:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.884408:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2002:x1830881273094272:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3952us (4268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.884417:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14567 00000100:00100000:0.0:1746065140.885728:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.885859:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273094528 00000100:00100000:1.0:1746065140.885866:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273094528 00002000:00100000:1.0:1746065140.885897:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf8700 x1830881273094528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.885913:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8700 with x1830881273094528 ext(0->4095) 00002000:00010000:1.0:1746065140.885926:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbf8700 00000100:00100000:1.0:1746065140.885952:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13739 00000100:00100000:1.0:1746065140.885958:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2003:x1830881273094528:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065140.886054:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2003:x1830881273094528:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 96us (329us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.886059:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13739 00002000:00100000:1.0:1746065140.886064:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf8700 x1830881273094528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.886070:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8700 with x1830881273094528 ext(0->4095) 00002000:00010000:1.0:1746065140.886072:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbf8700 00000100:00100000:0.0:1746065140.888173:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.888359:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273094656 00000100:00100000:2.0:1746065140.888366:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273094656 00000100:00100000:2.0:1746065140.888417:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30596 00000100:00100000:2.0:1746065140.888425:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273094656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.888438:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.888453:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63b6 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.888478:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 23 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.888485:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.888486:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.888489:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.888516:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 23 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.888531:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 23 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065140.888542:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267751040:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065140.888623:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.890248:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267751040:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.890282:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.890297:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065140.890351:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273094656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1918us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.890359:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30596 00000100:00100000:0.0:1746065140.890484:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.890655:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273094784 00000100:00100000:3.0:1746065140.890660:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273094784 00010000:00010000:3.0:1746065140.890700:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 24 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065140.890756:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14568 00000100:00100000:3.0:1746065140.890763:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2005:x1830881273094784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.890773:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.890804:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 24 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.890824:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 24 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.890852:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68e00/0x392ae0376f88043e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63af expref: 24 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.890884:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.890887:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.890893:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.890900:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.890965:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.891132:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267751168:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.892219:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.894986:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.895042:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273095040 00000100:00100000:2.0:1746065140.895050:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273095040 00002000:00100000:2.0:1746065140.895114:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfaa00 x1830881273095040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.895122:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfaa00 with x1830881273095040 ext(0->4095) 00002000:00010000:2.0:1746065140.895126:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfaa00 00000100:00100000:2.0:1746065140.895154:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13740 00000100:00100000:2.0:1746065140.895160:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273095040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.895182:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267751168:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.895196:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.895401:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2005:x1830881273094784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4637us (4916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.895410:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14568 00000100:00100000:2.0:1746065140.895548:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273095040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 387us (568us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.895557:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13740 00002000:00100000:2.0:1746065140.895562:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfaa00 x1830881273095040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.895568:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfaa00 with x1830881273095040 ext(0->4095) 00002000:00010000:2.0:1746065140.895571:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfaa00 00000100:00100000:0.0:1746065140.895671:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.896005:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273095168 00000100:00100000:3.0:1746065140.896009:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273095168 00000100:00100000:3.0:1746065140.896029:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30597 00000100:00100000:3.0:1746065140.896034:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:1791:x1830881273095168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.896042:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.896055:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63bd expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.896074:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.896096:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.896097:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.896595:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.896621:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.896631:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065140.896642:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267751296:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.896704:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.897403:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.897444:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273095296 00000100:00100000:2.0:1746065140.897450:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273095296 00000100:00100000:2.0:1746065140.897481:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30598 00000100:00100000:2.0:1746065140.897487:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1795:x1830881273095296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.897494:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.897502:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63c4 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.897514:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.897518:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.897523:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.897525:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.897543:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.897553:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.897565:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065a00, rc 0) 00000100:00100000:2.0:1746065140.897602:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1795:x1830881273095296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 115us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.897607:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30598 00000100:00100000:0.0:1746065140.898846:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.898850:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267751296:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.898870:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.898880:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065140.898966:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1791:x1830881273095168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2930us (3298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.898972:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30597 00000100:00100000:2.0:1746065140.899038:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273095424 00000100:00100000:2.0:1746065140.899043:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273095424 00010000:00010000:2.0:1746065140.899061:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065140.899107:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14569 00000100:00100000:2.0:1746065140.899113:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273095424:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.899121:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.899136:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.899145:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.899160:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880445 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63b6 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.899636:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.899637:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.899644:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.899656:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.899675:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.899685:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 24 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065140.899694:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267751552:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.900022:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.901105:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267751552:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.901117:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.901137:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273095424:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2024us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.901144:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14569 00000100:00100000:0.0:1746065140.901744:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.901885:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273095680 00000100:00100000:2.0:1746065140.901890:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273095680 00002000:00100000:2.0:1746065140.901928:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f9500 x1830881273095680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.901937:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9500 with x1830881273095680 ext(0->4095) 00010000:00010000:2.0:1746065140.901944:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.901953:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065140.901959:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9f9500 00000100:00100000:2.0:1746065140.901974:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3003 00000100:00100000:2.0:1746065140.901979:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881273095680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065140.903000:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881273095680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1018us (1254us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.903006:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3003 00002000:00100000:2.0:1746065140.903012:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f9500 x1830881273095680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.903019:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9500 with x1830881273095680 ext(0->4095) 00010000:00010000:2.0:1746065140.903024:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.903033:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065140.903039:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9f9500 00000100:00100000:0.0:1746065140.904779:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.904875:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273095808 00000100:00100000:2.0:1746065140.904882:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273095808 00010000:00010000:2.0:1746065140.904905:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065140.905025:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14570 00000100:00100000:2.0:1746065140.905031:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2002:x1830881273095808:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.905041:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.905056:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.905065:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.905105:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88044c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63bd expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.905115:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.905117:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.905123:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.905129:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.905155:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 24 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.905166:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267751680:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.905472:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.909066:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.909200:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267751680:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.909218:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.909252:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2002:x1830881273095808:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4220us (4477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.909261:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14570 00000100:00100000:3.0:1746065140.909368:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273096064 00000100:00100000:3.0:1746065140.909374:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273096064 00002000:00100000:3.0:1746065140.909407:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f9880 x1830881273096064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.909415:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9880 with x1830881273096064 ext(0->4095) 00002000:00010000:3.0:1746065140.909419:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9f9880 00000100:00100000:3.0:1746065140.909638:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13741 00000100:00100000:3.0:1746065140.909646:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881273096064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065140.910244:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881273096064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 598us (1184us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.910251:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13741 00002000:00100000:3.0:1746065140.910257:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9f9880 x1830881273096064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.910265:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f9880 with x1830881273096064 ext(0->4095) 00002000:00010000:3.0:1746065140.910268:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9f9880 00000100:00100000:0.0:1746065140.912975:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.913078:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273096192 00000100:00100000:3.0:1746065140.913197:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273096192 00000100:00100000:3.0:1746065140.913280:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30599 00000100:00100000:3.0:1746065140.913287:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273096192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065140.913301:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.913315:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63cb expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.913337:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.913343:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.913344:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.913347:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.913371:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 23 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.913382:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 23 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065140.913393:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267751808:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065140.913835:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.916464:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.916554:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267751808:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065140.916575:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.916595:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065140.916629:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273096192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3342us (3659us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.916636:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30599 00000100:00100000:2.0:1746065140.916706:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273096320 00000100:00100000:2.0:1746065140.916712:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273096320 00010000:00010000:2.0:1746065140.916732:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 24 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065140.917006:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14571 00000100:00100000:2.0:1746065140.917013:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2005:x1830881273096320:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.917022:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.917038:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 24 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.917048:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 24 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.917063:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f880453 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63c4 expref: 24 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.917076:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.917078:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.917110:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.917116:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.917138:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.917147:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267751936:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.917188:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.919639:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.919683:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.919715:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273096704 00000100:00100000:0.0:1746065140.919721:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273096704 00000100:00100000:0.0:1746065140.919763:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30600 00000100:00100000:0.0:1746065140.919769:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1791:x1830881273096704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065140.919781:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.919794:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63d2 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.919814:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.919819:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.919821:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.919824:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.919844:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.919854:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065140.919863:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a093ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267752064:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065140.919926:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.919949:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267751936:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.919961:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.919981:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273096320:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2969us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.919988:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14571 00000100:00100000:3.0:1746065140.920181:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273096576 00000100:00100000:3.0:1746065140.920185:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273096576 00002000:00100000:3.0:1746065140.920206:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0938a80 x1830881273096576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.920213:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0938a80 with x1830881273096576 ext(0->4095) 00010000:00010000:3.0:1746065140.920217:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.920225:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065140.920230:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0938a80 00000100:00100000:3.0:1746065140.920240:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3004 00000100:00100000:3.0:1746065140.920244:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273096576:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065140.920324:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273096576:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 78us (690us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.920329:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3004 00002000:00100000:3.0:1746065140.920333:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0938a80 x1830881273096576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.920345:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0938a80 with x1830881273096576 ext(0->4095) 00010000:00010000:3.0:1746065140.920348:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.920357:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065140.920361:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0938a80 00000100:00100000:2.0:1746065140.921389:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a093ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267752064:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065140.921405:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.921415:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb69e00, rc 0) 00000100:00100000:2.0:1746065140.921450:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1791:x1830881273096704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1681us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.921456:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30600 00000100:00100000:0.0:1746065140.921819:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.921966:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273096832 00000100:00100000:2.0:1746065140.921971:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273096832 00000100:00100000:2.0:1746065140.923260:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30601 00000100:00100000:2.0:1746065140.923269:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a093a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1795:x1830881273096832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065140.923281:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065140.923294:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63d9 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.923314:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.923318:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.923327:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065140.923330:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.923355:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.923364:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.923371:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064000, rc 0) 00000100:00100000:2.0:1746065140.923404:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a093a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1795:x1830881273096832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 138us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.923409:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30601 00000100:00100000:0.0:1746065140.923546:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.923962:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273096960 00000100:00100000:2.0:1746065140.923968:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273096960 00010000:00010000:2.0:1746065140.923985:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065140.925120:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14572 00000100:00100000:2.0:1746065140.925129:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273096960:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.925139:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.925155:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.925165:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.925182:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88045a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63cb expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.925205:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.925207:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.925213:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.925220:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.925243:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.925253:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 24 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065140.925263:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267752320:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.925333:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.928560:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267752320:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.928581:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.928628:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273096960:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3498us (5080us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.928637:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14572 00000100:00100000:0.0:1746065140.928780:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.928826:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273097216 00000100:00100000:1.0:1746065140.928832:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273097216 00002000:00100000:1.0:1746065140.928866:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a093ad80 x1830881273097216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.928875:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a093ad80 with x1830881273097216 ext(0->4095) 00010000:00010000:1.0:1746065140.928882:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065140.928895:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065140.928902:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a093ad80 00000100:00100000:1.0:1746065140.928934:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3005 00000100:00100000:1.0:1746065140.928941:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a093ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273097216:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.929028:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a093ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273097216:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 86us (248us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.929033:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3005 00002000:00100000:1.0:1746065140.929037:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a093ad80 x1830881273097216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.929044:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a093ad80 with x1830881273097216 ext(0->4095) 00010000:00010000:1.0:1746065140.929048:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065140.929056:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065140.929061:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a093ad80 00000100:00100000:0.0:1746065140.933588:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.934303:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273097344 00000100:00100000:2.0:1746065140.934313:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273097344 00010000:00010000:2.0:1746065140.934343:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065140.934379:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14573 00000100:00100000:2.0:1746065140.934385:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4f95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881273097344:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065140.934395:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065140.934409:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.934420:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.934437:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f880461 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d2 expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.934465:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.934467:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065140.934473:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.934480:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065140.934508:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 24 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065140.934519:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267752448:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065140.934957:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065140.937166:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267752448:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065140.937182:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065140.937218:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4f95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881273097344:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2832us (3639us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065140.937227:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14573 00000100:00100000:0.0:1746065140.939042:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.940117:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273097600 00000100:00100000:3.0:1746065140.940125:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273097600 00002000:00100000:3.0:1746065140.940160:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0939500 x1830881273097600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.940169:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0939500 with x1830881273097600 ext(0->4095) 00002000:00010000:3.0:1746065140.940174:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0939500 00000100:00100000:3.0:1746065140.940201:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13742 00000100:00100000:3.0:1746065140.940207:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2005:x1830881273097600:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065140.940317:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2005:x1830881273097600:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 110us (1280us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.940323:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13742 00002000:00100000:3.0:1746065140.940327:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0939500 x1830881273097600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065140.940333:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0939500 with x1830881273097600 ext(0->4095) 00002000:00010000:3.0:1746065140.940336:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0939500 00000100:00100000:0.0:1746065140.944442:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.944535:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273097728 00000100:00100000:1.0:1746065140.944542:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273097728 00000100:00100000:1.0:1746065140.944593:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30602 00000100:00100000:1.0:1746065140.944601:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273097728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.944615:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.944630:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63e0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.944653:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 23 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.944659:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.944662:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.944665:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.944689:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 23 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.944699:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 23 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065140.944710:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267752576:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.944781:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.947933:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267752576:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.947957:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.947971:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00000100:00100000:1.0:1746065140.948007:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273097728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3407us (3573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.948013:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30602 00000100:00100000:0.0:1746065140.948699:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.949764:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.950121:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273097856 00000100:00100000:3.0:1746065140.950128:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273097856 00010000:00010000:3.0:1746065140.950163:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 24 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065140.950185:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14574 00000100:00100000:3.0:1746065140.950192:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2005:x1830881273097856:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.950202:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.950229:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 24 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.950240:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 24 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.950258:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880468 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63d9 expref: 24 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.950282:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.950284:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.950290:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.950297:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.950322:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.950331:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267752704:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.950416:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.950726:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273097984 00000100:00100000:1.0:1746065140.950730:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273097984 00000100:00100000:1.0:1746065140.950750:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30603 00000100:00100000:1.0:1746065140.950755:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:1791:x1830881273097984:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.950765:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.950774:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63e7 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.950793:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.950798:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.950799:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.950802:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.950817:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.950826:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065140.950834:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267752832:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.950857:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.954887:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267752704:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.954904:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.955021:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267752832:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.955048:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.955093:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfcc00, rc 0) 00000100:00100000:3.0:1746065140.956713:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2005:x1830881273097856:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6514us (8008us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.956714:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1791:x1830881273097984:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5957us (6956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.956723:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14574 00000100:00100000:1.0:1746065140.956723:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30603 00000100:00100000:0.0:1746065140.956839:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.956957:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273098240 00000100:00100000:1.0:1746065140.956963:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273098240 00002000:00100000:1.0:1746065140.957001:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffe300 x1830881273098240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.957009:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffe300 with x1830881273098240 ext(0->4095) 00010000:00010000:1.0:1746065140.957016:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065140.957027:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065140.957038:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffe300 00000100:00100000:1.0:1746065140.957051:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3006 00000100:00100000:1.0:1746065140.957056:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273098240:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065140.957224:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273098240:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 167us (384us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.957235:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3006 00002000:00100000:1.0:1746065140.957241:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffe300 x1830881273098240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.957247:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffe300 with x1830881273098240 ext(0->4095) 00010000:00010000:1.0:1746065140.957252:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065140.957266:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065140.957271:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffe300 00000100:00100000:0.0:1746065140.960519:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.960585:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273098368 00000100:00100000:3.0:1746065140.960593:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273098368 00010000:00010000:3.0:1746065140.960622:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065140.960658:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14575 00000100:00100000:3.0:1746065140.960664:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273098368:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.960676:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.960690:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.960701:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.960717:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f88046f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e0 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.960743:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.960744:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.960751:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 23 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.960761:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 23 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.960787:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 23 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.960797:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267752960:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.960864:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.962398:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267752960:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.962411:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.962433:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273098368:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1770us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.962440:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14575 00000100:00100000:0.0:1746065140.963075:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.963139:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273098624 00000100:00100000:1.0:1746065140.963144:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273098624 00002000:00100000:1.0:1746065140.963172:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffce00 x1830881273098624/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.963181:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffce00 with x1830881273098624 ext(0->4095) 00002000:00010000:1.0:1746065140.963184:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dffce00 00000100:00100000:1.0:1746065140.963208:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13743 00000100:00100000:1.0:1746065140.963213:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2002:x1830881273098624:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065140.963301:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2002:x1830881273098624:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 88us (226us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.963306:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13743 00002000:00100000:1.0:1746065140.964264:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffce00 x1830881273098624/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.964273:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffce00 with x1830881273098624 ext(0->4095) 00002000:00010000:1.0:1746065140.964276:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dffce00 00000100:00100000:0.0:1746065140.968526:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.969076:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273098752 00000100:00100000:1.0:1746065140.969113:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273098752 00000100:00100000:1.0:1746065140.969218:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30604 00000100:00100000:1.0:1746065140.969225:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273098752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.969239:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.969253:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63ee expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.969275:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 23 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.969285:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.969287:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.969290:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.969310:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 23 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.969320:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 23 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065140.969329:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267753088:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.970563:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.971504:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267753088:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.971526:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.971539:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:1.0:1746065140.971892:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273098752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2667us (3371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.971900:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30604 00000100:00100000:0.0:1746065140.972541:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.972622:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273098880 00000100:00100000:1.0:1746065140.972628:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273098880 00002000:00100000:1.0:1746065140.972654:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012dffed80 x1830881273098880/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065140.972668:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffed80 with x1830881273098880 ext(0->7) 00010000:00010000:1.0:1746065140.972674:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 24 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065140.972683:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 24 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065140.972689:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffed80 00000100:00100000:1.0:1746065140.973669:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3007 00000100:00100000:1.0:1746065140.973677:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2004:x1830881273098880:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065140.975881:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273098880:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2199us (3335us total) trans 4294972130 rc 0/0 00000100:00100000:0.0:1746065140.975891:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3007 00002000:00100000:0.0:1746065140.975899:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012dffed80 x1830881273098880/t4294972130(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 496/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065140.975907:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffed80 with x1830881273098880 ext(0->7) 00010000:00010000:0.0:1746065140.975913:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065140.975934:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065140.975940:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffed80 00000100:00100000:0.0:1746065140.977970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065140.978049:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.978137:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273099008 00000100:00100000:1.0:1746065140.978144:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273099008 00000100:00100000:1.0:1746065140.978189:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30605 00000100:00100000:1.0:1746065140.978196:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1791:x1830881273099008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.978210:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.978230:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63f5 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.978251:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.978258:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.978263:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065140.978267:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.978300:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.978311:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.978320:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd800, rc 0) 00000100:00100000:1.0:1746065140.978350:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273099008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 155us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.978356:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30605 00000100:00100000:3.0:1746065140.978658:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273099136 00000100:00100000:3.0:1746065140.978662:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273099136 00010000:00010000:3.0:1746065140.978677:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065140.978694:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14576 00000100:00100000:3.0:1746065140.978699:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273099136:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.978705:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.978718:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.978726:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.978741:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880476 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63e7 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.978764:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.978765:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.978770:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.978776:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.978793:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.978802:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065140.978811:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267753344:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.978870:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.981053:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267753344:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.981068:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.981127:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273099136:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2427us (3077us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.981135:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14576 00000100:00100000:0.0:1746065140.981562:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.981647:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273099392 00000100:00100000:2.0:1746065140.981652:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273099392 00002000:00100000:2.0:1746065140.981678:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffc000 x1830881273099392/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.981686:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffc000 with x1830881273099392 ext(0->4095) 00010000:00010000:2.0:1746065140.981692:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.981703:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065140.981707:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffc000 00000100:00100000:2.0:1746065140.981730:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3008 00000100:00100000:2.0:1746065140.981735:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273099392:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065140.981826:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273099392:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (264us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.981831:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3008 00002000:00100000:2.0:1746065140.981836:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffc000 x1830881273099392/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.981848:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffc000 with x1830881273099392 ext(0->4095) 00010000:00010000:2.0:1746065140.981852:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065140.981861:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065140.981866:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffc000 00000100:00100000:0.0:1746065140.985174:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.985223:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273099520 00000100:00100000:3.0:1746065140.985230:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273099520 00010000:00010000:3.0:1746065140.985254:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065140.985280:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14577 00000100:00100000:3.0:1746065140.985287:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273099520:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.985298:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.985312:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.985322:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.985339:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88047d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63ee expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.985360:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.985361:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.985368:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.985375:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.985404:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.985415:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267753472:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.985483:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.987306:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267753472:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065140.987317:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.987347:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273099520:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2061us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.987355:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14577 00000100:00100000:1.0:1746065140.990940:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065140.991168:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273099776 00000100:00100000:2.0:1746065140.991181:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273099776 00002000:00100000:2.0:1746065140.991222:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff6d80 x1830881273099776/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.991232:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6d80 with x1830881273099776 ext(0->4095) 00002000:00010000:2.0:1746065140.991241:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff6d80 00000100:00100000:2.0:1746065140.991278:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13744 00000100:00100000:2.0:1746065140.991285:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273099776:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065140.991429:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273099776:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 143us (495us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065140.991435:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13744 00002000:00100000:2.0:1746065140.991440:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff6d80 x1830881273099776/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065140.991452:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6d80 with x1830881273099776 ext(0->4095) 00002000:00010000:2.0:1746065140.991454:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff6d80 00000100:00100000:0.0:1746065140.994216:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.994451:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273099904 00000100:00100000:1.0:1746065140.994458:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273099904 00000100:00100000:1.0:1746065140.994571:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30606 00000100:00100000:1.0:1746065140.994580:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273099904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065140.994598:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.994613:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e63fc expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.994643:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.994650:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.994651:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065140.994655:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.994683:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.994694:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 25 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065140.994704:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267753600:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065140.995664:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.997656:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267753600:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065140.997678:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.997699:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:1.0:1746065140.997730:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273099904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3152us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.997736:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30606 00000100:00100000:0.0:1746065140.998432:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065140.998650:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273100032 00000100:00100000:3.0:1746065140.998656:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273100032 00010000:00010000:3.0:1746065140.998680:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065140.998708:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14578 00000100:00100000:3.0:1746065140.998714:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273100032:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.998723:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.998739:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.998748:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.998765:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880484 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63f5 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065140.998777:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.998779:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.998784:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.998796:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.998821:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.998831:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267753728:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065140.998887:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.999628:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065140.999739:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273100160 00000100:00100000:1.0:1746065140.999744:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273100160 00000100:00100000:1.0:1746065141.000076:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30607 00000100:00100000:1.0:1746065141.000098:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1791:x1830881273100160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.000109:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.000119:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6403 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.000134:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.000140:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.000141:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.000144:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.000158:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.000167:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.000175:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267753856:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.000216:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.001244:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.001380:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267753728:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.001392:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.001455:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273100416 00000100:00100000:2.0:1746065141.001458:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273100416 00002000:00100000:2.0:1746065141.001484:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dfff480 x1830881273100416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.001492:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfff480 with x1830881273100416 ext(0->4095) 00010000:00010000:2.0:1746065141.001497:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.001506:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.001511:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dfff480 00000100:00100000:2.0:1746065141.001522:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3009 00000100:00100000:2.0:1746065141.001527:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273100416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.001615:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273100032:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2901us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.001622:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14578 00000100:00100000:2.0:1746065141.001974:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273100416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 444us (728us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.001979:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3009 00002000:00100000:2.0:1746065141.001985:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dfff480 x1830881273100416/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.001991:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfff480 with x1830881273100416 ext(0->4095) 00010000:00010000:2.0:1746065141.001996:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.002004:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.002053:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267753856:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.002067:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.002247:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:1.0:1746065141.002279:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1791:x1830881273100160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2196us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.002285:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30607 00002000:00010000:2.0:1746065141.002498:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dfff480 00000100:00100000:0.0:1746065141.003579:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.003705:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273100544 00000100:00100000:1.0:1746065141.003710:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273100544 00000100:00100000:1.0:1746065141.003747:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30608 00000100:00100000:1.0:1746065141.003753:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1795:x1830881273100544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.003765:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.003774:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e640a expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.003790:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.003794:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.003800:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.003807:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.003832:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.003841:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.003848:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfcc00, rc 0) 00000100:00100000:1.0:1746065141.003882:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1795:x1830881273100544:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 129us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.003887:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30608 00000100:00100000:0.0:1746065141.003925:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.004006:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273100672 00000100:00100000:3.0:1746065141.004059:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273100672 00010000:00010000:3.0:1746065141.004075:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.004135:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14579 00000100:00100000:3.0:1746065141.004141:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273100672:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.004149:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.004161:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.004174:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.004189:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88048b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e63fc expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.004198:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.004199:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.004205:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.004212:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.004229:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.004238:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.004247:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267754112:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.004301:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.005515:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267754112:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.005525:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.005554:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273100672:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1413us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.005566:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14579 00000100:00100000:0.0:1746065141.006254:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.006313:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273100928 00000100:00100000:2.0:1746065141.006319:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273100928 00002000:00100000:2.0:1746065141.006346:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72a300 x1830881273100928/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.006354:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a300 with x1830881273100928 ext(0->4095) 00010000:00010000:2.0:1746065141.006360:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.006371:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.006376:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72a300 00000100:00100000:2.0:1746065141.006401:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3010 00000100:00100000:2.0:1746065141.006406:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273100928:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.006502:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273100928:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 96us (250us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.006508:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3010 00002000:00100000:2.0:1746065141.006512:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f72a300 x1830881273100928/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.006518:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f72a300 with x1830881273100928 ext(0->4095) 00010000:00010000:2.0:1746065141.006522:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.006533:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.006538:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f72a300 00000100:00100000:0.0:1746065141.008705:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.008753:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273101056 00000100:00100000:3.0:1746065141.008759:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273101056 00010000:00010000:3.0:1746065141.008780:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.008813:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14580 00000100:00100000:3.0:1746065141.008819:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4f95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2004:x1830881273101056:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.008827:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.008841:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.008851:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.008868:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880492 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6403 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.009127:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.009130:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.009137:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.009144:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.009176:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.009187:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267754240:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.009251:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.010482:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267754240:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.010493:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.010513:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4f95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273101056:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1695us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.010521:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14580 00000100:00100000:0.0:1746065141.010854:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.010963:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273101312 00000100:00100000:3.0:1746065141.010968:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273101312 00002000:00100000:3.0:1746065141.010992:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728380 x1830881273101312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.011000:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728380 with x1830881273101312 ext(0->4095) 00002000:00010000:3.0:1746065141.011003:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f728380 00000100:00100000:3.0:1746065141.011186:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13745 00000100:00100000:3.0:1746065141.011193:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273101312:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.011286:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273101312:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 94us (433us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.011292:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13745 00002000:00100000:3.0:1746065141.011297:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728380 x1830881273101312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.011314:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728380 with x1830881273101312 ext(0->4095) 00002000:00010000:3.0:1746065141.011317:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f728380 00000100:00100000:0.0:1746065141.012583:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.012691:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273101440 00000100:00100000:1.0:1746065141.012696:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273101440 00000100:00100000:1.0:1746065141.012783:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30609 00000100:00100000:1.0:1746065141.012789:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273101440:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.012798:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.012811:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6411 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.012834:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.012841:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.012843:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.012846:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.012867:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.012877:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 25 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.012886:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267754368:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.012962:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.015071:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267754368:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.015117:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.015129:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd000, rc 0) 00000100:00100000:1.0:1746065141.015159:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273101440:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2369us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.015161:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.015165:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30609 00000100:00100000:3.0:1746065141.015231:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273101568 00000100:00100000:3.0:1746065141.015237:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273101568 00010000:00010000:3.0:1746065141.015258:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.015287:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14581 00000100:00100000:3.0:1746065141.015293:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273101568:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.015540:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.015557:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.015566:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.015584:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880499 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e640a expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.015649:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.015651:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.015657:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.015664:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.015689:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.015702:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267754496:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.015967:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.018007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.018128:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267754496:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.018142:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.018171:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881273101568:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2878us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.018179:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14581 00000100:00100000:2.0:1746065141.018253:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273101824 00000100:00100000:2.0:1746065141.018259:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273101824 00002000:00100000:2.0:1746065141.018286:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728e00 x1830881273101824/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.018294:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728e00 with x1830881273101824 ext(0->4095) 00002000:00010000:2.0:1746065141.018298:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f728e00 00000100:00100000:2.0:1746065141.018321:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13746 00000100:00100000:2.0:1746065141.018327:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273101824:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.018422:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273101824:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (418us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.018426:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13746 00002000:00100000:2.0:1746065141.018431:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728e00 x1830881273101824/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.018437:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728e00 with x1830881273101824 ext(0->4095) 00002000:00010000:2.0:1746065141.018440:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f728e00 00000100:00100000:0.0:1746065141.020722:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.020765:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273101952 00000100:00100000:1.0:1746065141.020770:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273101952 00000100:00100000:1.0:1746065141.020803:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30610 00000100:00100000:1.0:1746065141.020807:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1795:x1830881273101952:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.020817:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.021012:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6418 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.021036:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.021043:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.021044:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.021047:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.021069:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.021116:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.021129:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267754624:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.021214:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.021565:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.021710:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273102080 00000100:00100000:2.0:1746065141.021714:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273102080 00000100:00100000:2.0:1746065141.021745:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30611 00000100:00100000:2.0:1746065141.021750:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273102080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.021758:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.021764:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e641f expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.021774:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.021777:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 28 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.021781:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.021783:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 28 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.021799:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 28 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.021808:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 28 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.021816:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:2.0:1746065141.021849:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:1791:x1830881273102080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 99us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.021855:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30611 00000100:00100000:1.0:1746065141.022780:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267754624:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.022796:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.022809:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd200, rc 0) 00000100:00100000:1.0:1746065141.022827:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1795:x1830881273101952:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2020us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.022832:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30610 00000100:00100000:0.0:1746065141.023499:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.023550:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273102208 00000100:00100000:3.0:1746065141.023555:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273102208 00010000:00010000:3.0:1746065141.023576:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.023602:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14582 00000100:00100000:3.0:1746065141.023607:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273102208:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.023615:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.023629:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.023638:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.023655:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6411 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.023674:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.023676:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.023681:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.023688:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.023709:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.023718:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.023728:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267754880:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.023786:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.025329:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267754880:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.025342:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.025365:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273102208:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1757us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.025373:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14582 00000100:00100000:0.0:1746065141.025708:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.025814:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273102464 00000100:00100000:3.0:1746065141.025819:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273102464 00002000:00100000:3.0:1746065141.025842:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1ce00 x1830881273102464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.025851:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1ce00 with x1830881273102464 ext(0->4095) 00010000:00010000:3.0:1746065141.025856:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.025871:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.025876:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1ce00 00000100:00100000:3.0:1746065141.025900:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3011 00000100:00100000:3.0:1746065141.025906:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273102464:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.026012:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273102464:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 106us (305us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.026018:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3011 00002000:00100000:3.0:1746065141.026022:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1ce00 x1830881273102464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.026028:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1ce00 with x1830881273102464 ext(0->4095) 00010000:00010000:3.0:1746065141.026032:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.026039:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.026044:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a1ce00 00000100:00100000:0.0:1746065141.027179:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.027221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.027225:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273102592 00000100:00100000:1.0:1746065141.027230:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273102592 00000100:00100000:1.0:1746065141.027252:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30612 00000100:00100000:1.0:1746065141.027257:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273102592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.027265:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.027275:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6426 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.027290:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273102720 00010000:00010000:1.0:1746065141.027292:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746065141.027293:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273102720 00010000:00010000:3.0:1746065141.027305:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.027321:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14583 00000100:00100000:3.0:1746065141.027325:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2004:x1830881273102720:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.027332:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.027493:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 27 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.027501:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065141.027505:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.027515:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.027523:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.027536:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 27 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.027540:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8804a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6418 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.027545:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.027548:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.027550:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.027554:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.027560:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.027568:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfde00, rc 0) 00010000:00010000:3.0:1746065141.027574:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.027582:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 26 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.027591:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267755136:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065141.027599:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273102592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 343us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.027604:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30612 00000100:00100000:3.0:1746065141.027637:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.029520:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267755136:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.029534:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.029569:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273102720:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2242us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.029576:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14583 00000100:00100000:0.0:1746065141.029676:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.030272:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273102976 00000100:00100000:2.0:1746065141.030277:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273102976 00002000:00100000:2.0:1746065141.030300:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c321880 x1830881273102976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.030309:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321880 with x1830881273102976 ext(0->4095) 00010000:00010000:2.0:1746065141.030317:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 26 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.030327:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 26 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.030333:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c321880 00000100:00100000:2.0:1746065141.030638:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3012 00000100:00100000:2.0:1746065141.030645:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273102976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.030856:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273102976:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 211us (1179us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.030862:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3012 00002000:00100000:2.0:1746065141.030867:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c321880 x1830881273102976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.030875:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321880 with x1830881273102976 ext(0->4095) 00010000:00010000:2.0:1746065141.030880:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 26 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.030888:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 26 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.030893:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c321880 00000100:00100000:0.0:1746065141.032320:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.032354:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.032358:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273103104 00000100:00100000:1.0:1746065141.032364:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273103104 00000100:00100000:1.0:1746065141.032402:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30613 00000100:00100000:1.0:1746065141.032409:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1791:x1830881273103104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.032417:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.032429:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e642d expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.032451:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273103232 00010000:00010000:1.0:1746065141.032453:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746065141.032454:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273103232 00010000:00010000:1.0:1746065141.032458:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.032463:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065141.032466:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 28 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.032470:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 28 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.032491:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14584 00010000:00010000:1.0:1746065141.032492:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.032496:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2005:x1830881273103232:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.032501:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 28 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.032502:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.032513:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd000, rc 0) 00010000:00010000:3.0:1746065141.032515:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 28 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.032524:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 28 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.032536:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:1791:x1830881273103104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 128us (219us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065141.032538:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e641f expref: 28 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.032541:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30613 00010000:00010000:3.0:1746065141.032555:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.032557:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.032562:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.032568:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.032586:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.032732:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.032743:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267755392:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.033023:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.035027:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267755392:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.035041:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.035353:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273103232:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2855us (2996us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.035362:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14584 00000100:00100000:0.0:1746065141.035528:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.035737:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273103488 00000100:00100000:3.0:1746065141.035742:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273103488 00002000:00100000:3.0:1746065141.035770:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3e680 x1830881273103488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.035778:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3e680 with x1830881273103488 ext(0->4095) 00010000:00010000:3.0:1746065141.035784:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.035794:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.035799:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3e680 00000100:00100000:3.0:1746065141.035814:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3013 00000100:00100000:3.0:1746065141.035819:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273103488:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.035902:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273103488:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 82us (374us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.035907:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3013 00002000:00100000:3.0:1746065141.035911:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3e680 x1830881273103488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.035925:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3e680 with x1830881273103488 ext(0->4095) 00010000:00010000:3.0:1746065141.035929:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.035936:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.035940:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3e680 00000100:00100000:0.0:1746065141.037263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.037347:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273103616 00000100:00100000:3.0:1746065141.037352:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273103616 00010000:00010000:3.0:1746065141.037368:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.037636:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14585 00000100:00100000:3.0:1746065141.037642:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273103616:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.037651:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.037663:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.037676:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.037691:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6426 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.037824:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.037827:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.037833:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.037839:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.037863:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.037873:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267755520:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.038277:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.039606:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267755520:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.039616:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.039636:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273103616:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1995us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.039641:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14585 00000100:00100000:0.0:1746065141.040621:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.040707:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273103872 00000100:00100000:2.0:1746065141.040713:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273103872 00002000:00100000:2.0:1746065141.040740:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3e300 x1830881273103872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.040754:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3e300 with x1830881273103872 ext(0->4095) 00002000:00010000:2.0:1746065141.040757:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3e300 00000100:00100000:2.0:1746065141.040782:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13747 00000100:00100000:2.0:1746065141.040789:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273103872:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.040874:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273103872:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 85us (253us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.040879:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13747 00002000:00100000:2.0:1746065141.040884:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3e300 x1830881273103872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.040890:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3e300 with x1830881273103872 ext(0->4095) 00002000:00010000:2.0:1746065141.040893:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3e300 00000100:00100000:0.0:1746065141.042221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.042291:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273104000 00000100:00100000:1.0:1746065141.042296:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273104000 00000100:00100000:1.0:1746065141.042321:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30614 00000100:00100000:1.0:1746065141.042326:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273104000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.042335:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.042415:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6434 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.042436:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.042442:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.042444:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.042447:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.042470:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.042480:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 25 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.042495:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267755648:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.042565:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.043836:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267755648:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.043854:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.043864:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00000100:00100000:1.0:1746065141.043888:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273104000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1562us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.043895:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30614 00000100:00100000:0.0:1746065141.044318:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.044386:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273104128 00000100:00100000:3.0:1746065141.044392:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273104128 00010000:00010000:3.0:1746065141.044411:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.044547:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14586 00000100:00100000:3.0:1746065141.044553:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273104128:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.044563:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.044582:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.044591:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.044609:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8804bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e642d expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.044631:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.044633:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.044638:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.044645:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.044667:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.044676:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267755776:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.044728:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.045692:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267755776:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.045701:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.045731:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881273104128:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1178us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.045738:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14586 00000100:00100000:0.0:1746065141.046007:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.046072:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273104384 00000100:00100000:3.0:1746065141.046075:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273104384 00002000:00100000:3.0:1746065141.046122:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3f100 x1830881273104384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.046131:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3f100 with x1830881273104384 ext(0->4095) 00002000:00010000:3.0:1746065141.046134:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3f100 00000100:00100000:3.0:1746065141.046158:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13748 00000100:00100000:3.0:1746065141.046163:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273104384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.046265:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273104384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 101us (258us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.046271:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13748 00002000:00100000:3.0:1746065141.046276:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3f100 x1830881273104384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.046282:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3f100 with x1830881273104384 ext(0->4095) 00002000:00010000:3.0:1746065141.046285:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009de3f100 00000100:00100000:0.0:1746065141.047751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.047840:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273104512 00000100:00100000:1.0:1746065141.047846:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273104512 00000100:00100000:1.0:1746065141.047881:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30615 00000100:00100000:1.0:1746065141.047887:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1795:x1830881273104512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.047896:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.047912:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e643b expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.047942:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.047947:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.047949:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.047951:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.047977:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.047986:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.047995:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267755904:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.048060:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.049328:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267755904:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.049346:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.049357:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfde00, rc 0) 00000100:00100000:1.0:1746065141.049391:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1795:x1830881273104512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1504us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.049398:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30615 00000100:00100000:0.0:1746065141.049694:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.049827:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273104640 00000100:00100000:3.0:1746065141.049831:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273104640 00010000:00010000:3.0:1746065141.049848:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.049867:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14587 00000100:00100000:3.0:1746065141.049871:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4124450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273104640:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.049879:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.049894:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.049902:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.049927:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8804c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6434 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.049949:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.049950:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.049956:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.049962:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.049985:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.049994:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267756032:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.050043:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f810c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.050754:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.050823:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273104768 00000100:00100000:1.0:1746065141.050827:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273104768 00000100:00100000:1.0:1746065141.050966:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30616 00000100:00100000:1.0:1746065141.050972:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1791:x1830881273104768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.050986:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.050995:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6442 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.051042:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.051048:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.051049:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.051052:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.051065:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.051074:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.051249:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267756160:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.051552:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.052017:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267756032:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.052029:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.052057:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4124450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273104640:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2185us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.052064:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14587 00000100:00100000:0.0:1746065141.052563:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.052831:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273105024 00000100:00100000:3.0:1746065141.052835:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273105024 00002000:00100000:3.0:1746065141.052855:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3c000 x1830881273105024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.052863:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3c000 with x1830881273105024 ext(0->4095) 00010000:00010000:3.0:1746065141.052869:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 28 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.052879:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 28 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.052884:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3c000 00000100:00100000:3.0:1746065141.053245:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3014 00000100:00100000:3.0:1746065141.053251:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2004:x1830881273105024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.053600:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2004:x1830881273105024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 348us (1036us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.053606:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3014 00002000:00100000:3.0:1746065141.053611:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009de3c000 x1830881273105024/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.053618:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3c000 with x1830881273105024 ext(0->4095) 00010000:00010000:3.0:1746065141.053622:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 28 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.053631:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 28 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.053636:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009de3c000 00000100:00100000:3.0:1746065141.054276:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267756160:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.054293:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.054303:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc800, rc 0) 00000100:00100000:3.0:1746065141.054324:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273104768:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3353us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.054329:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30616 00000100:00100000:0.0:1746065141.055556:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.055605:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.055669:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273105280 00000100:00100000:2.0:1746065141.055675:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273105280 00010000:00010000:2.0:1746065141.055696:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.055714:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14588 00000100:00100000:2.0:1746065141.055719:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2002:x1830881273105280:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.055728:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.055742:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.055751:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.055770:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8804ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e643b expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.055844:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273105152 00000100:00100000:3.0:1746065141.055848:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273105152 00010000:00010000:2.0:1746065141.055878:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.055880:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.055886:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.055894:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.055930:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.055939:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267756288:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.055994:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.056005:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30617 00000100:00100000:3.0:1746065141.056010:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273105152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.056019:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.056027:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6449 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.056041:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.056046:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.056048:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.056051:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.056065:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.056074:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.056270:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267756416:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.056310:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.059296:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.059315:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273105536 00000100:00100000:2.0:1746065141.059321:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273105536 00002000:00100000:2.0:1746065141.059351:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1880 x1830881273105536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.059361:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1880 with x1830881273105536 ext(0->4095) 00010000:00010000:2.0:1746065141.059367:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.059379:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.059385:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1880 00000100:00100000:0.0:1746065141.059437:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267756416:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065141.059455:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.059467:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:0.0:1746065141.059507:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273105152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3496us (3952us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.059514:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30617 00000100:00100000:3.0:1746065141.059754:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267756288:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.059763:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.059781:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2002:x1830881273105280:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4062us (4176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.059787:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14588 00000100:00100000:2.0:1746065141.060076:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3015 00000100:00100000:2.0:1746065141.060100:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273105536:12345-192.168.202.8@tcp:3:ldlm_bl.0 00000100:00100000:2.0:1746065141.060189:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273105536:12345-192.168.202.8@tcp:3:ldlm_bl.0 Request processed in 90us (899us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.060194:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3015 00002000:00100000:2.0:1746065141.060199:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1880 x1830881273105536/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.060207:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1880 with x1830881273105536 ext(0->4095) 00010000:00010000:2.0:1746065141.060211:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.060219:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.060225:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1880 00000100:00100000:0.0:1746065141.063016:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.063054:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.063120:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273105792 00000100:00100000:3.0:1746065141.063127:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273105792 00010000:00010000:3.0:1746065141.063153:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.063175:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14589 00000100:00100000:3.0:1746065141.063181:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273105792:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.063190:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.063205:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.063220:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.063238:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8804d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6442 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.063262:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.063264:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.063269:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.063275:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.063301:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.063310:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267756544:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.063369:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.063508:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273105664 00000100:00100000:2.0:1746065141.063512:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273105664 00000100:00100000:2.0:1746065141.063806:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30618 00000100:00100000:2.0:1746065141.063811:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1791:x1830881273105664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.063821:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.063830:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6450 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.063846:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.063851:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.063852:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.063855:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.063867:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.063875:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.063881:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267756672:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.063898:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.065855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.065884:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267756672:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.065903:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 27 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.065929:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:2.0:1746065141.065956:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273105664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2144us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.065962:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30618 00000100:00100000:3.0:1746065141.066265:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273106048 00000100:00100000:3.0:1746065141.066271:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273106048 00002000:00100000:3.0:1746065141.066299:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072978700 x1830881273106048/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.066307:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978700 with x1830881273106048 ext(0->4095) 00010000:00010000:3.0:1746065141.066312:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.066328:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.066334:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978700 00000100:00100000:3.0:1746065141.066357:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3016 00000100:00100000:3.0:1746065141.066363:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273106048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.066464:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273106048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 100us (613us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.066469:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3016 00002000:00100000:3.0:1746065141.066474:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072978700 x1830881273106048/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.066481:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072978700 with x1830881273106048 ext(0->4095) 00010000:00010000:3.0:1746065141.066485:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.066494:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.066499:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072978700 00000100:00100000:3.0:1746065141.066523:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267756544:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.066530:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.066560:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273105792:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3379us (3505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.066567:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14589 00000100:00100000:0.0:1746065141.068571:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.068621:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273106176 00000100:00100000:3.0:1746065141.068627:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273106176 00010000:00010000:3.0:1746065141.068657:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.068729:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14590 00000100:00100000:3.0:1746065141.068736:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273106176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.068746:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.068760:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.068769:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.068786:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8804d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6449 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.068798:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.068800:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.068805:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.068811:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.068835:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.068849:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267756800:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.068960:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.070697:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267756800:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.070712:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.070749:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273106176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2012us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.070756:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14590 00000100:00100000:0.0:1746065141.071167:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.071238:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273106432 00000100:00100000:3.0:1746065141.071243:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273106432 00002000:00100000:3.0:1746065141.071269:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea77100 x1830881273106432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.071278:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77100 with x1830881273106432 ext(0->4095) 00002000:00010000:3.0:1746065141.071282:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea77100 00000100:00100000:3.0:1746065141.071306:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13749 00000100:00100000:3.0:1746065141.071312:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273106432:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.071412:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273106432:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 100us (245us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.071421:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13749 00002000:00100000:3.0:1746065141.071426:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea77100 x1830881273106432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.071432:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77100 with x1830881273106432 ext(0->4095) 00002000:00010000:3.0:1746065141.071434:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea77100 00000100:00100000:0.0:1746065141.072617:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.072683:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273106560 00000100:00100000:2.0:1746065141.072687:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273106560 00000100:00100000:2.0:1746065141.072710:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30619 00000100:00100000:2.0:1746065141.072715:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273106560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.072723:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.072737:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6457 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.072757:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.072763:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.072764:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.072767:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.072788:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 25 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.072798:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 25 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.072809:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267756928:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.072871:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.075014:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267756928:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.075035:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.075054:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065141.075106:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273106560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2389us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.075112:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30619 00000100:00100000:0.0:1746065141.075481:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.075988:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273106688 00000100:00100000:3.0:1746065141.075994:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273106688 00010000:00010000:3.0:1746065141.076013:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.076032:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14591 00000100:00100000:3.0:1746065141.076038:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273106688:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.076048:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.076063:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.076073:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.076109:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6450 expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.076129:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.076131:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.076136:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.076144:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.076168:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.076183:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267757056:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.076233:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.078629:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.078713:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273106944 00000100:00100000:2.0:1746065141.078720:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273106944 00002000:00100000:2.0:1746065141.078754:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75c00 x1830881273106944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065141.078762:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267757056:192.168.202.8@tcp:105: 00002000:00100000:2.0:1746065141.078762:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75c00 with x1830881273106944 ext(0->4095) 00002000:00010000:2.0:1746065141.078766:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea75c00 00010000:00010000:3.0:1746065141.078776:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.078784:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13750 00000100:00100000:2.0:1746065141.078790:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273106944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.078804:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881273106688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2767us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.078812:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14591 00000100:00100000:2.0:1746065141.078877:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273106944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 86us (254us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.078882:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13750 00002000:00100000:2.0:1746065141.078887:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea75c00 x1830881273106944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.078894:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75c00 with x1830881273106944 ext(0->4095) 00002000:00010000:2.0:1746065141.078896:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea75c00 00000100:00100000:0.0:1746065141.080554:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.080636:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273107072 00000100:00100000:2.0:1746065141.080641:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273107072 00000100:00100000:2.0:1746065141.080663:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30620 00000100:00100000:2.0:1746065141.080667:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1791:x1830881273107072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.080676:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.080688:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e645e expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.080709:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.080716:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.080717:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.080720:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.080743:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.080753:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.080762:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267757184:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.080819:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.081622:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.081996:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273107200 00000100:00100000:0.0:1746065141.082000:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273107200 00000100:00100000:0.0:1746065141.082030:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30621 00000100:00100000:0.0:1746065141.082035:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1795:x1830881273107200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065141.082043:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.082051:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6465 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.082064:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.082069:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 28 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.082074:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065141.082077:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 28 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.082282:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267757184:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.082296:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 28 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.082451:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 28 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.082492:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:3.0:1746065141.082530:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:1791:x1830881273107072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1861us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.082536:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30620 00010000:00010000:0.0:1746065141.082722:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.082731:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb69600, rc 0) 00000100:00100000:0.0:1746065141.082848:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1795:x1830881273107200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 812us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.082853:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30621 00000100:00100000:2.0:1746065141.082930:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.083232:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273107328 00000100:00100000:0.0:1746065141.083237:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273107328 00010000:00010000:0.0:1746065141.083252:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065141.083387:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14592 00000100:00100000:0.0:1746065141.083394:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273107328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.083403:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065141.083416:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.083482:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.083498:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8804e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6457 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.083520:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.083521:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.083526:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.083533:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.083553:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.083562:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065141.083572:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ea74380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267757440:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065141.084513:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.086521:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ea74380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267757440:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.086539:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.086582:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273107328:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3187us (3651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.086591:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14592 00000100:00100000:0.0:1746065141.086728:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.086942:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273107584 00000100:00100000:2.0:1746065141.086947:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273107584 00002000:00100000:2.0:1746065141.086975:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea74380 x1830881273107584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.086984:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea74380 with x1830881273107584 ext(0->4095) 00010000:00010000:2.0:1746065141.086991:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.087003:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.087008:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea74380 00000100:00100000:2.0:1746065141.087033:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3017 00000100:00100000:2.0:1746065141.087038:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2004:x1830881273107584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.087172:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2004:x1830881273107584:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 133us (443us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.087177:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3017 00002000:00100000:2.0:1746065141.087182:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009ea74380 x1830881273107584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.087189:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea74380 with x1830881273107584 ext(0->4095) 00010000:00010000:2.0:1746065141.087193:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.087201:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.087211:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea74380 00000100:00100000:0.0:1746065141.089726:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.092095:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273107712 00000100:00100000:2.0:1746065141.092106:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273107712 00010000:00010000:2.0:1746065141.092139:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.092165:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14593 00000100:00100000:2.0:1746065141.092170:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273107712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.092181:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.092195:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.092206:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.092224:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f8804ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e645e expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.092245:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.092247:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.092254:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.092262:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.092295:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.092306:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267757568:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.092379:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.094594:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267757568:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.094612:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.094646:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273107712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2475us (4926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.094655:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14593 00000100:00100000:0.0:1746065141.094828:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.094937:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273107968 00000100:00100000:1.0:1746065141.094944:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273107968 00002000:00100000:1.0:1746065141.094973:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fafad80 x1830881273107968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.094982:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafad80 with x1830881273107968 ext(0->4095) 00002000:00010000:1.0:1746065141.094986:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fafad80 00000100:00100000:1.0:1746065141.095018:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13751 00000100:00100000:1.0:1746065141.095024:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273107968:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065141.095259:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273107968:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 235us (431us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.095265:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13751 00002000:00100000:1.0:1746065141.095269:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fafad80 x1830881273107968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.095277:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafad80 with x1830881273107968 ext(0->4095) 00002000:00010000:1.0:1746065141.095280:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fafad80 00000100:00100000:0.0:1746065141.096911:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.097050:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273108096 00000100:00100000:2.0:1746065141.097056:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273108096 00000100:00100000:2.0:1746065141.097117:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30622 00000100:00100000:2.0:1746065141.097123:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273108096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.097197:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.097211:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e646c expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.097234:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.097241:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.097242:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.097245:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.097272:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.097282:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 25 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.097291:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267757696:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.097553:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.098741:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267757696:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.098759:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.098769:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:2.0:1746065141.098792:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273108096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1669us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.098797:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30622 00000100:00100000:0.0:1746065141.099492:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.099541:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273108224 00000100:00100000:2.0:1746065141.099547:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273108224 00010000:00010000:2.0:1746065141.099566:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.099594:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14594 00000100:00100000:2.0:1746065141.099601:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4125450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273108224:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.099610:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.099626:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.099634:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.099648:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69600/0x392ae0376f8804f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6465 expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.099665:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.099666:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.099672:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.099680:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.099702:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.099711:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267757824:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.099750:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.101376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.101444:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267757824:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.101456:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.101480:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4125450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881273108224:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1879us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.101487:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14594 00000100:00100000:1.0:1746065141.101571:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273108480 00000100:00100000:1.0:1746065141.101576:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273108480 00002000:00100000:1.0:1746065141.101604:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938e00 x1830881273108480/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.101612:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938e00 with x1830881273108480 ext(0->4095) 00002000:00010000:1.0:1746065141.101616:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938e00 00000100:00100000:1.0:1746065141.101641:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13752 00000100:00100000:1.0:1746065141.101646:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273108480:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065141.101739:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273108480:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 92us (365us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.101744:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13752 00002000:00100000:1.0:1746065141.101748:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f938e00 x1830881273108480/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.101755:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938e00 with x1830881273108480 ext(0->4095) 00002000:00010000:1.0:1746065141.101757:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938e00 00000100:00100000:0.0:1746065141.103118:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.103264:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273108608 00000100:00100000:2.0:1746065141.103270:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273108608 00000100:00100000:2.0:1746065141.103310:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30623 00000100:00100000:2.0:1746065141.103316:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1795:x1830881273108608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.103326:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.103338:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6473 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.103357:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.103363:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.103364:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.103367:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.103388:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.103399:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 5 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.103409:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267757952:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.103468:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.105752:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.105829:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.105955:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267757952:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.105975:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.105989:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065c00, rc 0) 00000100:00100000:2.0:1746065141.106064:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1795:x1830881273108608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2747us (2947us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.106071:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30623 00000100:00100000:2.0:1746065141.106116:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273108864 00000100:00100000:2.0:1746065141.106121:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273108864 00000100:00100000:2.0:1746065141.106145:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30624 00000100:00100000:2.0:1746065141.106150:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1791:x1830881273108864:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.106160:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.106170:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e647a expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.106187:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.106190:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.106195:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.106198:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.106220:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.106228:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.106234:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065141.106249:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273108864:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 99us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.106257:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30624 00000100:00100000:3.0:1746065141.106331:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273108736 00000100:00100000:3.0:1746065141.106335:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273108736 00010000:00010000:3.0:1746065141.106351:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.106380:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14595 00000100:00100000:3.0:1746065141.106385:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273108736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.106392:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.106407:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.106417:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.106432:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f8804fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e646c expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.106443:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.106444:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.106449:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.106455:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.106472:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.106480:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.106489:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267758208:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.106547:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.108661:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267758208:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.108677:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.108704:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273108736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2319us (2958us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.108714:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14595 00000100:00100000:0.0:1746065141.109618:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.109810:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273109120 00000100:00100000:3.0:1746065141.109816:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273109120 00002000:00100000:3.0:1746065141.109846:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939f80 x1830881273109120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.109855:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939f80 with x1830881273109120 ext(0->4095) 00010000:00010000:3.0:1746065141.109862:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.109874:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.109880:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939f80 00000100:00100000:3.0:1746065141.109903:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3018 00000100:00100000:3.0:1746065141.109909:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2004:x1830881273109120:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.110022:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2004:x1830881273109120:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (405us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.110027:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3018 00002000:00100000:3.0:1746065141.110032:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f939f80 x1830881273109120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.110038:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939f80 with x1830881273109120 ext(0->4095) 00010000:00010000:3.0:1746065141.110042:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.110055:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.110061:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939f80 00000100:00100000:0.0:1746065141.112634:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.112752:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273109248 00000100:00100000:3.0:1746065141.112760:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273109248 00000100:00100000:3.0:1746065141.112804:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30625 00000100:00100000:3.0:1746065141.112811:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273109248:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.112822:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.112835:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6481 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.112854:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.112858:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.112863:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065141.112866:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.112893:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.112903:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.112912:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065141.112963:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273109248:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 152us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.112968:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30625 00000100:00100000:0.0:1746065141.113215:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.113280:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273109376 00000100:00100000:3.0:1746065141.113382:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273109376 00010000:00010000:3.0:1746065141.113396:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.113432:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14596 00000100:00100000:3.0:1746065141.113437:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2002:x1830881273109376:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.113445:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.113460:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.113469:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.113482:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880502 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6473 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.113575:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.113576:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.113582:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.113590:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.113620:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.113630:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.113639:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267758464:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.113699:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.115051:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267758464:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.115063:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.115111:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2002:x1830881273109376:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1673us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.115119:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14596 00000100:00100000:0.0:1746065141.115436:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.115483:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273109632 00000100:00100000:1.0:1746065141.115488:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273109632 00002000:00100000:1.0:1746065141.115512:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3b100 x1830881273109632/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.115521:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3b100 with x1830881273109632 ext(0->4095) 00010000:00010000:1.0:1746065141.115527:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.115538:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.115548:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc3b100 00000100:00100000:1.0:1746065141.115674:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3019 00000100:00100000:1.0:1746065141.115680:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273109632:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065141.115783:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273109632:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (346us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.115788:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3019 00002000:00100000:1.0:1746065141.115792:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3b100 x1830881273109632/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.115799:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3b100 with x1830881273109632 ext(0->4095) 00010000:00010000:1.0:1746065141.115804:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.115812:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.115817:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc3b100 00000100:00100000:0.0:1746065141.117192:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.117227:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.117343:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273109888 00000100:00100000:3.0:1746065141.117348:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273109888 00010000:00010000:3.0:1746065141.117366:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 26 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.117531:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14597 00000100:00100000:2.0:1746065141.117532:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273109760 00000100:00100000:2.0:1746065141.117536:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273109760 00000100:00100000:3.0:1746065141.117537:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273109888:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.117550:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065141.117560:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30626 00010000:00010000:3.0:1746065141.117563:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.117565:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273109760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.117572:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.117574:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.117583:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6488 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.117664:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880509 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e647a expref: 28 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.118140:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.118147:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.118153:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.118156:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 27 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.118164:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.118166:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.118173:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.118181:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.118208:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.118218:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.118226:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.118227:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267758720:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.118233:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.118241:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267758592:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.118293:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.118301:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.123292:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.123398:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273110144 00000100:00100000:1.0:1746065141.123405:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273110144 00000100:00100000:2.0:1746065141.123409:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267758720:192.168.202.8@tcp:104: 00002000:00100000:1.0:1746065141.123439:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc38000 x1830881273110144/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1746065141.123446:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 27 pid: 9635 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746065141.123448:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc38000 with x1830881273110144 ext(0->4095) 00010000:00010000:1.0:1746065141.123454:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.123459:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00010000:00010000:1.0:1746065141.123464:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.123469:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc38000 00000100:00100000:1.0:1746065141.123486:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3020 00000100:00100000:1.0:1746065141.123492:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273110144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.123496:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273109760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5927us (6304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.123502:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30626 00000100:00100000:1.0:1746065141.123583:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273110144:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (299us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.123589:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3020 00002000:00100000:1.0:1746065141.123593:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc38000 x1830881273110144/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.123600:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc38000 with x1830881273110144 ext(0->4095) 00000100:00100000:3.0:1746065141.123703:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267758592:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.123714:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.123733:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273109888:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6196us (6506us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.123740:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14597 00010000:00010000:1.0:1746065141.123864:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.123872:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.123877:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc38000 00000100:00100000:0.0:1746065141.125505:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.125909:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273110272 00000100:00100000:3.0:1746065141.125927:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273110272 00010000:00010000:3.0:1746065141.125955:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.125993:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14598 00000100:00100000:3.0:1746065141.125999:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273110272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.126010:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.126025:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.126035:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.126053:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880510 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6481 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.126065:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.126067:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.126073:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.126113:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.126144:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.126154:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267758848:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.126218:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.128519:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.128634:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267758848:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.128650:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.128682:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273110272:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2683us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.128691:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14598 00000100:00100000:1.0:1746065141.129412:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273110528 00000100:00100000:1.0:1746065141.129418:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273110528 00002000:00100000:1.0:1746065141.129449:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cad80 x1830881273110528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.129463:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cad80 with x1830881273110528 ext(0->4095) 00002000:00010000:1.0:1746065141.129467:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cad80 00000100:00100000:1.0:1746065141.129492:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13753 00000100:00100000:1.0:1746065141.129497:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273110528:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065141.129619:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273110528:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 121us (1106us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.129625:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13753 00002000:00100000:1.0:1746065141.129629:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cad80 x1830881273110528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.129635:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cad80 with x1830881273110528 ext(0->4095) 00002000:00010000:1.0:1746065141.129637:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cad80 00000100:00100000:0.0:1746065141.131754:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.131970:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273110656 00000100:00100000:2.0:1746065141.131977:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273110656 00000100:00100000:2.0:1746065141.132024:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30627 00000100:00100000:2.0:1746065141.132030:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273110656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.132043:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.132057:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e648f expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.132117:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.132124:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.132126:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.132129:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.132151:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.132164:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.132173:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267758976:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.132247:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.133795:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267758976:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.133812:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.133823:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065a00, rc 0) 00000100:00100000:2.0:1746065141.133859:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273110656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1829us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.133865:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30627 00000100:00100000:0.0:1746065141.134707:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.134766:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273110784 00000100:00100000:3.0:1746065141.134772:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273110784 00010000:00010000:3.0:1746065141.134794:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 26 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.134827:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14599 00000100:00100000:3.0:1746065141.134833:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273110784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.134843:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.134858:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 26 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.134868:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 26 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.134885:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880517 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6488 expref: 26 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.134908:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.134910:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.134924:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.134936:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.134960:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.134970:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267759104:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.135027:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.136810:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.136814:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267759104:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.136829:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.136864:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2004:x1830881273110784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2031us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.136872:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14599 00000100:00100000:1.0:1746065141.136946:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273111040 00000100:00100000:1.0:1746065141.136951:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273111040 00002000:00100000:1.0:1746065141.136986:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9f80 x1830881273111040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.136994:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9f80 with x1830881273111040 ext(0->4095) 00002000:00010000:1.0:1746065141.136998:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c9f80 00000100:00100000:1.0:1746065141.137012:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13754 00000100:00100000:1.0:1746065141.137017:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273111040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065141.137175:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273111040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 156us (367us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065141.137181:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13754 00002000:00100000:0.0:1746065141.137188:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9f80 x1830881273111040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.137194:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9f80 with x1830881273111040 ext(0->4095) 00002000:00010000:0.0:1746065141.137197:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c9f80 00000100:00100000:0.0:1746065141.138536:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.138581:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273111168 00000100:00100000:2.0:1746065141.138586:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273111168 00000100:00100000:2.0:1746065141.139342:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30628 00000100:00100000:2.0:1746065141.139351:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:1795:x1830881273111168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.139363:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.139377:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6496 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.139401:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.139408:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.139409:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.139412:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.139439:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.139450:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.139460:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267759232:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.139521:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.140493:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.140749:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273111296 00000100:00100000:3.0:1746065141.140755:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273111296 00000100:00100000:3.0:1746065141.140790:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30629 00000100:00100000:3.0:1746065141.140795:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273111296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.140803:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.140810:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e649d expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.140826:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.140829:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 28 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.140838:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.140840:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 28 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.140859:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 28 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.140869:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 28 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.140876:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065141.140901:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:1791:x1830881273111296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 106us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.140906:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30629 00000100:00100000:2.0:1746065141.142073:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267759232:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.142117:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 27 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.142125:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065c00, rc 0) 00000100:00100000:2.0:1746065141.142150:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1795:x1830881273111168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2801us (3617us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.142156:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30628 00000100:00100000:0.0:1746065141.142480:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.143184:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273111424 00000100:00100000:3.0:1746065141.143190:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273111424 00010000:00010000:3.0:1746065141.143209:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.143241:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14600 00000100:00100000:3.0:1746065141.143247:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273111424:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.143256:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.143270:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.143279:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.143295:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f88051e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e648f expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.143316:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.143318:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.143323:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.143330:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.143352:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 26 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.143362:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 26 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.143372:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267759488:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.143424:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.147550:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267759488:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.147566:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.147613:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273111424:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4365us (5132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.147622:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14600 00000100:00100000:0.0:1746065141.147681:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.148143:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273111680 00000100:00100000:3.0:1746065141.148148:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273111680 00002000:00100000:3.0:1746065141.148175:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130690380 x1830881273111680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.148183:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130690380 with x1830881273111680 ext(0->4095) 00010000:00010000:3.0:1746065141.148189:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.148200:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.148206:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130690380 00000100:00100000:3.0:1746065141.148230:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3021 00000100:00100000:3.0:1746065141.148236:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273111680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.148336:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273111680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 99us (654us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.148341:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3021 00002000:00100000:3.0:1746065141.148346:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130690380 x1830881273111680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.148352:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130690380 with x1830881273111680 ext(0->4095) 00010000:00010000:3.0:1746065141.148356:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.148364:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.148369:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130690380 00000100:00100000:0.0:1746065141.151516:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.152296:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.152373:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273111936 00000100:00100000:3.0:1746065141.152382:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273111936 00010000:00010000:3.0:1746065141.152411:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.152987:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14601 00000100:00100000:3.0:1746065141.152994:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273111936:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.153005:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.153019:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.153030:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.153047:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880525 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6496 expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.153069:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.153071:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.153076:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.153096:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.153119:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.153132:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267759616:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.153186:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.153688:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273111808 00000100:00100000:2.0:1746065141.153693:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273111808 00000100:00100000:2.0:1746065141.153746:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30630 00000100:00100000:2.0:1746065141.153752:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273111808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.153762:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.153772:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64a4 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.153788:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.153793:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.153795:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.153797:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.153812:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 26 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.153821:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.153828:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267759744:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.153862:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.157706:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.157779:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267759616:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.157796:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.157933:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273112192 00000100:00100000:1.0:1746065141.157938:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273112192 00002000:00100000:1.0:1746065141.157973:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130693b80 x1830881273112192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.157987:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130693b80 with x1830881273112192 ext(0->4095) 00010000:00010000:1.0:1746065141.157994:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.158005:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.158011:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130693b80 00000100:00100000:3.0:1746065141.158414:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273111936:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5418us (6116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.158422:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14601 00000100:00100000:3.0:1746065141.158636:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267759744:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.158652:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.158664:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:3.0:1746065141.158686:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273111808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4935us (7177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.158691:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30630 00000100:00100000:1.0:1746065141.158749:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3022 00000100:00100000:1.0:1746065141.158756:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273112192:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065141.158851:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273112192:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (1151us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.158855:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3022 00002000:00100000:1.0:1746065141.158860:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130693b80 x1830881273112192/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.158866:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130693b80 with x1830881273112192 ext(0->4095) 00010000:00010000:1.0:1746065141.158871:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.158879:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 26 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.158884:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130693b80 00000100:00100000:0.0:1746065141.162601:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.162682:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.162741:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273112448 00000100:00100000:2.0:1746065141.162749:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273112448 00000100:00100000:3.0:1746065141.162761:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273112320 00000100:00100000:3.0:1746065141.162765:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273112320 00010000:00010000:2.0:1746065141.162775:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.162791:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30631 00000100:00100000:3.0:1746065141.162797:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273112320:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.162809:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.162821:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64ab expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.162841:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.162846:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.162852:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065141.162855:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 28 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.162884:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.162893:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 28 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.162901:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065141.162954:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:1791:x1830881273112320:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 157us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.162960:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30631 00000100:00100000:2.0:1746065141.163005:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14602 00000100:00100000:2.0:1746065141.163011:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273112448:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.163020:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.163035:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.163045:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.163065:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88052c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e649d expref: 27 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.163077:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.163098:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.163103:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.163109:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.163125:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.163134:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.163143:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267760000:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.163182:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.165186:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.165299:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267760000:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.165312:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.165336:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273112704 00000100:00100000:2.0:1746065141.165338:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273112448:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2328us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.165341:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273112704 00000100:00100000:2.0:1746065141.165346:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14602 00002000:00100000:3.0:1746065141.165370:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091e680 x1830881273112704/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.165379:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091e680 with x1830881273112704 ext(0->4095) 00010000:00010000:3.0:1746065141.165385:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.165396:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.165406:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091e680 00000100:00100000:3.0:1746065141.165433:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3023 00000100:00100000:3.0:1746065141.165439:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273112704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.166035:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273112704:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 595us (854us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.166042:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3023 00002000:00100000:3.0:1746065141.166046:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091e680 x1830881273112704/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.166052:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091e680 with x1830881273112704 ext(0->4095) 00010000:00010000:3.0:1746065141.166057:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.166064:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.166069:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091e680 00000100:00100000:0.0:1746065141.172972:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.173841:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273112832 00000100:00100000:2.0:1746065141.173850:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273112832 00010000:00010000:2.0:1746065141.173876:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.173911:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14603 00000100:00100000:2.0:1746065141.173929:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273112832:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.173940:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.173957:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.173968:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.173987:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880533 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64a4 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.174016:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.174018:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.174024:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.174032:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.174058:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.174067:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267760128:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.174166:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.177716:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267760128:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.177732:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.177800:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273112832:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3870us (4834us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.177809:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14603 00000100:00100000:0.0:1746065141.178267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.178321:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273113088 00000100:00100000:3.0:1746065141.178327:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273113088 00002000:00100000:3.0:1746065141.178357:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091c000 x1830881273113088/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.178366:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091c000 with x1830881273113088 ext(0->4095) 00002000:00010000:3.0:1746065141.178370:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091c000 00000100:00100000:3.0:1746065141.179436:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13755 00000100:00100000:3.0:1746065141.179445:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273113088:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.179565:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2005:x1830881273113088:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 122us (1298us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.179571:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13755 00002000:00100000:3.0:1746065141.179576:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091c000 x1830881273113088/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.179585:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091c000 with x1830881273113088 ext(0->4095) 00002000:00010000:3.0:1746065141.179588:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091c000 00000100:00100000:0.0:1746065141.184219:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.184335:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273113216 00000100:00100000:2.0:1746065141.184343:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273113216 00000100:00100000:2.0:1746065141.184393:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30632 00000100:00100000:2.0:1746065141.184400:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273113216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.184414:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.184429:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64b2 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.184484:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.184491:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.184493:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.184496:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.184520:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 25 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.184530:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 25 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.184545:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267760256:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.184612:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.186377:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267760256:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.186398:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.186410:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065141.186437:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273113216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2038us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.186444:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30632 00000100:00100000:0.0:1746065141.187850:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.187880:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.187947:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273113472 00000100:00100000:3.0:1746065141.187953:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273113472 00000100:00100000:2.0:1746065141.187970:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273113344 00000100:00100000:2.0:1746065141.187974:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273113344 00010000:00010000:2.0:1746065141.187991:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.187996:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30633 00000100:00100000:3.0:1746065141.188004:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273113472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:2.0:1746065141.188074:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14604 00000100:00100000:2.0:1746065141.188098:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2004:x1830881273113344:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.188109:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.188124:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.188134:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.188155:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88053a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ab expref: 27 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.188171:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.188172:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.188178:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.188185:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.188208:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.188218:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267760384:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.188277:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00010000:00010000:3.0:1746065141.188658:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.188669:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64b9 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.188687:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.188693:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.188694:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.188697:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.188713:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.188726:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 5 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.188733:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267760512:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.188759:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.190021:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267760512:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.190040:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.190049:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065141.190119:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273113472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2115us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.190126:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30633 00000100:00100000:0.0:1746065141.190609:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.190634:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273113728 00000100:00100000:0.0:1746065141.190639:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273113728 00002000:00100000:0.0:1746065141.190666:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091f480 x1830881273113728/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.190673:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f480 with x1830881273113728 ext(0->4095) 00010000:00010000:0.0:1746065141.190678:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.190688:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.190693:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091f480 00000100:00100000:0.0:1746065141.190716:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3024 00000100:00100000:0.0:1746065141.190722:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273113728:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065141.190814:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273113728:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 91us (206us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065141.190819:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3024 00002000:00100000:0.0:1746065141.190823:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091f480 x1830881273113728/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.190829:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f480 with x1830881273113728 ext(0->4095) 00010000:00010000:0.0:1746065141.190833:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.190840:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.190844:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091f480 00000100:00100000:2.0:1746065141.191002:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267760384:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.191013:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.191034:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273113344:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2954us (3186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.191040:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14604 00000100:00100000:0.0:1746065141.192667:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.193639:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273113856 00000100:00100000:3.0:1746065141.193647:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273113856 00010000:00010000:3.0:1746065141.193675:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.193711:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14605 00000100:00100000:3.0:1746065141.193718:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273113856:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.193728:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.193742:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.193757:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.193775:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880541 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b2 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.193789:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.193791:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.193797:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.193804:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.193830:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.193841:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267760640:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.193899:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.196494:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.197215:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273114112 00000100:00100000:2.0:1746065141.197222:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273114112 00002000:00100000:2.0:1746065141.197261:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297bb80 x1830881273114112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.197276:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297bb80 with x1830881273114112 ext(0->4095) 00002000:00010000:2.0:1746065141.197280:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007297bb80 00000100:00100000:2.0:1746065141.197304:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13756 00000100:00100000:2.0:1746065141.197311:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273114112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.197413:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:2004:x1830881273114112:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (924us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.197738:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267760640:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.197752:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.197774:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273113856:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4058us (5112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.197782:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14605 00000100:00100000:2.0:1746065141.199367:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13756 00002000:00100000:2.0:1746065141.199377:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007297bb80 x1830881273114112/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.199386:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297bb80 with x1830881273114112 ext(0->4095) 00002000:00010000:2.0:1746065141.199390:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007297bb80 00000100:00100000:0.0:1746065141.214172:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.215477:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273114240 00000100:00100000:3.0:1746065141.215486:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273114240 00000100:00100000:3.0:1746065141.218976:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30634 00000100:00100000:3.0:1746065141.219177:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273114240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.219196:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.219212:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64c0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.219238:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.219245:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.219246:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.219249:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.219275:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 25 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.219285:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 25 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.219296:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267760768:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.219403:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.236152:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267760768:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.236177:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.236197:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065141.236245:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273114240:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 17260us (22080us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.236252:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30634 00010000:00010000:2.0:1746065141.238018:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065141.264576:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.264817:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273114496 00000100:00100000:3.0:1746065141.264825:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273114496 00000100:00100000:3.0:1746065141.265973:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30635 00000100:00100000:3.0:1746065141.265983:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:1791:x1830881273114496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.265999:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.266013:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64c7 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.266036:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.266041:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.266047:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065141.266049:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.266077:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.266101:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.266109:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065141.266156:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:1791:x1830881273114496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 175us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.266166:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30635 00000100:00100000:0.0:1746065141.267623:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.267677:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273114368 00000100:00100000:2.0:1746065141.267684:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273114368 00002000:00100000:2.0:1746065141.267713:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012fbf8000 x1830881273114368/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.267722:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8000 with x1830881273114368 ext(0->7) 00010000:00010000:2.0:1746065141.267729:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.267740:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.267746:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fbf8000 00000100:00100000:2.0:1746065141.267772:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3025 00000100:00100000:2.0:1746065141.267778:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:2005:x1830881273114368:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065141.268481:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:2005:x1830881273114368:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 701us (859us total) trans 4294972131 rc 0/0 00000100:00100000:0.0:1746065141.268488:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3025 00002000:00100000:0.0:1746065141.268493:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88012fbf8000 x1830881273114368/t4294972131(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.268500:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8000 with x1830881273114368 ext(0->7) 00010000:00010000:0.0:1746065141.268505:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 29 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.268515:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 29 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.268521:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fbf8000 00000100:00100000:0.0:1746065141.271459:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.271645:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273114624 00000100:00100000:3.0:1746065141.271653:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273114624 00010000:00010000:3.0:1746065141.271683:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 29 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.271720:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14606 00000100:00100000:3.0:1746065141.271727:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:2004:x1830881273114624:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.271739:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.271754:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 29 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.271765:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 29 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.271783:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880548 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64b9 expref: 29 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.272230:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.272232:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.272240:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.272248:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.272276:0:7200:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.272286:0:7200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 5 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.272297:0:7200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267761024:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.272374:0:7200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.274683:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.274776:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273114880 00000100:00100000:1.0:1746065141.274783:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273114880 00002000:00100000:1.0:1746065141.274817:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfa300 x1830881273114880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.274824:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfa300 with x1830881273114880 ext(0->4095) 00010000:00010000:1.0:1746065141.274831:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.274842:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.274847:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fbfa300 00000100:00100000:1.0:1746065141.274874:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3026 00000100:00100000:1.0:1746065141.274880:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273114880:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065141.274993:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273114880:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 113us (314us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.274999:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3026 00002000:00100000:1.0:1746065141.275004:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfa300 x1830881273114880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.275011:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfa300 with x1830881273114880 ext(0->4095) 00010000:00010000:1.0:1746065141.275014:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.275023:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.275028:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fbfa300 00000100:00100000:3.0:1746065141.275243:0:7200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7200:1830881267761024:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.275256:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065141.278352:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.278443:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273115008 00000100:00100000:0.0:1746065141.278449:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273115008 00010000:00010000:0.0:1746065141.278474:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065141.278496:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14607 00000100:00100000:0.0:1746065141.278501:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273115008:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.278510:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065141.278524:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.278535:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.278552:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88054f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c0 expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.278579:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.278581:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.278587:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 28 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.278594:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 28 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.278619:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 28 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.278628:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267761152:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065141.278681:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.279028:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2004:x1830881273114624:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 7299us (7572us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.279036:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14606 00000100:00100000:2.0:1746065141.279975:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267761152:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.279989:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.280012:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273115008:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1511us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.280019:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14607 00000100:00100000:0.0:1746065141.280372:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.280428:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273115264 00000100:00100000:2.0:1746065141.280433:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273115264 00002000:00100000:2.0:1746065141.280461:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf9c00 x1830881273115264/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.280469:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9c00 with x1830881273115264 ext(0->4095) 00002000:00010000:2.0:1746065141.280473:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf9c00 00000100:00100000:2.0:1746065141.280529:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13757 00000100:00100000:2.0:1746065141.280534:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2005:x1830881273115264:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.283401:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2005:x1830881273115264:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 2859us (3022us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.283410:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13757 00002000:00100000:2.0:1746065141.283419:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009faf9c00 x1830881273115264/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.283428:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf9c00 with x1830881273115264 ext(0->4095) 00002000:00010000:2.0:1746065141.283433:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf9c00 00000100:00100000:0.0:1746065141.287792:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.287970:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273115392 00000100:00100000:3.0:1746065141.287978:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273115392 00000100:00100000:3.0:1746065141.288022:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30636 00000100:00100000:3.0:1746065141.288028:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273115392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.288042:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.288182:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64ce expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.288228:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.288234:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.288236:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.288239:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.288265:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.288276:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.288286:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267761280:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.288591:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.290896:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267761280:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.291074:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.291112:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065141.291144:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273115392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3115us (3357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.291152:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30636 00000100:00100000:0.0:1746065141.291307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.291401:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273115648 00000100:00100000:3.0:1746065141.291406:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273115648 00000100:00100000:3.0:1746065141.291436:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30637 00000100:00100000:3.0:1746065141.291440:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:1791:x1830881273115648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.291450:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.291459:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64d5 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.291473:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.291476:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.291482:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065141.291484:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 29 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.291503:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.291511:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 29 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.291517:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065141.291531:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:1791:x1830881273115648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.291536:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30637 00000100:00100000:0.0:1746065141.292198:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.292728:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273115520 00000100:00100000:2.0:1746065141.292732:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273115520 00010000:00010000:2.0:1746065141.292751:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 29 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.292778:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14608 00000100:00100000:2.0:1746065141.292783:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:2005:x1830881273115520:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.292790:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.292803:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 29 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.292811:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 29 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.292825:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880556 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64c7 expref: 29 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.292845:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.292847:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.292851:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.292858:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.292876:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.292885:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 5 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.292898:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267761536:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.293776:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.298070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.298258:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273115904 00000100:00100000:3.0:1746065141.298266:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273115904 00002000:00100000:3.0:1746065141.298301:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1c00 x1830881273115904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.298310:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1c00 with x1830881273115904 ext(0->4095) 00010000:00010000:3.0:1746065141.298317:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.298330:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.298340:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1c00 00000100:00100000:0.0:1746065141.298580:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267761536:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065141.298593:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065141.298624:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2005:x1830881273115520:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5840us (6440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.298632:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14608 00000100:00100000:3.0:1746065141.301327:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3027 00000100:00100000:3.0:1746065141.301343:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273115904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.301870:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273115904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 531us (3806us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.301876:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3027 00002000:00100000:3.0:1746065141.301884:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a1c00 x1830881273115904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.301892:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a1c00 with x1830881273115904 ext(0->4095) 00010000:00010000:3.0:1746065141.301900:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.301921:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.301927:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a1c00 00000100:00100000:0.0:1746065141.306582:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.306646:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273116032 00000100:00100000:2.0:1746065141.306654:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273116032 00010000:00010000:2.0:1746065141.306682:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.306706:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14609 00000100:00100000:2.0:1746065141.306711:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273116032:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.306722:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.306736:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.306746:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.306762:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f88055d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ce expref: 6 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.306774:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.306776:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.306781:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.306788:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.306812:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.306821:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267761664:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.306888:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.308766:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d4a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267761664:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.308780:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.308807:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273116032:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2096us (2233us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.308816:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14609 00000100:00100000:0.0:1746065141.309926:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.310001:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273116288 00000100:00100000:3.0:1746065141.310007:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273116288 00002000:00100000:3.0:1746065141.310035:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091fb80 x1830881273116288/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.310043:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091fb80 with x1830881273116288 ext(0->4095) 00002000:00010000:3.0:1746065141.310047:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091fb80 00000100:00100000:3.0:1746065141.310105:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13758 00000100:00100000:3.0:1746065141.310113:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2004:x1830881273116288:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.310204:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2004:x1830881273116288:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 92us (294us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.310210:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13758 00002000:00100000:3.0:1746065141.310214:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091fb80 x1830881273116288/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.310220:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091fb80 with x1830881273116288 ext(0->4095) 00002000:00010000:3.0:1746065141.310222:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091fb80 00000100:00100000:0.0:1746065141.315126:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.315169:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273116416 00000100:00100000:1.0:1746065141.315177:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273116416 00000100:00100000:1.0:1746065141.315223:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30638 00000100:00100000:1.0:1746065141.315229:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273116416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.315244:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.315258:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64dc expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.315282:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.315289:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.315291:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.315294:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.315317:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 27 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.315327:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 27 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.315337:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267761792:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.315451:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.316287:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267761792:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.316306:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.316321:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc800, rc 0) 00000100:00100000:1.0:1746065141.316343:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273116416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1115us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.316348:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30638 00000100:00100000:0.0:1746065141.318321:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.318629:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273116544 00000100:00100000:1.0:1746065141.318636:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273116544 00002000:00100000:1.0:1746065141.318667:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a091df80 x1830881273116544/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.318676:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091df80 with x1830881273116544 ext(0->7) 00010000:00010000:1.0:1746065141.318682:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 28 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.318694:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 28 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.318701:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091df80 00000100:00100000:1.0:1746065141.318727:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3028 00000100:00100000:1.0:1746065141.318732:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2004:x1830881273116544:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065141.321812:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881273116544:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 3073us (3489us total) trans 4294972132 rc 0/0 00000100:00100000:0.0:1746065141.321822:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3028 00002000:00100000:0.0:1746065141.321830:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a091df80 x1830881273116544/t4294972132(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.321838:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091df80 with x1830881273116544 ext(0->7) 00010000:00010000:0.0:1746065141.321845:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 30 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.321859:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 30 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.321864:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091df80 00000100:00100000:2.0:1746065141.334245:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.336180:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273116672 00000100:00100000:0.0:1746065141.336191:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273116672 00010000:00010000:0.0:1746065141.336224:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 30 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065141.336268:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14610 00000100:00100000:0.0:1746065141.336276:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2005:x1830881273116672:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.336287:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065141.336302:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 30 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.336313:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 30 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.336332:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880564 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64d5 expref: 30 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.336368:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.336370:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.336377:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.336383:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.336412:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.336423:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbf9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267761920:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065141.336511:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.338872:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.339003:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273116800 00000100:00100000:1.0:1746065141.339010:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273116800 00000100:00100000:2.0:1746065141.339138:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbf9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267761920:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.339156:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.339182:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2005:x1830881273116672:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2908us (4947us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.339190:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14610 00000100:00100000:1.0:1746065141.339365:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30639 00000100:00100000:1.0:1746065141.339372:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:1791:x1830881273116800:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.339385:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.339396:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64e3 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.339415:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.339421:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.339423:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.339425:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 30 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.339443:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.339453:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.339462:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267762048:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.339502:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.340846:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.340893:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273117056 00000100:00100000:2.0:1746065141.340898:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273117056 00002000:00100000:2.0:1746065141.340935:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf9f80 x1830881273117056/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.340945:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf9f80 with x1830881273117056 ext(0->4095) 00010000:00010000:2.0:1746065141.340951:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.340966:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.340971:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fbf9f80 00000100:00100000:1.0:1746065141.341043:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267762048:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.341060:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 30 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.341069:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00000100:00100000:1.0:1746065141.341112:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:1791:x1830881273116800:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1741us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.341117:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30639 00000100:00100000:2.0:1746065141.341348:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3029 00000100:00100000:2.0:1746065141.341355:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273117056:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.341453:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273117056:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (609us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.341460:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3029 00002000:00100000:2.0:1746065141.341464:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf9f80 x1830881273117056/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.343177:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf9f80 with x1830881273117056 ext(0->4095) 00010000:00010000:2.0:1746065141.343186:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.343199:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.343205:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fbf9f80 00000100:00100000:0.0:1746065141.346227:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.348069:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273117184 00000100:00100000:2.0:1746065141.348092:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273117184 00010000:00010000:2.0:1746065141.348125:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.348165:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14611 00000100:00100000:2.0:1746065141.348173:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273117184:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.348185:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.348201:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.348212:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.348231:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88056b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64dc expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.348259:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.348261:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.348267:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 29 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.348275:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 29 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.348304:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 29 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.348315:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267762176:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.348393:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.351563:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.351668:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267762176:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.351683:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.351730:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273117184:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3557us (5509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.351744:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14611 00000100:00100000:3.0:1746065141.352052:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273117440 00000100:00100000:3.0:1746065141.352059:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273117440 00002000:00100000:3.0:1746065141.352116:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9faa00 x1830881273117440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.352125:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9faa00 with x1830881273117440 ext(0->4095) 00002000:00010000:3.0:1746065141.352129:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9faa00 00000100:00100000:3.0:1746065141.352144:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13759 00000100:00100000:3.0:1746065141.352150:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881273117440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.352244:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881273117440:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (688us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.352250:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13759 00002000:00100000:3.0:1746065141.352254:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9faa00 x1830881273117440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.352260:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9faa00 with x1830881273117440 ext(0->4095) 00002000:00010000:3.0:1746065141.352263:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9faa00 00000100:00100000:0.0:1746065141.370475:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.370557:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273117568 00000100:00100000:1.0:1746065141.370566:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273117568 00000100:00100000:1.0:1746065141.370612:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30640 00000100:00100000:1.0:1746065141.370619:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273117568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.370636:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.370650:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64ea expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.370675:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 29 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.370682:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.370683:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.370686:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.370710:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 29 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.370721:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 29 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.370730:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267762304:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.370806:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.379862:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267762304:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.379887:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.379902:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfcc00, rc 0) 00000100:00100000:1.0:1746065141.380516:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273117568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 9547us (9696us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.380537:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30640 00000100:00100000:0.0:1746065141.384576:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.384695:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.384941:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273117824 00000100:00100000:1.0:1746065141.384949:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273117824 00000100:00100000:1.0:1746065141.384994:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30641 00000100:00100000:1.0:1746065141.385000:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:1791:x1830881273117824:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.385014:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.385097:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64f1 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.385118:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.385123:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.385128:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065141.385131:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.385158:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.385167:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.385175:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:1.0:1746065141.385207:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1791:x1830881273117824:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 208us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.385215:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30641 00000100:00100000:2.0:1746065141.386562:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273117696 00000100:00100000:2.0:1746065141.386567:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273117696 00002000:00100000:2.0:1746065141.386593:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88007253c700 x1830881273117696/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.386602:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253c700 with x1830881273117696 ext(0->7) 00010000:00010000:2.0:1746065141.386608:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 31 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.386619:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 31 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.386624:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253c700 00000100:00100000:2.0:1746065141.386648:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3030 00000100:00100000:2.0:1746065141.386653:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2005:x1830881273117696:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065141.389273:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881273117696:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2612us (4570us total) trans 4294972133 rc 0/0 00000100:00100000:0.0:1746065141.389282:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3030 00002000:00100000:0.0:1746065141.389289:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88007253c700 x1830881273117696/t4294972133(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.389303:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253c700 with x1830881273117696 ext(0->7) 00010000:00010000:0.0:1746065141.389310:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.389322:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.389327:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253c700 00000100:00100000:0.0:1746065141.393497:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.393590:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273117952 00000100:00100000:2.0:1746065141.393598:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273117952 00010000:00010000:2.0:1746065141.393627:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.394209:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14612 00000100:00100000:2.0:1746065141.394217:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881273117952:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.394229:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.394246:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.394262:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.394290:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880572 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64e3 expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.394310:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.394312:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.394318:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.394325:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.394352:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.394363:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.394372:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267762560:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.394446:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.397989:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.398114:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267762560:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.398128:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.398161:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881273117952:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3946us (4671us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.398173:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14612 00000100:00100000:1.0:1746065141.398491:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273118208 00000100:00100000:1.0:1746065141.398497:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273118208 00002000:00100000:1.0:1746065141.398527:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253fb80 x1830881273118208/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.398537:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253fb80 with x1830881273118208 ext(0->4095) 00010000:00010000:1.0:1746065141.398543:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.398555:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.398560:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253fb80 00000100:00100000:1.0:1746065141.398770:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3031 00000100:00100000:1.0:1746065141.398777:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273118208:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065141.398869:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273118208:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 93us (889us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.398874:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3031 00002000:00100000:1.0:1746065141.398878:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88007253fb80 x1830881273118208/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.399324:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007253fb80 with x1830881273118208 ext(0->4095) 00010000:00010000:1.0:1746065141.399329:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.399342:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.399347:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007253fb80 00000100:00100000:0.0:1746065141.401720:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.401812:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273118336 00000100:00100000:2.0:1746065141.401819:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273118336 00010000:00010000:2.0:1746065141.401845:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.402049:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14613 00000100:00100000:2.0:1746065141.402056:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273118336:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.402069:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.402167:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.402177:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.402195:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880579 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ea expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.402212:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.402213:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.402219:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.402226:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.402251:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.402261:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267762688:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.402327:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.405377:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267762688:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.405395:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.406028:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273118336:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3970us (4310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.406037:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14613 00000100:00100000:1.0:1746065141.406217:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.406257:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273118592 00000100:00100000:0.0:1746065141.406263:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273118592 00002000:00100000:0.0:1746065141.406292:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4e00 x1830881273118592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.406301:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4e00 with x1830881273118592 ext(0->4095) 00002000:00010000:0.0:1746065141.406305:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff4e00 00000100:00100000:0.0:1746065141.406330:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13760 00000100:00100000:0.0:1746065141.406336:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2005:x1830881273118592:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065141.406723:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2005:x1830881273118592:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 386us (505us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065141.406729:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13760 00002000:00100000:0.0:1746065141.406735:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4e00 x1830881273118592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.406747:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4e00 with x1830881273118592 ext(0->4095) 00002000:00010000:0.0:1746065141.406750:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff4e00 00000100:00100000:0.0:1746065141.409135:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.409178:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273118720 00000100:00100000:1.0:1746065141.409184:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273118720 00000100:00100000:1.0:1746065141.409229:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30642 00000100:00100000:1.0:1746065141.409236:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273118720:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.409250:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.409267:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64f8 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.409294:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.409300:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.409302:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.409305:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.409341:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 31 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.409353:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 31 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.409372:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267762816:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.409457:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.411330:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.411480:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273118848 00000100:00100000:2.0:1746065141.411487:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273118848 00010000:00010000:2.0:1746065141.411511:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 32 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.411544:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14614 00000100:00100000:2.0:1746065141.411550:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881273118848:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.411560:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.411578:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 32 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.411589:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 32 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.411607:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.411609:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.411615:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.411627:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.411651:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.411660:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267762944:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.411715:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00010000:00010000:1.0:1746065141.412390:0:9635:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f880580 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f1 expref: 32 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.412422:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267762816:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.412441:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.412450:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfda00, rc 0) 00000100:00100000:1.0:1746065141.412484:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273118720:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3248us (3356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.412492:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30642 00000100:00100000:2.0:1746065141.413464:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267762944:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.413475:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.413497:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881273118848:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1947us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.413504:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14614 00000100:00100000:0.0:1746065141.414418:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.414778:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273119104 00000100:00100000:2.0:1746065141.414784:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273119104 00002000:00100000:2.0:1746065141.414809:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92a00 x1830881273119104/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.414818:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92a00 with x1830881273119104 ext(0->4095) 00002000:00010000:2.0:1746065141.414821:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c92a00 00000100:00100000:2.0:1746065141.414843:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13761 00000100:00100000:2.0:1746065141.414847:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273119104:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.415021:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273119104:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 172us (604us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.415030:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13761 00002000:00100000:2.0:1746065141.415035:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92a00 x1830881273119104/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.415042:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92a00 with x1830881273119104 ext(0->4095) 00002000:00010000:2.0:1746065141.415045:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c92a00 00000100:00100000:0.0:1746065141.415773:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.415923:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273119232 00000100:00100000:1.0:1746065141.415928:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273119232 00000100:00100000:1.0:1746065141.416413:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30643 00000100:00100000:1.0:1746065141.416420:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:1791:x1830881273119232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.416431:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.416444:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e64ff expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.416466:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.416477:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.416478:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.416481:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.416505:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.416515:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.416525:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267763072:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065141.416766:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.417101:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273119360 00000100:00100000:3.0:1746065141.417106:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273119360 00000100:00100000:3.0:1746065141.417129:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30644 00000100:00100000:3.0:1746065141.417134:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1795:x1830881273119360:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.417141:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.417146:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6506 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.417157:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.417160:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.417165:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.417168:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 34 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.417186:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.417196:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 34 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.417203:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065141.417226:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1795:x1830881273119360:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 92us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.417231:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30644 00000100:00100000:1.0:1746065141.417356:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.421991:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267763072:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.422018:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.422034:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:1.0:1746065141.422133:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1791:x1830881273119232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5713us (6360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.422141:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30643 00000100:00100000:0.0:1746065141.423022:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.423332:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273119488 00000100:00100000:2.0:1746065141.423340:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273119488 00010000:00010000:2.0:1746065141.423365:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.423396:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14615 00000100:00100000:2.0:1746065141.423402:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273119488:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.423412:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.423425:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.423435:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.423453:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f880587 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64f8 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.423468:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.423470:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.423475:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.423487:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.423513:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 32 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.423523:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 32 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.423532:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267763328:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.424375:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff880079e42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.426475:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267763328:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.426489:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.426532:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273119488:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3129us (3511us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.426540:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14615 00000100:00100000:0.0:1746065141.431317:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.431397:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273119744 00000100:00100000:2.0:1746065141.431405:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273119744 00002000:00100000:2.0:1746065141.431441:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92680 x1830881273119744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.431451:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92680 with x1830881273119744 ext(0->4095) 00010000:00010000:2.0:1746065141.431459:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.431472:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.431478:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c92680 00000100:00100000:2.0:1746065141.431494:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3032 00000100:00100000:2.0:1746065141.431500:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881273119744:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.431625:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881273119744:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 124us (314us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.431630:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3032 00002000:00100000:2.0:1746065141.432021:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c92680 x1830881273119744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.432029:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c92680 with x1830881273119744 ext(0->4095) 00010000:00010000:2.0:1746065141.432033:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.432041:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.432046:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c92680 00000100:00100000:0.0:1746065141.441207:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.441634:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273119872 00000100:00100000:2.0:1746065141.441643:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273119872 00010000:00010000:2.0:1746065141.442182:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.442222:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14616 00000100:00100000:2.0:1746065141.442230:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881273119872:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.442242:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.442259:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.442271:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.442291:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f88058e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e64ff expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.442317:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.442320:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.442326:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 32 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.442333:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 32 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.442361:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 32 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.442372:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267763456:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.442450:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.444442:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267763456:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.444456:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.444762:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2005:x1830881273119872:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2532us (3560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.444770:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14616 00000100:00100000:0.0:1746065141.445628:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.445719:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273120128 00000100:00100000:2.0:1746065141.445726:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273120128 00002000:00100000:2.0:1746065141.445755:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c93800 x1830881273120128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.445764:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c93800 with x1830881273120128 ext(0->4095) 00002000:00010000:2.0:1746065141.445768:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c93800 00000100:00100000:2.0:1746065141.445782:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13762 00000100:00100000:2.0:1746065141.445788:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881273120128:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.445900:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881273120128:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 111us (273us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.445906:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13762 00002000:00100000:2.0:1746065141.445922:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c93800 x1830881273120128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.445929:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c93800 with x1830881273120128 ext(0->4095) 00002000:00010000:2.0:1746065141.445932:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c93800 00000100:00100000:0.0:1746065141.450472:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.450633:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273120256 00000100:00100000:1.0:1746065141.450641:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273120256 00000100:00100000:1.0:1746065141.450688:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30645 00000100:00100000:1.0:1746065141.450695:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273120256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.450712:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.450726:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e650d expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.450748:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 31 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.450754:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.450756:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.450758:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.450780:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 31 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.451638:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 31 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.451652:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267763584:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.455242:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.459697:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267763584:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.459724:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.459740:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc800, rc 0) 00000100:00100000:1.0:1746065141.459775:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273120256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 9079us (9310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.459785:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30645 00000100:00100000:0.0:1746065141.461987:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.462190:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273120384 00000100:00100000:2.0:1746065141.462197:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273120384 00002000:00100000:2.0:1746065141.462229:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f84b800 x1830881273120384/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.462237:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84b800 with x1830881273120384 ext(0->7) 00010000:00010000:2.0:1746065141.462243:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 32 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.462255:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 32 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.462265:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f84b800 00000100:00100000:2.0:1746065141.462285:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3033 00000100:00100000:2.0:1746065141.462291:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2004:x1830881273120384:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065141.463202:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273120384:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 909us (1217us total) trans 4294972134 rc 0/0 00000100:00100000:0.0:1746065141.463208:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3033 00002000:00100000:0.0:1746065141.463213:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f84b800 x1830881273120384/t4294972134(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.463219:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84b800 with x1830881273120384 ext(0->7) 00010000:00010000:0.0:1746065141.463224:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 34 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.463232:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 34 pid: 9558 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.463241:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f84b800 00000100:00100000:0.0:1746065141.467694:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.470995:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273120512 00000100:00100000:3.0:1746065141.471013:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273120512 00010000:00010000:3.0:1746065141.471058:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 34 pid: 9558 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.471145:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14617 00000100:00100000:3.0:1746065141.471157:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2003:x1830881273120512:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.471169:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.471192:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 34 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.471202:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 34 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.471225:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880595 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6506 expref: 34 pid: 9558 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.471252:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.471253:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.471260:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.471267:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.471294:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.471305:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267763712:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.471390:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.478168:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.478197:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273120768 00000100:00100000:0.0:1746065141.478204:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273120768 00002000:00100000:0.0:1746065141.478239:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549dc00 x1830881273120768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.478248:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549dc00 with x1830881273120768 ext(0->4095) 00002000:00010000:0.0:1746065141.478253:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549dc00 00000100:00100000:0.0:1746065141.478271:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13763 00000100:00100000:0.0:1746065141.478278:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273120768:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746065141.478394:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273120768:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 117us (234us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065141.478400:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13763 00002000:00100000:0.0:1746065141.478405:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549dc00 x1830881273120768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.478412:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549dc00 with x1830881273120768 ext(0->4095) 00002000:00010000:0.0:1746065141.478415:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549dc00 00000100:00100000:3.0:1746065141.478956:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267763712:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.478972:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.479004:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2003:x1830881273120512:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 7853us (11317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.479012:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14617 00000100:00100000:0.0:1746065141.480496:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.480776:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273120896 00000100:00100000:1.0:1746065141.480782:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273120896 00000100:00100000:1.0:1746065141.480896:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30646 00000100:00100000:1.0:1746065141.480904:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1795:x1830881273120896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.480924:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.480938:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6514 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.480960:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.480966:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.480967:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.480970:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.480994:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.481003:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.481013:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267763840:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.483436:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.487527:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267763840:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.487554:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.487567:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfde00, rc 0) 00000100:00100000:1.0:1746065141.487598:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1795:x1830881273120896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6695us (7105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.487605:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30646 00000100:00100000:0.0:1746065141.488325:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.488361:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.488379:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273121024 00000100:00100000:3.0:1746065141.488385:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273121024 00010000:00010000:3.0:1746065141.488412:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.488445:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14618 00000100:00100000:3.0:1746065141.488451:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273121024:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.488461:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.488475:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.488484:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.488501:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f88059c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e650d expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.488516:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.488518:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.488523:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.488530:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.488554:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.488563:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267763968:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.488626:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.489054:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273121152 00000100:00100000:1.0:1746065141.489057:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273121152 00000100:00100000:1.0:1746065141.489109:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30647 00000100:00100000:1.0:1746065141.489114:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1791:x1830881273121152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.489125:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.489179:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e651b expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.489194:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.489199:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.489200:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.489203:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.489217:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.489226:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.489234:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267764096:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.489260:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.490280:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267763968:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.490292:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.490329:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273121024:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1878us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.490337:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14618 00000100:00100000:0.0:1746065141.490448:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.490510:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273121408 00000100:00100000:2.0:1746065141.490515:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273121408 00002000:00100000:2.0:1746065141.490543:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549fb80 x1830881273121408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.490552:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549fb80 with x1830881273121408 ext(0->4095) 00010000:00010000:2.0:1746065141.490557:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 36 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.490567:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 36 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.490573:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549fb80 00000100:00100000:2.0:1746065141.490598:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3034 00000100:00100000:2.0:1746065141.490604:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2005:x1830881273121408:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.490699:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2005:x1830881273121408:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 95us (250us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.490704:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3034 00002000:00100000:2.0:1746065141.490708:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549fb80 x1830881273121408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.490716:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549fb80 with x1830881273121408 ext(0->4095) 00010000:00010000:2.0:1746065141.490721:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 36 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.490729:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 36 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.490734:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549fb80 00000100:00100000:1.0:1746065141.491670:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267764096:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.491685:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.491694:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00000100:00100000:1.0:1746065141.491748:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1791:x1830881273121152:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2633us (3385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.491754:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30647 00000100:00100000:0.0:1746065141.492246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.492327:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273121536 00000100:00100000:1.0:1746065141.492331:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273121536 00000100:00100000:1.0:1746065141.492358:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30648 00000100:00100000:1.0:1746065141.492364:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273121536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.492372:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.492381:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6522 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.492394:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.492397:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.492402:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065141.492405:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.492427:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.492434:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.492440:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd200, rc 0) 00000100:00100000:1.0:1746065141.492466:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273121536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 103us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.492471:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30648 00000100:00100000:0.0:1746065141.493289:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.493373:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273121664 00000100:00100000:3.0:1746065141.493377:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273121664 00010000:00010000:3.0:1746065141.493396:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.493411:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14619 00000100:00100000:3.0:1746065141.493415:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881273121664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.493425:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.493437:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.493446:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.493460:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfde00/0x392ae0376f8805a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6514 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.493777:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.493779:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.493784:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.493791:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.493811:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.493821:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.493831:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267764352:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.493889:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.494828:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267764352:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.494838:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.494857:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273121664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1441us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.494864:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14619 00000100:00100000:0.0:1746065141.495743:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.495805:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273121920 00000100:00100000:2.0:1746065141.495810:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273121920 00002000:00100000:2.0:1746065141.495834:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549f800 x1830881273121920/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.495842:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549f800 with x1830881273121920 ext(0->4095) 00010000:00010000:2.0:1746065141.495848:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.495858:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.495863:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549f800 00000100:00100000:2.0:1746065141.495875:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3035 00000100:00100000:2.0:1746065141.495880:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273121920:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.495998:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273121920:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 116us (255us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.496003:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3035 00002000:00100000:2.0:1746065141.496008:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549f800 x1830881273121920/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.496020:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549f800 with x1830881273121920 ext(0->4095) 00010000:00010000:2.0:1746065141.496024:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.496032:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.496037:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549f800 00000100:00100000:0.0:1746065141.497191:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.497233:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.497304:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273122048 00000100:00100000:2.0:1746065141.497309:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273122048 00000100:00100000:2.0:1746065141.497339:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30649 00000100:00100000:2.0:1746065141.497344:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1791:x1830881273122048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.497352:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.497363:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6529 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.497379:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.497383:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.497387:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065141.497390:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 35 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.497416:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.497428:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 35 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.497436:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065141.497466:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1791:x1830881273122048:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 122us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.497471:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30649 00000100:00100000:3.0:1746065141.497528:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273122176 00000100:00100000:3.0:1746065141.497534:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273122176 00010000:00010000:3.0:1746065141.497548:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.497611:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14620 00000100:00100000:3.0:1746065141.497617:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2005:x1830881273122176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.497625:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.497663:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.497672:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.497684:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8805aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e651b expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.497695:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.497696:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.497701:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.497707:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.497724:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.497732:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.497745:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267764608:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.497798:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.499761:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267764608:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.499775:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.499815:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2005:x1830881273122176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2196us (2580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.499822:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14620 00000100:00100000:0.0:1746065141.499954:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.500203:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273122432 00000100:00100000:2.0:1746065141.500208:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273122432 00002000:00100000:2.0:1746065141.500232:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3b80 x1830881273122432/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.500240:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3b80 with x1830881273122432 ext(0->4095) 00010000:00010000:2.0:1746065141.500247:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.500256:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.500261:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3b80 00000100:00100000:2.0:1746065141.500273:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3036 00000100:00100000:2.0:1746065141.500278:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273122432:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.500361:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273122432:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 83us (407us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.500365:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3036 00002000:00100000:2.0:1746065141.500370:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3b80 x1830881273122432/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.500376:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3b80 with x1830881273122432 ext(0->4095) 00010000:00010000:2.0:1746065141.500380:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.500387:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.500391:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3b80 00000100:00100000:0.0:1746065141.505274:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.505327:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273122560 00000100:00100000:2.0:1746065141.505334:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273122560 00010000:00010000:2.0:1746065141.505361:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.505381:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14621 00000100:00100000:2.0:1746065141.505386:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273122560:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.505396:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.505410:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.505420:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.505436:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6522 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.505451:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.505453:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.505458:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.505464:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.505488:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.505496:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267764736:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.505539:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.508661:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267764736:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.508678:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.508708:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273122560:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3321us (3440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.508717:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14621 00000100:00100000:0.0:1746065141.509508:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.509605:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273122816 00000100:00100000:2.0:1746065141.509611:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273122816 00002000:00100000:2.0:1746065141.509640:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0a80 x1830881273122816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.509649:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0a80 with x1830881273122816 ext(0->4095) 00002000:00010000:2.0:1746065141.509653:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f0a80 00000100:00100000:2.0:1746065141.509676:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13764 00000100:00100000:2.0:1746065141.509682:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273122816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.509819:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273122816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 136us (311us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.509825:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13764 00002000:00100000:2.0:1746065141.509830:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0a80 x1830881273122816/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.509836:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0a80 with x1830881273122816 ext(0->4095) 00002000:00010000:2.0:1746065141.509838:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f0a80 00000100:00100000:0.0:1746065141.511224:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.511321:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273122944 00000100:00100000:1.0:1746065141.511326:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273122944 00000100:00100000:1.0:1746065141.511401:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30650 00000100:00100000:1.0:1746065141.511406:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273122944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.511416:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.511430:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6530 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.511449:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.511455:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.511456:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.511459:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.511484:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 33 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.511494:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 33 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.511504:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267764864:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.513999:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.515856:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267764864:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.515878:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.515891:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfcc00, rc 0) 00000100:00100000:1.0:1746065141.515931:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273122944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4524us (4708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.515937:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30650 00000100:00100000:0.0:1746065141.516643:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.516707:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273123072 00000100:00100000:2.0:1746065141.516714:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273123072 00010000:00010000:2.0:1746065141.516735:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 34 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.516752:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14622 00000100:00100000:2.0:1746065141.516757:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2005:x1830881273123072:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.516766:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.516780:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 34 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.516789:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 34 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.516807:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8805b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6529 expref: 34 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.516829:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.516831:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.516837:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.516844:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.516868:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.516878:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267764992:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.516943:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007c001000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.518676:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.520781:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273123200 00000100:00100000:1.0:1746065141.520789:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273123200 00000100:00100000:1.0:1746065141.520838:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30651 00000100:00100000:1.0:1746065141.520845:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1791:x1830881273123200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.520860:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.520874:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6537 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.520896:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.520903:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.520905:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.520908:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.520941:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.520952:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.520962:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267765120:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.521019:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.521509:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267764992:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.521524:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.521543:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2005:x1830881273123072:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4786us (4901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.521551:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14622 00000100:00100000:3.0:1746065141.521684:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.521751:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273123456 00000100:00100000:0.0:1746065141.521755:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273123456 00002000:00100000:0.0:1746065141.521776:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e888000 x1830881273123456/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.521785:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e888000 with x1830881273123456 ext(0->4095) 00010000:00010000:0.0:1746065141.521790:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.521799:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.521804:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e888000 00000100:00100000:0.0:1746065141.522254:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3037 00000100:00100000:0.0:1746065141.522260:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273123456:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065141.522344:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273123456:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 84us (660us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065141.522350:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3037 00002000:00100000:0.0:1746065141.522355:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e888000 x1830881273123456/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.522363:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e888000 with x1830881273123456 ext(0->4095) 00010000:00010000:0.0:1746065141.522367:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.522376:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.522381:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e888000 00000100:00100000:1.0:1746065141.523853:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267765120:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.523873:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.523884:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfda00, rc 0) 00000100:00100000:1.0:1746065141.523902:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1791:x1830881273123200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3058us (5230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.523908:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30651 00000100:00100000:0.0:1746065141.525765:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.525805:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.526220:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273123584 00000100:00100000:1.0:1746065141.526227:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273123584 00000100:00100000:1.0:1746065141.526656:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30652 00000100:00100000:1.0:1746065141.526664:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:1795:x1830881273123584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.526678:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.526690:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e653e expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.526709:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.526713:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.526719:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.526722:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.526747:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.526756:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 35 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.526763:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:1.0:1746065141.526787:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1795:x1830881273123584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 124us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.526792:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30652 00000100:00100000:2.0:1746065141.527065:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273123712 00000100:00100000:2.0:1746065141.527069:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273123712 00010000:00010000:2.0:1746065141.527098:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.527123:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14623 00000100:00100000:2.0:1746065141.527129:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273123712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.527136:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.527150:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.527164:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.527179:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8805bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6530 expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.527885:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.527888:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.527895:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.527903:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.527933:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.527944:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.527953:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267765376:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.528008:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.535431:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.535567:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267765376:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.535584:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.535832:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273123712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 8702us (10025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.535846:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14623 00000100:00100000:3.0:1746065141.536006:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273123968 00000100:00100000:3.0:1746065141.536011:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273123968 00002000:00100000:3.0:1746065141.536041:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4380 x1830881273123968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.536050:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4380 with x1830881273123968 ext(0->4095) 00010000:00010000:3.0:1746065141.536057:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.536070:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.536076:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff4380 00000100:00100000:3.0:1746065141.536117:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3038 00000100:00100000:3.0:1746065141.536124:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881273123968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.536210:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881273123968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 88us (786us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.536219:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3038 00002000:00100000:3.0:1746065141.536224:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4380 x1830881273123968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.536231:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4380 with x1830881273123968 ext(0->4095) 00010000:00010000:3.0:1746065141.536236:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.536245:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.536250:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff4380 00000100:00100000:0.0:1746065141.546452:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.546826:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273124096 00000100:00100000:2.0:1746065141.546834:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273124096 00010000:00010000:2.0:1746065141.546863:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.549373:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14624 00000100:00100000:2.0:1746065141.549387:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881273124096:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.549402:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.549422:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.549435:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.549453:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8805c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6537 expref: 35 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.549485:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.549488:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.549493:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.549501:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.549527:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.549538:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267765504:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.549613:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.551585:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267765504:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.551602:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.551869:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273124096:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2486us (5424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.551877:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14624 00000100:00100000:0.0:1746065141.555577:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.556125:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273124352 00000100:00100000:1.0:1746065141.556132:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273124352 00002000:00100000:1.0:1746065141.556169:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f2d80 x1830881273124352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.556179:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2d80 with x1830881273124352 ext(0->4095) 00002000:00010000:1.0:1746065141.556184:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f2d80 00000100:00100000:1.0:1746065141.556215:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13765 00000100:00100000:1.0:1746065141.556222:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273124352:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065141.556325:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273124352:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (754us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.556331:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13765 00002000:00100000:1.0:1746065141.556336:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f2d80 x1830881273124352/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.556343:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f2d80 with x1830881273124352 ext(0->4095) 00002000:00010000:1.0:1746065141.556346:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f2d80 00000100:00100000:0.0:1746065141.557728:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.558167:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273124480 00000100:00100000:3.0:1746065141.558173:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273124480 00000100:00100000:3.0:1746065141.558210:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30653 00000100:00100000:3.0:1746065141.558215:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273124480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.558226:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.558240:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6545 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.558259:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.558266:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.558267:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.558270:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.558296:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.558306:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.558316:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267765632:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.558380:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.560071:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.560160:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267765632:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.560178:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.560190:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065141.560215:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273124480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2000us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.560222:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30653 00000100:00100000:2.0:1746065141.560225:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273124608 00000100:00100000:2.0:1746065141.560230:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273124608 00010000:00010000:2.0:1746065141.560247:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.560273:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14625 00000100:00100000:2.0:1746065141.560278:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2005:x1830881273124608:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.560287:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.560301:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.560310:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.560325:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8805cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e653e expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.560338:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.560340:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.560345:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.560352:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.560373:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.560381:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267765760:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.560419:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.565608:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267765760:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.565627:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.565670:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2005:x1830881273124608:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5390us (5600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.565679:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14625 00000100:00100000:0.0:1746065141.566962:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.567301:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273124864 00000100:00100000:3.0:1746065141.567308:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273124864 00002000:00100000:3.0:1746065141.567342:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0e00 x1830881273124864/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.567352:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0e00 with x1830881273124864 ext(0->4095) 00002000:00010000:3.0:1746065141.567356:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f0e00 00000100:00100000:3.0:1746065141.567382:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13766 00000100:00100000:3.0:1746065141.567389:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273124864:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.567500:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273124864:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 111us (540us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.567506:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13766 00002000:00100000:3.0:1746065141.567510:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0e00 x1830881273124864/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.567517:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0e00 with x1830881273124864 ext(0->4095) 00002000:00010000:3.0:1746065141.567520:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306f0e00 00000100:00100000:0.0:1746065141.568664:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.568728:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273124992 00000100:00100000:3.0:1746065141.568731:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273124992 00000100:00100000:3.0:1746065141.568761:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30654 00000100:00100000:3.0:1746065141.568767:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1791:x1830881273124992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.568776:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.568790:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e654c expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.568810:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.568817:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.568818:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.568821:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 34 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.568845:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.568859:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.568869:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267765888:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.568928:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.570116:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.570166:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273125120 00000100:00100000:1.0:1746065141.570170:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273125120 00000100:00100000:1.0:1746065141.570241:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30655 00000100:00100000:1.0:1746065141.570247:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1795:x1830881273125120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.570254:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.570262:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6553 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.570276:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.570280:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 36 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.570286:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.570289:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 36 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.570312:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 36 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.570322:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 36 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.570330:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd200, rc 0) 00000100:00100000:1.0:1746065141.570350:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:1795:x1830881273125120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 104us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.570355:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30655 00000100:00100000:3.0:1746065141.575100:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267765888:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065141.575135:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.575529:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273125248 00000100:00100000:2.0:1746065141.575535:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273125248 00010000:00010000:2.0:1746065141.575562:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.575590:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14626 00000100:00100000:2.0:1746065141.575596:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273125248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.575606:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.575620:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.575632:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.575649:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8805d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6545 expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.575675:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.575677:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.575684:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.575691:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.575715:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.575725:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.575734:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267766144:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.575794:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065141.575993:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.576003:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065141.576028:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1791:x1830881273124992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7261us (7365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.576035:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30654 00000100:00100000:3.0:1746065141.577219:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267766144:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.577231:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.577252:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273125248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1656us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.577258:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14626 00000100:00100000:0.0:1746065141.577851:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.578110:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273125504 00000100:00100000:3.0:1746065141.578115:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273125504 00002000:00100000:3.0:1746065141.578141:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5500 x1830881273125504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.578149:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5500 with x1830881273125504 ext(0->4095) 00010000:00010000:3.0:1746065141.578156:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.578166:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.578171:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a5500 00000100:00100000:3.0:1746065141.578464:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3039 00000100:00100000:3.0:1746065141.578471:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881273125504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.578713:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881273125504:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 242us (862us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.578719:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3039 00002000:00100000:3.0:1746065141.578724:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5500 x1830881273125504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.578731:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5500 with x1830881273125504 ext(0->4095) 00010000:00010000:3.0:1746065141.578735:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.578743:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.578748:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a5500 00000100:00100000:0.0:1746065141.583295:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.583414:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273125632 00000100:00100000:3.0:1746065141.583421:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273125632 00010000:00010000:3.0:1746065141.583451:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.583493:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14627 00000100:00100000:3.0:1746065141.583500:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2003:x1830881273125632:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.583511:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.583526:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.583536:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.583554:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8805db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e654c expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.583570:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.583572:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.583577:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.583584:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.583610:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 34 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.583620:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267766272:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.583688:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.587030:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.587601:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273125888 00000100:00100000:2.0:1746065141.587610:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273125888 00002000:00100000:2.0:1746065141.587644:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a7800 x1830881273125888/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.587659:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7800 with x1830881273125888 ext(0->4095) 00002000:00010000:2.0:1746065141.587664:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a7800 00000100:00100000:2.0:1746065141.587683:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13767 00000100:00100000:2.0:1746065141.587689:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2005:x1830881273125888:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.587791:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2005:x1830881273125888:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 102us (767us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.587798:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13767 00002000:00100000:2.0:1746065141.587803:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a7800 x1830881273125888/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.587809:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a7800 with x1830881273125888 ext(0->4095) 00002000:00010000:2.0:1746065141.587812:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a7800 00000100:00100000:3.0:1746065141.587922:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267766272:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.587938:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.587961:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2003:x1830881273125632:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4462us (4674us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.587968:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14627 00000100:00100000:0.0:1746065141.589844:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.589972:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273126016 00000100:00100000:3.0:1746065141.589978:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273126016 00000100:00100000:3.0:1746065141.590021:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30656 00000100:00100000:3.0:1746065141.590027:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273126016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.590038:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.590051:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e655a expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.590072:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.590078:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.590100:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.590104:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.590127:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 33 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.590137:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 33 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.590148:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267766400:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.590219:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.591994:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.592048:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273126144 00000100:00100000:2.0:1746065141.592054:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273126144 00010000:00010000:2.0:1746065141.592076:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.592132:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14628 00000100:00100000:2.0:1746065141.592138:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273126144:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.592148:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.592164:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.592173:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.592185:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267766400:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.592189:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd200/0x392ae0376f8805e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6553 expref: 34 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.592202:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.592211:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.592212:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.592217:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.592224:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.592313:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:3.0:1746065141.592380:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273126016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2352us (2541us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.592387:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30656 00010000:00010000:2.0:1746065141.592614:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.592627:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267766528:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.592679:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.594767:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267766528:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.594781:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.594805:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881273126144:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2667us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.594812:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14628 00000100:00100000:0.0:1746065141.595665:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.595852:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273126400 00000100:00100000:1.0:1746065141.595857:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273126400 00002000:00100000:1.0:1746065141.595886:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130179c00 x1830881273126400/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.595895:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130179c00 with x1830881273126400 ext(0->4095) 00002000:00010000:1.0:1746065141.595899:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130179c00 00000100:00100000:1.0:1746065141.595927:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13768 00000100:00100000:1.0:1746065141.595933:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273126400:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065141.596038:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273126400:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 105us (374us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.596044:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13768 00002000:00100000:1.0:1746065141.596049:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130179c00 x1830881273126400/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.596061:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130179c00 with x1830881273126400 ext(0->4095) 00002000:00010000:1.0:1746065141.596064:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130179c00 00000100:00100000:0.0:1746065141.601686:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.601893:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273126528 00000100:00100000:3.0:1746065141.601901:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273126528 00000100:00100000:3.0:1746065141.601945:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30657 00000100:00100000:3.0:1746065141.601952:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:1791:x1830881273126528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.601968:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.601982:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6561 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.602004:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.602010:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.602011:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.602014:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 34 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.602036:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.602051:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.602061:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267766656:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.602508:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.604540:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.604807:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273126656 00000100:00100000:2.0:1746065141.604815:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273126656 00000100:00100000:2.0:1746065141.604896:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30658 00000100:00100000:2.0:1746065141.604903:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1795:x1830881273126656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.604928:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.604941:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6568 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.604962:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.604966:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 36 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.604971:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.604974:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 36 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.605001:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 36 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.605538:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267766656:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.605553:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 36 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.605662:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 36 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.605673:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065141.605703:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:1795:x1830881273126656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 801us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.605709:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30658 00010000:00010000:3.0:1746065141.605759:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065141.605775:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1791:x1830881273126528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3823us (4096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.605780:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30657 00000100:00100000:0.0:1746065141.606511:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.606570:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273126784 00000100:00100000:2.0:1746065141.606575:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273126784 00010000:00010000:2.0:1746065141.606592:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.606655:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14629 00000100:00100000:2.0:1746065141.606662:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273126784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.606669:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.606683:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.606691:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.606706:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8805e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e655a expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.607226:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.607229:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.607235:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 34 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.607242:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 34 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.607264:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 34 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.607272:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 34 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.607282:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267766912:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.608438:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.615927:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267766912:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.615944:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.615975:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273126784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 9313us (9464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.615983:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14629 00000100:00100000:0.0:1746065141.619028:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.619176:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273127040 00000100:00100000:2.0:1746065141.619184:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273127040 00002000:00100000:2.0:1746065141.619220:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017a300 x1830881273127040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.619229:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017a300 with x1830881273127040 ext(0->4095) 00010000:00010000:2.0:1746065141.619236:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.619249:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.619255:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017a300 00000100:00100000:2.0:1746065141.619274:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3040 00000100:00100000:2.0:1746065141.619280:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2005:x1830881273127040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.619390:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2005:x1830881273127040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 110us (369us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.619396:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3040 00002000:00100000:2.0:1746065141.619400:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017a300 x1830881273127040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.619406:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017a300 with x1830881273127040 ext(0->4095) 00010000:00010000:2.0:1746065141.619411:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.619419:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.619424:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017a300 00000100:00100000:0.0:1746065141.630165:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.631621:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273127168 00000100:00100000:2.0:1746065141.631629:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273127168 00010000:00010000:2.0:1746065141.631659:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.631690:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14630 00000100:00100000:2.0:1746065141.631695:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881273127168:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.631706:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.631720:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.631729:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.631745:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8805f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6561 expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.631762:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.631764:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.631769:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 34 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.631781:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 34 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.631803:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 34 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.631812:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267767040:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.631881:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.642272:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267767040:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.642291:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.642343:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2004:x1830881273127168:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 10646us (12184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.642352:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14630 00000100:00100000:0.0:1746065141.642599:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.642685:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273127424 00000100:00100000:1.0:1746065141.642691:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273127424 00002000:00100000:1.0:1746065141.642721:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017bb80 x1830881273127424/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.642730:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017bb80 with x1830881273127424 ext(0->4095) 00002000:00010000:1.0:1746065141.642733:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017bb80 00000100:00100000:1.0:1746065141.642747:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13769 00000100:00100000:1.0:1746065141.642753:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2005:x1830881273127424:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065141.642844:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2005:x1830881273127424:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 91us (245us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.642849:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13769 00002000:00100000:1.0:1746065141.642854:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017bb80 x1830881273127424/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.642860:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017bb80 with x1830881273127424 ext(0->4095) 00002000:00010000:1.0:1746065141.642862:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013017bb80 00000100:00100000:0.0:1746065141.676871:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.676994:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273127552 00000100:00100000:3.0:1746065141.677002:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273127552 00000100:00100000:3.0:1746065141.678100:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30659 00000100:00100000:3.0:1746065141.678108:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273127552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.678122:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.678136:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e656f expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.678159:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 33 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.678170:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.678172:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.678175:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.678195:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 33 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.678204:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 33 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.678213:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267767168:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065141.683489:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.683527:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267767168:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065141.683550:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.683565:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:0.0:1746065141.683613:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273127552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5505us (6748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.683621:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30659 00000100:00100000:0.0:1746065141.687707:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.687749:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.687815:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273127680 00000100:00100000:1.0:1746065141.687822:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273127680 00002000:00100000:1.0:1746065141.687854:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f5e9f80 x1830881273127680/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.687862:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9f80 with x1830881273127680 ext(0->7) 00010000:00010000:1.0:1746065141.687869:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 34 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.687882:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 34 pid: 9560 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.687888:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e9f80 00000100:00100000:1.0:1746065141.687902:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3041 00000100:00100000:1.0:1746065141.687907:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:2005:x1830881273127680:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746065141.688052:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273127808 00000100:00100000:2.0:1746065141.688056:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273127808 00000100:00100000:2.0:1746065141.688101:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30660 00000100:00100000:2.0:1746065141.688105:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1791:x1830881273127808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.688112:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.688123:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6576 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.688139:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.688144:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.688153:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065141.688155:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 36 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.688180:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.688188:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 36 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.688196:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065141.688225:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:1791:x1830881273127808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 119us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.688230:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30660 00000100:00100000:0.0:1746065141.689172:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2005:x1830881273127680:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1261us (1419us total) trans 4294972135 rc 0/0 00000100:00100000:0.0:1746065141.689179:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3041 00002000:00100000:0.0:1746065141.689185:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f5e9f80 x1830881273127680/t4294972135(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.689192:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e9f80 with x1830881273127680 ext(0->7) 00010000:00010000:0.0:1746065141.689196:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 37 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.689210:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 37 pid: 9560 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.689215:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e9f80 00000100:00100000:0.0:1746065141.700930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.701680:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273127936 00000100:00100000:2.0:1746065141.701689:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273127936 00010000:00010000:2.0:1746065141.701719:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 37 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.701745:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14631 00000100:00100000:2.0:1746065141.701752:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2002:x1830881273127936:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.701764:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.701780:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 37 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.701790:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 37 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.701808:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f8805f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6568 expref: 37 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.701824:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.701826:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.701833:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.701840:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.701867:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.701877:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 5 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.701887:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267767424:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.701979:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.703787:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.703907:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267767424:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.703932:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.703961:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2002:x1830881273127936:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2209us (3050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.703970:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14631 00000100:00100000:1.0:1746065141.704537:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273128192 00000100:00100000:1.0:1746065141.704543:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273128192 00002000:00100000:1.0:1746065141.704583:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9500 x1830881273128192/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.704591:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9500 with x1830881273128192 ext(0->4095) 00010000:00010000:1.0:1746065141.704597:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.704616:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.704622:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9500 00000100:00100000:1.0:1746065141.704645:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3042 00000100:00100000:1.0:1746065141.704651:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273128192:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065141.704747:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273128192:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 96us (966us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.704752:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3042 00002000:00100000:1.0:1746065141.704757:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9500 x1830881273128192/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.704764:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9500 with x1830881273128192 ext(0->4095) 00010000:00010000:1.0:1746065141.704768:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.704777:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065141.704781:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6c9500 00000100:00100000:0.0:1746065141.708847:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.709238:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273128320 00000100:00100000:2.0:1746065141.709247:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273128320 00010000:00010000:2.0:1746065141.709276:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.709306:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14632 00000100:00100000:2.0:1746065141.709312:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273128320:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.709322:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.709336:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.709346:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.709365:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f8805fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e656f expref: 6 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.709387:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.709389:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.709395:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 35 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.709402:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 35 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.709428:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 35 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.709438:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267767552:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.709507:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.712368:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.712471:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267767552:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.712486:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.712515:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273128320:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3204us (3676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.712524:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14632 00000100:00100000:1.0:1746065141.712592:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273128576 00000100:00100000:1.0:1746065141.712597:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273128576 00002000:00100000:1.0:1746065141.712637:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cb480 x1830881273128576/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.712645:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb480 with x1830881273128576 ext(0->4095) 00002000:00010000:1.0:1746065141.712649:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cb480 00000100:00100000:1.0:1746065141.712663:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13770 00000100:00100000:1.0:1746065141.712668:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2004:x1830881273128576:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065141.712755:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2004:x1830881273128576:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 86us (392us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.712760:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13770 00002000:00100000:1.0:1746065141.712764:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cb480 x1830881273128576/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.712770:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb480 with x1830881273128576 ext(0->4095) 00002000:00010000:1.0:1746065141.712773:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cb480 00000100:00100000:0.0:1746065141.716011:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.716065:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273128704 00000100:00100000:3.0:1746065141.716071:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273128704 00000100:00100000:3.0:1746065141.716208:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30661 00000100:00100000:3.0:1746065141.716215:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273128704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.716227:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.716240:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e657d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.716261:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 35 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.716267:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.716268:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.716271:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.716292:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 35 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.716301:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 35 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.716310:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267767680:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.717032:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.718309:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267767680:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.718351:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.718364:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065141.718709:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273128704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2492us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.718716:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30661 00000100:00100000:0.0:1746065141.720669:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.720747:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273128832 00000100:00100000:2.0:1746065141.720754:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273128832 00010000:00010000:2.0:1746065141.720778:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 36 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.720802:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14633 00000100:00100000:2.0:1746065141.720808:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2004:x1830881273128832:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.720817:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.720832:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 36 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.720840:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 36 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.720856:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880605 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6576 expref: 36 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.720883:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.720884:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.720890:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.720901:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.720934:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.720943:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267767808:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.721000:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.723042:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267767808:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.723059:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.723113:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2004:x1830881273128832:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2304us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.723121:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14633 00000100:00100000:0.0:1746065141.723485:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.723624:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273128960 00000100:00100000:3.0:1746065141.723630:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273128960 00000100:00100000:3.0:1746065141.723655:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30662 00000100:00100000:3.0:1746065141.723660:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:1791:x1830881273128960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.723672:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.723684:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6584 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.723703:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.723709:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.723711:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.723713:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 36 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.723732:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.723741:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 5 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.723750:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267767936:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.723804:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.728122:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267767936:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.728150:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 36 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.728165:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065141.728212:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:1791:x1830881273128960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4551us (4726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.728220:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30662 00000100:00100000:0.0:1746065141.728627:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.728893:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273129216 00000100:00100000:3.0:1746065141.728898:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273129216 00002000:00100000:3.0:1746065141.728938:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f729f80 x1830881273129216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.728951:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729f80 with x1830881273129216 ext(0->4095) 00010000:00010000:3.0:1746065141.728956:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.728965:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.728970:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f729f80 00000100:00100000:3.0:1746065141.729481:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3043 00000100:00100000:3.0:1746065141.729488:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273129216:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.729584:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273129216:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 97us (958us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.729589:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3043 00002000:00100000:3.0:1746065141.729594:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f729f80 x1830881273129216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.729601:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f729f80 with x1830881273129216 ext(0->4095) 00010000:00010000:3.0:1746065141.729606:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.729615:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.729620:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f729f80 00000100:00100000:0.0:1746065141.732799:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.732902:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273129344 00000100:00100000:2.0:1746065141.732917:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273129344 00010000:00010000:2.0:1746065141.732942:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.732963:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14634 00000100:00100000:2.0:1746065141.732968:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273129344:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.732977:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.732991:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.733001:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.733017:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f88060c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e657d expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.733042:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.733044:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.733049:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 35 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.733056:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 35 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.733098:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 35 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.733108:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267768064:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.733655:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.736999:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.737101:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267768064:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.737118:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.737157:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273129344:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4188us (4364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.737166:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14634 00000100:00100000:1.0:1746065141.737410:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273129600 00000100:00100000:1.0:1746065141.737416:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273129600 00002000:00100000:1.0:1746065141.737448:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c321c00 x1830881273129600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.737458:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321c00 with x1830881273129600 ext(0->4095) 00002000:00010000:1.0:1746065141.737462:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c321c00 00000100:00100000:1.0:1746065141.737486:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13771 00000100:00100000:1.0:1746065141.737492:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2004:x1830881273129600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065141.737606:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2004:x1830881273129600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 114us (613us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.737611:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13771 00002000:00100000:1.0:1746065141.737616:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009c321c00 x1830881273129600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.737623:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321c00 with x1830881273129600 ext(0->4095) 00002000:00010000:1.0:1746065141.737626:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c321c00 00000100:00100000:0.0:1746065141.748279:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.748349:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273129728 00000100:00100000:3.0:1746065141.748358:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273129728 00000100:00100000:3.0:1746065141.748393:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30663 00000100:00100000:3.0:1746065141.748400:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273129728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.748413:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.748428:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e658b expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.748453:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 35 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.748459:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.748460:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.748463:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.748487:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 35 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.748497:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 35 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.748507:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267768192:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.748592:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.759454:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.759537:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273129856 00000100:00100000:2.0:1746065141.759551:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273129856 00002000:00100000:2.0:1746065141.759593:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009c321180 x1830881273129856/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.759608:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321180 with x1830881273129856 ext(0->7) 00010000:00010000:2.0:1746065141.759614:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 36 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.759627:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 36 pid: 9560 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.759633:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c321180 00000100:00100000:2.0:1746065141.759664:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3044 00000100:00100000:2.0:1746065141.759671:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2002:x1830881273129856:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065141.761811:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2002:x1830881273129856:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2134us (2363us total) trans 4294972136 rc 0/0 00000100:00100000:0.0:1746065141.761821:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3044 00002000:00100000:0.0:1746065141.761829:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009c321180 x1830881273129856/t4294972136(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 496/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.761836:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321180 with x1830881273129856 ext(0->7) 00010000:00010000:0.0:1746065141.761843:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.761862:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.761867:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c321180 00000100:00100000:3.0:1746065141.761985:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267768192:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.762004:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.762017:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065141.762034:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273129728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 13635us (13763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.762040:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30663 00000100:00100000:0.0:1746065141.780801:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.780888:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273129984 00000100:00100000:2.0:1746065141.780895:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273129984 00010000:00010000:2.0:1746065141.780939:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.780965:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14635 00000100:00100000:2.0:1746065141.780971:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881273129984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.780983:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065141.780996:0:7198:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1746065140 -> 1746065141 00002000:00010000:2.0:1746065141.780999:0:7198:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1746065140 -> 1746065141 00010000:00010000:2.0:1746065141.781003:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.781013:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.781034:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f880613 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6584 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.781063:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.781065:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.781071:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.781079:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.781123:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.781132:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267768320:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.781206:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.782658:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267768320:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.782673:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.782695:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2004:x1830881273129984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1724us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.782701:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14635 00000100:00100000:0.0:1746065141.785796:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.785871:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273130240 00000100:00100000:2.0:1746065141.785878:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273130240 00002000:00100000:2.0:1746065141.785924:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1f800 x1830881273130240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.785938:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f800 with x1830881273130240 ext(0->4095) 00002000:00010000:2.0:1746065141.785942:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1f800 00000100:00100000:2.0:1746065141.785968:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13772 00000100:00100000:2.0:1746065141.785975:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273130240:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.786096:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273130240:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 108us (291us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.786102:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13772 00002000:00100000:2.0:1746065141.786107:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1f800 x1830881273130240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.786114:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1f800 with x1830881273130240 ext(0->4095) 00002000:00010000:2.0:1746065141.786116:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1f800 00000100:00100000:0.0:1746065141.798836:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.798930:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273130368 00000100:00100000:3.0:1746065141.798938:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273130368 00000100:00100000:3.0:1746065141.798973:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30664 00000100:00100000:3.0:1746065141.798980:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:1795:x1830881273130368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.798994:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.799008:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6592 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.799032:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.799038:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.799039:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.799042:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.799065:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.799075:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 5 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.799103:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267768448:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.799180:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.805777:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.805871:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273130496 00000100:00100000:2.0:1746065141.805879:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273130496 00000100:00100000:2.0:1746065141.805931:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30665 00000100:00100000:2.0:1746065141.805938:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1791:x1830881273130496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.805954:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.805968:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6599 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.805990:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.805994:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 40 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.806000:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.806003:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.806029:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 40 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.806039:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.806047:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065141.806077:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1791:x1830881273130496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.806103:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30665 00000100:00100000:3.0:1746065141.809997:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267768448:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.810023:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.810038:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065141.810072:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881273130368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 11092us (11243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.810102:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30664 00000100:00100000:2.0:1746065141.815731:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.815935:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273130624 00000100:00100000:3.0:1746065141.815944:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273130624 00010000:00010000:3.0:1746065141.815973:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.815995:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14636 00000100:00100000:3.0:1746065141.816000:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273130624:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.816010:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.816024:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.816034:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.816051:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88061a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e658b expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.816065:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.816067:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.816072:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.816094:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.816120:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.816129:0:7198:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.816138:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267768704:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065141.820841:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.820917:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273130880 00000100:00100000:2.0:1746065141.820924:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273130880 00002000:00100000:2.0:1746065141.820955:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffc700 x1830881273130880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.820963:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffc700 with x1830881273130880 ext(0->4095) 00010000:00010000:2.0:1746065141.820971:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 39 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.820983:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 39 pid: 9560 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.820989:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffc700 00000100:00100000:2.0:1746065141.821017:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3045 00000100:00100000:2.0:1746065141.821024:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273130880:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065141.821149:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273130880:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 125us (313us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.821154:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3045 00002000:00100000:2.0:1746065141.821159:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffc700 x1830881273130880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.821165:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffc700 with x1830881273130880 ext(0->4095) 00010000:00010000:2.0:1746065141.821168:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 39 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.821175:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 39 pid: 9560 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.821179:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffc700 00000100:00100000:0.0:1746065141.823307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.823375:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.823395:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273131136 00000100:00100000:0.0:1746065141.823401:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273131136 00010000:00010000:0.0:1746065141.823426:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 39 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065141.823452:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14637 00000100:00100000:0.0:1746065141.823458:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2003:x1830881273131136:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.823466:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065141.823482:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 39 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.823491:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 39 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.823510:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.823512:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.823518:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 39 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.823524:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 39 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.823549:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 39 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.823559:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dfff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267768832:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.823771:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273131008 00000100:00100000:3.0:1746065141.823775:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273131008 00000100:00100000:3.0:1746065141.823797:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30666 00000100:00100000:3.0:1746065141.823801:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273131008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.823809:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.823818:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65a0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.823832:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 39 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.823837:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.823838:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.823841:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.823858:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 39 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.823866:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 39 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.823873:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267768960:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.826682:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746065141.826719:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880621 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6592 expref: 39 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.826732:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267768704:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.826746:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.826784:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2002:x1830881273130624:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 10783us (11061us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.826792:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14636 00000100:00100000:1.0:1746065141.827311:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.828366:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.829959:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dfff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267768832:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065141.829976:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.830025:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2003:x1830881273131136:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6565us (6647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.830034:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14637 00000100:00100000:2.0:1746065141.830058:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267768960:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.830075:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.830111:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:2.0:1746065141.830129:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273131008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6328us (6827us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.830135:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30666 00000100:00100000:2.0:1746065141.830528:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.830886:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273131392 00000100:00100000:0.0:1746065141.830892:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273131392 00002000:00100000:0.0:1746065141.830926:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a07100 x1830881273131392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.830933:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a07100 with x1830881273131392 ext(0->4095) 00010000:00010000:0.0:1746065141.830939:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 38 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.830950:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 38 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.830956:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a07100 00000100:00100000:0.0:1746065141.830969:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3046 00000100:00100000:0.0:1746065141.830975:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273131392:12345-192.168.202.8@tcp:3:ldlm_bl.0 00000100:00100000:0.0:1746065141.831076:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273131392:12345-192.168.202.8@tcp:3:ldlm_bl.0 Request processed in 100us (547us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065141.831100:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3046 00002000:00100000:0.0:1746065141.831104:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a07100 x1830881273131392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.831110:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a07100 with x1830881273131392 ext(0->4095) 00010000:00010000:0.0:1746065141.831113:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 38 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065141.831120:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 38 pid: 21550 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065141.831124:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072a07100 00000100:00100000:0.0:1746065141.833921:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.834249:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.834616:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273131520 00000100:00100000:2.0:1746065141.834624:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273131520 00000100:00100000:2.0:1746065141.834661:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30667 00000100:00100000:2.0:1746065141.834668:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:1791:x1830881273131520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.834682:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.834697:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65a7 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.834717:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.834723:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.834728:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065141.834731:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.834759:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.834771:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.834779:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:2.0:1746065141.834828:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1791:x1830881273131520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 161us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.834834:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30667 00000100:00100000:1.0:1746065141.834899:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273131648 00000100:00100000:1.0:1746065141.834903:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273131648 00010000:00010000:1.0:1746065141.834929:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 39 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.834951:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14638 00000100:00100000:1.0:1746065141.834956:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2002:x1830881273131648:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.834963:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.834978:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 39 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.834988:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 39 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.835002:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880628 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6599 expref: 39 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.835014:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.835016:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.835021:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.835027:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.835045:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.835054:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 5 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.835068:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267769216:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065141.835126:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.837120:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267769216:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065141.837135:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.837162:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2002:x1830881273131648:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2205us (2912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.837170:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14638 00000100:00100000:0.0:1746065141.838709:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.839319:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273131904 00000100:00100000:2.0:1746065141.839326:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273131904 00002000:00100000:2.0:1746065141.839358:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1500 x1830881273131904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.839372:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1500 with x1830881273131904 ext(0->4095) 00010000:00010000:2.0:1746065141.839379:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.839391:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.839397:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a1500 00000100:00100000:2.0:1746065141.839410:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3047 00000100:00100000:2.0:1746065141.839416:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273131904:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.839528:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273131904:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 111us (823us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.839534:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3047 00002000:00100000:2.0:1746065141.839539:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1500 x1830881273131904/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.839546:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1500 with x1830881273131904 ext(0->4095) 00010000:00010000:2.0:1746065141.839549:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.839558:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065141.839564:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a1500 00000100:00100000:0.0:1746065141.842180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.842243:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273132032 00000100:00100000:1.0:1746065141.842249:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273132032 00010000:00010000:1.0:1746065141.842272:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065141.842301:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14639 00000100:00100000:1.0:1746065141.842306:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273132032:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.842314:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.842328:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.842337:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.842353:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f88062f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a0 expref: 6 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065141.842374:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.842376:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.842382:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.842388:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.842411:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065141.842421:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267769344:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065141.842478:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.844028:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267769344:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065141.844041:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.844062:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273132032:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1756us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.844069:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14639 00000100:00100000:0.0:1746065141.845128:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.845833:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273132288 00000100:00100000:2.0:1746065141.845839:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273132288 00002000:00100000:2.0:1746065141.845872:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a0a80 x1830881273132288/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.845881:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0a80 with x1830881273132288 ext(0->4095) 00002000:00010000:2.0:1746065141.845885:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a0a80 00000100:00100000:2.0:1746065141.846377:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13773 00000100:00100000:2.0:1746065141.846385:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273132288:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.846521:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273132288:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 138us (1396us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.846527:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13773 00002000:00100000:2.0:1746065141.846532:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a0a80 x1830881273132288/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.846538:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a0a80 with x1830881273132288 ext(0->4095) 00002000:00010000:2.0:1746065141.846541:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801306a0a80 00000100:00100000:0.0:1746065141.848486:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.848694:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273132416 00000100:00100000:2.0:1746065141.848701:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273132416 00000100:00100000:2.0:1746065141.848727:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30668 00000100:00100000:2.0:1746065141.848733:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273132416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.848745:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.848760:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65ae expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.848782:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.848793:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.848794:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.848797:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.848819:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.848828:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 37 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.848838:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267769472:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.848906:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.851593:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267769472:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.851615:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.851628:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065141.851664:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273132416:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2931us (3184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.851671:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30668 00000100:00100000:0.0:1746065141.851876:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.852259:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273132544 00000100:00100000:2.0:1746065141.852266:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273132544 00010000:00010000:2.0:1746065141.852283:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.852307:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14640 00000100:00100000:2.0:1746065141.852312:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273132544:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.852322:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.852336:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.852346:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.852362:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880636 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65a7 expref: 38 pid: 9560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.852379:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.852380:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.852386:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.852393:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.852415:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.852423:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a05180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267769600:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.852472:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.854643:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.854723:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273132800 00000100:00100000:1.0:1746065141.854729:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273132800 00002000:00100000:1.0:1746065141.854758:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f981880 x1830881273132800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.854767:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981880 with x1830881273132800 ext(0->4095) 00002000:00010000:1.0:1746065141.854771:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f981880 00000100:00100000:1.0:1746065141.854795:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13774 00000100:00100000:1.0:1746065141.854801:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273132800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065141.854890:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273132800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 89us (252us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.854896:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13774 00002000:00100000:1.0:1746065141.854900:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f981880 x1830881273132800/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.854920:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981880 with x1830881273132800 ext(0->4095) 00002000:00010000:1.0:1746065141.854923:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f981880 00000100:00100000:2.0:1746065141.854985:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a05180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267769600:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.854998:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.855015:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2005:x1830881273132544:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2703us (3140us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.855021:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14640 00000100:00100000:0.0:1746065141.855746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.855957:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273132928 00000100:00100000:3.0:1746065141.855961:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273132928 00000100:00100000:3.0:1746065141.855986:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30669 00000100:00100000:3.0:1746065141.855990:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:1791:x1830881273132928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.856000:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.856012:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65b5 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.856030:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.856037:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.856039:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.856042:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.856064:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.856073:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 5 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065141.856114:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267769728:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.856167:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.859337:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.860276:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267769728:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.860298:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.860313:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:2.0:1746065141.860650:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273133056 00000100:00100000:2.0:1746065141.860656:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273133056 00000100:00100000:2.0:1746065141.860690:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30670 00000100:00100000:2.0:1746065141.860696:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881273133056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.860707:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.860717:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65bc expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.860733:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.860737:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 40 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.860743:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.860745:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.860768:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 40 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.860777:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.860784:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:3.0:1746065141.861012:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1791:x1830881273132928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5019us (5265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.861018:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30669 00000100:00100000:2.0:1746065141.861156:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881273133056:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 460us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.861161:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30670 00000100:00100000:2.0:1746065141.861281:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.861300:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273133184 00000100:00100000:2.0:1746065141.861303:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273133184 00010000:00010000:2.0:1746065141.861318:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.861334:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14641 00000100:00100000:2.0:1746065141.861338:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273133184:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.861346:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.861359:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.861368:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.861381:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f88063d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ae expref: 6 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.861389:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.861390:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.861394:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.861400:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.861419:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.861428:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 38 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.861436:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267769984:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.861475:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.863592:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267769984:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.863609:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.863945:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273133184:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2604us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.863954:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14641 00000100:00100000:2.0:1746065141.864775:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.864949:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273133440 00000100:00100000:3.0:1746065141.864955:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273133440 00002000:00100000:3.0:1746065141.864982:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f1c00 x1830881273133440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.864996:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f1c00 with x1830881273133440 ext(0->4095) 00010000:00010000:3.0:1746065141.865002:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 39 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.865012:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 39 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.865017:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f1c00 00000100:00100000:3.0:1746065141.865346:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3048 00000100:00100000:3.0:1746065141.865352:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273133440:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.865631:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273133440:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 279us (858us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.865636:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3048 00002000:00100000:3.0:1746065141.865642:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f1c00 x1830881273133440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.865648:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f1c00 with x1830881273133440 ext(0->4095) 00010000:00010000:3.0:1746065141.865652:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 39 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065141.865660:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 39 pid: 9635 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065141.865665:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f1c00 00000100:00100000:0.0:1746065141.867446:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.867601:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273133568 00000100:00100000:2.0:1746065141.867607:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273133568 00010000:00010000:2.0:1746065141.867627:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 39 pid: 9635 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.867652:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14642 00000100:00100000:2.0:1746065141.867657:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273133568:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.867666:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.867678:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 39 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.867692:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 39 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.867709:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f880644 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65b5 expref: 39 pid: 9635 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.867729:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.867731:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.867736:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.867743:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.867765:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.867775:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267770112:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.867831:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.870049:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267770112:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.870064:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.870129:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881273133568:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2470us (2684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.870137:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14642 00000100:00100000:0.0:1746065141.870517:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.870596:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273133824 00000100:00100000:3.0:1746065141.870601:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273133824 00002000:00100000:3.0:1746065141.870629:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729d6a00 x1830881273133824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.870638:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d6a00 with x1830881273133824 ext(0->4095) 00002000:00010000:3.0:1746065141.870642:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729d6a00 00000100:00100000:3.0:1746065141.871025:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13775 00000100:00100000:3.0:1746065141.871033:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273133824:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.871152:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273133824:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 120us (635us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.871157:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13775 00002000:00100000:3.0:1746065141.871161:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729d6a00 x1830881273133824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.871168:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d6a00 with x1830881273133824 ext(0->4095) 00002000:00010000:3.0:1746065141.871171:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729d6a00 00000100:00100000:0.0:1746065141.873753:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.873937:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273133952 00000100:00100000:2.0:1746065141.873944:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273133952 00000100:00100000:2.0:1746065141.873986:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30671 00000100:00100000:2.0:1746065141.874012:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273133952:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.874026:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.874041:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65c3 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.874064:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 37 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.874070:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.874071:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.874075:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.874113:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 37 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.874122:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 37 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.874131:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267770240:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.874194:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.875904:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267770240:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.875933:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.875946:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065c00, rc 0) 00000100:00100000:2.0:1746065141.875981:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273133952:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1989us (2233us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.875988:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30671 00000100:00100000:0.0:1746065141.877666:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.877748:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273134080 00000100:00100000:2.0:1746065141.877755:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273134080 00010000:00010000:2.0:1746065141.877925:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 38 pid: 21550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065141.877956:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14643 00000100:00100000:2.0:1746065141.877963:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801376a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881273134080:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.877973:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.877987:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 38 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.877997:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 38 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.878013:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88064b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65bc expref: 38 pid: 21550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065141.878626:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.878628:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.878635:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.878644:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.878675:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.878686:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267770368:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.878755:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.882425:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.882736:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267770368:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.882752:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.882789:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801376a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2004:x1830881273134080:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4826us (5127us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.882798:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14643 00000100:00100000:0.0:1746065141.882961:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.882984:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273134464 00000100:00100000:0.0:1746065141.882989:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273134464 00002000:00100000:0.0:1746065141.883014:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb67b80 x1830881273134464/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.883022:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67b80 with x1830881273134464 ext(0->4095) 00002000:00010000:0.0:1746065141.883026:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb67b80 00000100:00100000:0.0:1746065141.883038:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13776 00000100:00100000:0.0:1746065141.883043:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273134464:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065141.883139:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273134464:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (177us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065141.883144:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13776 00002000:00100000:0.0:1746065141.883148:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb67b80 x1830881273134464/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065141.883154:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67b80 with x1830881273134464 ext(0->4095) 00002000:00010000:0.0:1746065141.883157:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb67b80 00000100:00100000:3.0:1746065141.883557:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273134336 00000100:00100000:3.0:1746065141.883561:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273134336 00000100:00100000:3.0:1746065141.883582:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30672 00000100:00100000:3.0:1746065141.883587:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:1791:x1830881273134336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.883595:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.883607:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65ca expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.883627:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.883638:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.883640:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.883643:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.883664:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.883674:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 5 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065141.883683:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267770496:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.884218:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.888247:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.888556:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273134592 00000100:00100000:2.0:1746065141.888563:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273134592 00000100:00100000:2.0:1746065141.888599:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30673 00000100:00100000:2.0:1746065141.888606:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881273134592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.888621:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.888635:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65d1 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.888656:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.888661:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 40 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.888666:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.888669:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.888701:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 40 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.888712:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.888721:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065141.888768:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1795:x1830881273134592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 163us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.888774:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30673 00000100:00100000:3.0:1746065141.889191:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267770496:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.889205:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.889213:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065141.889233:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1791:x1830881273134336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5646us (6814us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.889238:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30672 00000100:00100000:2.0:1746065141.890259:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.890438:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273134720 00000100:00100000:0.0:1746065141.890443:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273134720 00010000:00010000:0.0:1746065141.890463:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746065141.890481:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14644 00000100:00100000:0.0:1746065141.890486:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273134720:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.890493:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065141.890508:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065141.890517:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065141.890533:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f880652 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65c3 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065141.890556:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.890557:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.890563:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.890569:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.890589:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.890598:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 38 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746065141.890607:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267770752:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065141.892245:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.893604:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267770752:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.893619:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.893651:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273134720:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3164us (3394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.893659:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14644 00000100:00100000:0.0:1746065141.895010:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.895281:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273134976 00000100:00100000:2.0:1746065141.895288:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273134976 00002000:00100000:2.0:1746065141.895321:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb67800 x1830881273134976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.895331:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67800 with x1830881273134976 ext(0->4095) 00010000:00010000:2.0:1746065141.895337:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.895348:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065141.895354:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb67800 00000100:00100000:2.0:1746065141.895367:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3049 00000100:00100000:2.0:1746065141.895372:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273134976:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.895542:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273134976:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 169us (535us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.895549:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3049 00002000:00100000:2.0:1746065141.895554:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb67800 x1830881273134976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.895561:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb67800 with x1830881273134976 ext(0->4095) 00010000:00010000:2.0:1746065141.895565:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.895573:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065141.895577:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb67800 00000100:00100000:0.0:1746065141.897508:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.897732:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273135104 00000100:00100000:2.0:1746065141.897738:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273135104 00010000:00010000:2.0:1746065141.897759:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.897785:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14645 00000100:00100000:2.0:1746065141.897791:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273135104:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.897799:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.897813:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.897821:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.897838:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880659 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ca expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.898447:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.898450:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.898458:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.898465:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.898493:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.898502:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267770880:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.898571:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.900725:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267770880:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.900743:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.900772:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881273135104:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2980us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.900780:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14645 00000100:00100000:0.0:1746065141.901059:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.901257:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273135360 00000100:00100000:3.0:1746065141.901263:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273135360 00002000:00100000:3.0:1746065141.901291:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1180 x1830881273135360/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.901305:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1180 with x1830881273135360 ext(0->4095) 00002000:00010000:3.0:1746065141.901308:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b1180 00000100:00100000:3.0:1746065141.901322:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13777 00000100:00100000:3.0:1746065141.901328:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273135360:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.901414:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273135360:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 86us (355us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.901419:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13777 00002000:00100000:3.0:1746065141.901423:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1180 x1830881273135360/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.901429:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1180 with x1830881273135360 ext(0->4095) 00002000:00010000:3.0:1746065141.901432:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b1180 00000100:00100000:0.0:1746065141.903867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.903981:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273135488 00000100:00100000:2.0:1746065141.903988:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273135488 00000100:00100000:2.0:1746065141.904032:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30674 00000100:00100000:2.0:1746065141.904039:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273135488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.904053:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.904067:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65d8 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.904113:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 37 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.904119:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.904120:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.904123:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.904145:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 37 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.904155:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 37 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.904165:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267771008:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.904895:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.907891:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267771008:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.907927:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.907941:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065141.907976:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273135488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3936us (4115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.907984:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30674 00000100:00100000:0.0:1746065141.909140:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.909399:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273135616 00000100:00100000:2.0:1746065141.909405:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273135616 00010000:00010000:2.0:1746065141.909427:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 38 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.909458:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14646 00000100:00100000:2.0:1746065141.909464:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273135616:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.909475:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.909491:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 38 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.909501:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 38 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.909518:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880660 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d1 expref: 38 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.909541:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.909542:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.909548:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.909554:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.909580:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.909589:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267771136:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.909651:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.913246:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.913314:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.913392:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273135872 00000100:00100000:1.0:1746065141.913399:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273135872 00002000:00100000:1.0:1746065141.913434:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1880 x1830881273135872/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.913443:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1880 with x1830881273135872 ext(0->4095) 00002000:00010000:1.0:1746065141.913447:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b1880 00000100:00100000:1.0:1746065141.913465:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13778 00000100:00100000:1.0:1746065141.913471:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273135872:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065141.913572:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273135872:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 101us (334us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.913577:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13778 00002000:00100000:1.0:1746065141.913582:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b1880 x1830881273135872/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.913588:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b1880 with x1830881273135872 ext(0->4095) 00002000:00010000:1.0:1746065141.913590:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b1880 00000100:00100000:3.0:1746065141.913786:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273136000 00000100:00100000:3.0:1746065141.913790:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273136000 00000100:00100000:3.0:1746065141.913810:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30675 00000100:00100000:3.0:1746065141.913814:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:1791:x1830881273136000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.913823:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.913836:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65df expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.913855:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.913861:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.913862:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.913866:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.914433:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267771136:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.914448:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.914469:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273135616:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5006us (5333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.914475:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14646 00010000:00010000:3.0:1746065141.914576:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.914586:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065141.914595:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267771264:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065141.914640:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.917724:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.917983:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267771264:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.918005:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.918019:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:2.0:1746065141.918228:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273136128 00000100:00100000:2.0:1746065141.918234:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273136128 00000100:00100000:2.0:1746065141.918270:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30676 00000100:00100000:2.0:1746065141.918276:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881273136128:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.918288:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.918299:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65e6 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.918316:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.918320:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 40 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.918325:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.918327:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.918353:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 40 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.918363:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.918369:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:3.0:1746065141.918887:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1791:x1830881273136000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5070us (5571us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.918894:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30675 00000100:00100000:2.0:1746065141.919342:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881273136128:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1065us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.919348:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30676 00000100:00100000:1.0:1746065141.920029:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.920481:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273136256 00000100:00100000:3.0:1746065141.920487:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273136256 00010000:00010000:3.0:1746065141.920511:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065141.920531:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14647 00000100:00100000:3.0:1746065141.920537:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273136256:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.920546:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.920562:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.920571:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.920589:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880667 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65d8 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.920603:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.920605:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.920610:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.920617:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.920639:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.920648:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 38 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065141.920658:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267771520:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.920703:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.923022:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267771520:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.923039:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.923558:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273136256:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3019us (3528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.923568:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14647 00000100:00100000:0.0:1746065141.924573:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.924644:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273136512 00000100:00100000:3.0:1746065141.924650:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273136512 00002000:00100000:3.0:1746065141.924682:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1e300 x1830881273136512/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.924691:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1e300 with x1830881273136512 ext(0->4095) 00010000:00010000:3.0:1746065141.924698:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.924709:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065141.924715:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1e300 00000100:00100000:3.0:1746065141.925201:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3050 00000100:00100000:3.0:1746065141.925208:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273136512:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.925305:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273136512:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (734us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.925310:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3050 00002000:00100000:3.0:1746065141.925315:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1e300 x1830881273136512/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.925322:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1e300 with x1830881273136512 ext(0->4095) 00010000:00010000:3.0:1746065141.925326:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.925340:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065141.925345:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1e300 00000100:00100000:0.0:1746065141.927831:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.928222:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273136640 00000100:00100000:3.0:1746065141.928230:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273136640 00010000:00010000:3.0:1746065141.928257:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065141.928280:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14648 00000100:00100000:3.0:1746065141.928286:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2003:x1830881273136640:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.928297:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.928312:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.928323:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.928340:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88066e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65df expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.928351:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.928353:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.928359:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.928371:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.928397:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.928407:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267771648:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.928478:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.931196:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.931276:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267771648:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.931291:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.931402:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273136896 00000100:00100000:1.0:1746065141.931408:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273136896 00002000:00100000:1.0:1746065141.931440:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f100 x1830881273136896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.931449:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f100 with x1830881273136896 ext(0->4095) 00002000:00010000:1.0:1746065141.931453:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1f100 00000100:00100000:1.0:1746065141.931476:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13779 00000100:00100000:1.0:1746065141.931482:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273136896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065141.931584:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2003:x1830881273136640:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3296us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.931591:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14648 00000100:00100000:1.0:1746065141.932156:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881273136896:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 673us (965us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.932163:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13779 00002000:00100000:1.0:1746065141.932168:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1f100 x1830881273136896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.932175:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1f100 with x1830881273136896 ext(0->4095) 00002000:00010000:1.0:1746065141.932178:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1f100 00000100:00100000:0.0:1746065141.934606:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.934672:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273137024 00000100:00100000:2.0:1746065141.934678:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273137024 00000100:00100000:2.0:1746065141.934710:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30677 00000100:00100000:2.0:1746065141.934717:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273137024:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.934729:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.934743:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65ed expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.934766:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 37 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.934773:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.934774:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.934777:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.934807:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 37 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.934818:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 37 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.934828:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267771776:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.935437:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.938411:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267771776:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.938433:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.938446:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065141.938476:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273137024:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3759us (3875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.938482:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30677 00000100:00100000:0.0:1746065141.938780:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.939471:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273137152 00000100:00100000:2.0:1746065141.939478:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273137152 00010000:00010000:2.0:1746065141.939496:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 38 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.939515:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14649 00000100:00100000:2.0:1746065141.939520:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273137152:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.939528:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.939544:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 38 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.939553:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 38 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.939571:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880675 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65e6 expref: 38 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.939594:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.939595:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.939601:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.939608:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.939630:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.939639:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267771904:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.939692:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.941855:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.942782:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267771904:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.942798:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.942831:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2005:x1830881273137152:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3310us (4051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.942839:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14649 00000100:00100000:2.0:1746065141.942879:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273137280 00000100:00100000:2.0:1746065141.942884:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273137280 00000100:00100000:2.0:1746065141.942925:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30678 00000100:00100000:2.0:1746065141.942930:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:1791:x1830881273137280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.942942:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.942955:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65f4 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.942974:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.942980:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.942982:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.942985:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.943005:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.943014:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 5 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.943023:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267772032:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.943063:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.944666:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.944789:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273137536 00000100:00100000:1.0:1746065141.944794:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273137536 00002000:00100000:1.0:1746065141.944820:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1dc00 x1830881273137536/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.944829:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1dc00 with x1830881273137536 ext(0->4095) 00010000:00010000:1.0:1746065141.944835:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065141.944845:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065141.944851:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1dc00 00000100:00100000:1.0:1746065141.944875:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3051 00000100:00100000:1.0:1746065141.944881:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273137536:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065141.944994:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273137536:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 112us (331us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.944999:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3051 00002000:00100000:1.0:1746065141.945003:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1dc00 x1830881273137536/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.945008:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1dc00 with x1830881273137536 ext(0->4095) 00010000:00010000:1.0:1746065141.945012:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065141.945020:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065141.945024:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1dc00 00000100:00100000:3.0:1746065141.945354:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267772032:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065141.945371:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.945382:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:3.0:1746065141.945401:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:1791:x1830881273137280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2471us (3551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.945408:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30678 00000100:00100000:0.0:1746065141.947968:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065141.948016:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.948117:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273137664 00000100:00100000:3.0:1746065141.948124:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273137664 00000100:00100000:3.0:1746065141.948166:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30679 00000100:00100000:3.0:1746065141.948172:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:1795:x1830881273137664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.948185:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.948197:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e65fb expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.948215:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.948220:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.948225:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.948229:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.948255:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.948265:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.948273:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:2.0:1746065141.948362:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273137792 00000100:00100000:2.0:1746065141.948366:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273137792 00010000:00010000:2.0:1746065141.948381:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.948401:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14650 00000100:00100000:2.0:1746065141.948406:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a943dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273137792:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.948412:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.948427:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.948441:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.948455:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88067c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65ed expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.948468:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.948469:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.948474:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.948480:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.948497:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.948506:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.948516:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267772288:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.948604:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881273137664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 431us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.948610:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30679 00000100:00100000:2.0:1746065141.948714:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.950814:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.950923:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267772288:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.950939:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.950968:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a943dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273137792:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2561us (2950us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.950981:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14650 00000100:00100000:3.0:1746065141.951075:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273138048 00000100:00100000:3.0:1746065141.951100:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273138048 00002000:00100000:3.0:1746065141.951131:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1c000 x1830881273138048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.951140:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1c000 with x1830881273138048 ext(0->4095) 00010000:00010000:3.0:1746065141.951146:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.951157:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065141.951163:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1c000 00000100:00100000:3.0:1746065141.951189:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3052 00000100:00100000:3.0:1746065141.951196:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273138048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.951297:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273138048:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 102us (487us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.951302:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3052 00002000:00100000:3.0:1746065141.951307:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1c000 x1830881273138048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.951314:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1c000 with x1830881273138048 ext(0->4095) 00010000:00010000:3.0:1746065141.951318:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.951326:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065141.951337:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eb1c000 00000100:00100000:0.0:1746065141.953688:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.953801:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273138176 00000100:00100000:2.0:1746065141.953808:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273138176 00010000:00010000:2.0:1746065141.953833:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.953854:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14651 00000100:00100000:2.0:1746065141.953860:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273138176:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.953871:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.953884:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.953892:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.953920:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880683 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65f4 expref: 39 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.953942:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.953944:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.953950:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.953956:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.953980:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.953990:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267772416:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.954047:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.955946:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.956070:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273138432 00000100:00100000:1.0:1746065141.956075:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273138432 00002000:00100000:1.0:1746065141.956124:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ed80 x1830881273138432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.956131:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ed80 with x1830881273138432 ext(0->4095) 00002000:00010000:1.0:1746065141.956135:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ed80 00000100:00100000:1.0:1746065141.956154:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13780 00000100:00100000:1.0:1746065141.956158:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273138432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065141.956241:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273138432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 82us (300us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.956247:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13780 00002000:00100000:1.0:1746065141.956251:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ed80 x1830881273138432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.956257:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ed80 with x1830881273138432 ext(0->4095) 00002000:00010000:1.0:1746065141.956260:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ed80 00000100:00100000:2.0:1746065141.956316:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267772416:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.956329:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.956358:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881273138176:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2498us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.956364:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14651 00000100:00100000:0.0:1746065141.958936:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.959005:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273138560 00000100:00100000:1.0:1746065141.959011:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273138560 00000100:00100000:1.0:1746065141.959047:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30680 00000100:00100000:1.0:1746065141.959052:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273138560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.959063:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.959075:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6602 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.959117:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.959122:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.959124:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.959127:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.959147:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.959156:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 37 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065141.959170:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267772544:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.959222:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.961506:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267772544:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.961530:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.961542:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfcc00, rc 0) 00000100:00100000:1.0:1746065141.961582:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273138560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2529us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.961589:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30680 00000100:00100000:0.0:1746065141.962339:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.962604:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273138688 00000100:00100000:2.0:1746065141.962609:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273138688 00010000:00010000:2.0:1746065141.962631:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 38 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.962648:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14652 00000100:00100000:2.0:1746065141.962653:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881273138688:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.962660:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.962674:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 38 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.962683:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 38 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.962698:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88068a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e65fb expref: 38 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065141.962719:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.962721:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.962727:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.962733:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.962756:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.962765:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267772672:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065141.962818:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.965404:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267772672:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065141.965420:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.965451:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2004:x1830881273138688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2797us (3112us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.965459:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14652 00000100:00100000:0.0:1746065141.965798:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.966061:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273138944 00000100:00100000:3.0:1746065141.966066:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273138944 00002000:00100000:3.0:1746065141.966120:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a2d80 x1830881273138944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.966129:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2d80 with x1830881273138944 ext(0->4095) 00002000:00010000:3.0:1746065141.966132:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a2d80 00000100:00100000:3.0:1746065141.966884:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13781 00000100:00100000:3.0:1746065141.966893:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273138944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065141.967031:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273138944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 139us (1233us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.967037:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13781 00002000:00100000:3.0:1746065141.967042:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a2d80 x1830881273138944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065141.967048:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2d80 with x1830881273138944 ext(0->4095) 00002000:00010000:3.0:1746065141.967051:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a2d80 00000100:00100000:0.0:1746065141.968301:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.969663:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273139072 00000100:00100000:1.0:1746065141.969671:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273139072 00000100:00100000:1.0:1746065141.969716:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30681 00000100:00100000:1.0:1746065141.969723:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:1791:x1830881273139072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065141.969735:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.969749:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6609 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.969772:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.969778:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.969779:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.969782:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.969810:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.969820:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 5 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065141.969829:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267772800:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065141.969884:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.972383:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.972610:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273139200 00000100:00100000:3.0:1746065141.972616:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273139200 00000100:00100000:3.0:1746065141.972658:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30682 00000100:00100000:3.0:1746065141.972663:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881273139200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065141.972676:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.972687:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6610 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.972710:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.972714:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.972719:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.972722:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 40 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.972748:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.972759:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 40 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.972767:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065141.972809:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1795:x1830881273139200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.972815:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30682 00000100:00100000:1.0:1746065141.972887:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267772800:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065141.972901:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 39 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.972919:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd000, rc 0) 00000100:00100000:1.0:1746065141.972935:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1791:x1830881273139072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3213us (4636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.972939:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30681 00000100:00100000:0.0:1746065141.973881:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.974268:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273139328 00000100:00100000:3.0:1746065141.974273:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273139328 00010000:00010000:3.0:1746065141.974289:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065141.974314:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14653 00000100:00100000:3.0:1746065141.974319:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273139328:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.974326:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.974339:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.974348:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.974362:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f880691 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6602 expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.974379:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.974380:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.974385:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.974391:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.974408:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 38 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.974415:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 38 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065141.974423:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267773056:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.974474:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.976724:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267773056:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.976740:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.977151:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273139328:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2829us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.977160:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14653 00000100:00100000:0.0:1746065141.978230:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.978643:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273139584 00000100:00100000:1.0:1746065141.978649:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273139584 00002000:00100000:1.0:1746065141.978680:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f087100 x1830881273139584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.978688:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f087100 with x1830881273139584 ext(0->4095) 00010000:00010000:1.0:1746065141.978696:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 39 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065141.978714:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 39 pid: 21550 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065141.978720:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f087100 00000100:00100000:1.0:1746065141.978743:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3053 00000100:00100000:1.0:1746065141.978749:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273139584:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065141.978851:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273139584:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 102us (623us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.978857:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3053 00002000:00100000:1.0:1746065141.978862:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f087100 x1830881273139584/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.978869:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f087100 with x1830881273139584 ext(0->4095) 00010000:00010000:1.0:1746065141.978874:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 39 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065141.978882:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 39 pid: 21550 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065141.978887:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f087100 00000100:00100000:0.0:1746065141.980619:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.981449:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273139712 00000100:00100000:3.0:1746065141.981456:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273139712 00010000:00010000:3.0:1746065141.981511:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 39 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065141.981558:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14654 00000100:00100000:3.0:1746065141.981564:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273139712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.981573:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.981586:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 39 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.981595:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 39 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.981612:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880698 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6609 expref: 39 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.981641:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.981643:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.981649:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.981655:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.981685:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 38 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.981702:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267773184:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.981774:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.983842:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.983970:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267773184:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.983984:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.984023:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881273139712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2459us (3408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.984031:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14654 00000100:00100000:2.0:1746065141.985007:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273139968 00000100:00100000:2.0:1746065141.985014:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273139968 00002000:00100000:2.0:1746065141.985044:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf8380 x1830881273139968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.985052:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8380 with x1830881273139968 ext(0->4095) 00002000:00010000:2.0:1746065141.985056:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbf8380 00000100:00100000:2.0:1746065141.985076:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13782 00000100:00100000:2.0:1746065141.985106:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273139968:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065141.985206:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273139968:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 124us (1369us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.985212:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13782 00002000:00100000:2.0:1746065141.985216:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbf8380 x1830881273139968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065141.985223:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbf8380 with x1830881273139968 ext(0->4095) 00002000:00010000:2.0:1746065141.985226:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbf8380 00000100:00100000:0.0:1746065141.987783:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.987858:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273140096 00000100:00100000:2.0:1746065141.987864:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273140096 00000100:00100000:2.0:1746065141.987916:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30683 00000100:00100000:2.0:1746065141.987923:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273140096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.987934:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.987947:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6617 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.987970:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.987976:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.987977:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.987981:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.988002:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 37 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.988011:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 37 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.988025:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267773312:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.988116:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.990383:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267773312:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.990405:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.990417:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065141.990459:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273140096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2535us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.990465:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30683 00000100:00100000:0.0:1746065141.991464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065141.991665:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273140224 00000100:00100000:3.0:1746065141.991671:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273140224 00010000:00010000:3.0:1746065141.991696:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 38 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065141.991726:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14655 00000100:00100000:3.0:1746065141.991732:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273140224:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.991744:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.991760:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 38 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.991769:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 38 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.991787:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f88069f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6610 expref: 38 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065141.991809:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.991811:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.991817:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.991824:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.991847:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.991856:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267773440:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065141.991924:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.993763:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267773440:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065141.993779:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.993805:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2005:x1830881273140224:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2073us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.993813:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14655 00000100:00100000:0.0:1746065141.996170:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065141.996344:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273140480 00000100:00100000:2.0:1746065141.996351:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273140480 00000100:00100000:2.0:1746065141.996439:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30684 00000100:00100000:2.0:1746065141.996446:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:1791:x1830881273140480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065141.996459:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.996472:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e661e expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.996494:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.996500:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.996502:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.996505:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.996531:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.996541:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065141.996551:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267773568:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065141.996607:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.996783:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065141.996892:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273140608 00000100:00100000:1.0:1746065141.996896:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273140608 00002000:00100000:1.0:1746065141.996944:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79f800 x1830881273140608/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.996953:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79f800 with x1830881273140608 ext(0->4095) 00010000:00010000:1.0:1746065141.996958:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065141.996968:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065141.996973:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79f800 00000100:00100000:1.0:1746065141.997143:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3054 00000100:00100000:1.0:1746065141.997150:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273140608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065141.997234:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273140608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 84us (450us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.997239:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3054 00002000:00100000:1.0:1746065141.997244:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d79f800 x1830881273140608/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065141.997251:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79f800 with x1830881273140608 ext(0->4095) 00010000:00010000:1.0:1746065141.997255:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065141.997263:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065141.997269:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d79f800 00000100:00100000:2.0:1746065141.999236:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267773568:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065141.999257:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.999269:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065141.999294:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:1791:x1830881273140480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2849us (3131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.999300:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30684 00000100:00100000:0.0:1746065142.001171:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.001211:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.001370:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273140864 00000100:00100000:3.0:1746065142.001377:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273140864 00010000:00010000:3.0:1746065142.001409:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.001439:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14656 00000100:00100000:3.0:1746065142.001445:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273140864:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.001454:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.001469:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.001482:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.001499:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8806a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6617 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.001512:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.001514:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.001519:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 37 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.001526:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 37 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.001549:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 37 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.001558:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267773696:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.001612:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.001803:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273140736 00000100:00100000:2.0:1746065142.001807:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273140736 00000100:00100000:2.0:1746065142.001864:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30685 00000100:00100000:2.0:1746065142.001870:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:1795:x1830881273140736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.001881:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.001889:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6625 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.001902:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.001919:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.001921:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.001924:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.001938:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.001946:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.001953:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267773824:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.001970:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746065142.002009:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065142.003981:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267773696:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.003997:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.004026:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273140864:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2581us (2814us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.004034:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14656 00000100:00100000:2.0:1746065142.004770:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267773824:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.004789:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.004800:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065a00, rc 0) 00000100:00100000:2.0:1746065142.004819:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881273140736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2950us (3654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.004826:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30685 00000100:00100000:0.0:1746065142.005640:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.005829:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273141120 00000100:00100000:3.0:1746065142.005835:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273141120 00002000:00100000:3.0:1746065142.005864:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a093a300 x1830881273141120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.005873:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a093a300 with x1830881273141120 ext(0->4095) 00010000:00010000:3.0:1746065142.005878:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.005888:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.005894:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a093a300 00000100:00100000:3.0:1746065142.006487:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3055 00000100:00100000:3.0:1746065142.006494:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a093a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273141120:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065142.007144:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a093a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273141120:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 650us (1504us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.007150:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3055 00002000:00100000:3.0:1746065142.007155:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a093a300 x1830881273141120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.007162:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a093a300 with x1830881273141120 ext(0->4095) 00010000:00010000:3.0:1746065142.007167:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.007176:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.007181:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a093a300 00000100:00100000:0.0:1746065142.015637:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.016606:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273141248 00000100:00100000:3.0:1746065142.016615:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273141248 00010000:00010000:3.0:1746065142.016644:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.016682:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14657 00000100:00100000:3.0:1746065142.016689:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273141248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.016700:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.016716:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.016726:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.016744:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f8806ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e661e expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.017507:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.017510:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.017517:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.017525:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.017553:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 38 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.017569:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267773952:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.019955:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.025757:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.025841:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273141504 00000100:00100000:2.0:1746065142.025848:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273141504 00002000:00100000:2.0:1746065142.025885:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f84b100 x1830881273141504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.025900:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84b100 with x1830881273141504 ext(0->4095) 00002000:00010000:2.0:1746065142.025904:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f84b100 00000100:00100000:2.0:1746065142.025940:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13783 00000100:00100000:2.0:1746065142.025946:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273141504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.026051:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2005:x1830881273141504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 105us (302us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.026057:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13783 00002000:00100000:2.0:1746065142.026062:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f84b100 x1830881273141504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.026067:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f84b100 with x1830881273141504 ext(0->4095) 00002000:00010000:2.0:1746065142.026070:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f84b100 00000100:00100000:3.0:1746065142.026980:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267773952:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.026996:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.027020:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2004:x1830881273141248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 10332us (11391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.027027:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14657 00000100:00100000:0.0:1746065142.029510:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.029712:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273141632 00000100:00100000:2.0:1746065142.029720:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273141632 00000100:00100000:2.0:1746065142.029949:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30686 00000100:00100000:2.0:1746065142.029957:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273141632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.029971:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.029985:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e662c expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.030010:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 37 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.030016:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.030017:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.030021:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.030042:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 37 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.030054:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 37 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.030064:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267774080:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.033391:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.035604:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267774080:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065142.035605:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065142.035629:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.035645:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:3.0:1746065142.035688:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273141632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5731us (6184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.035696:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30686 00000100:00100000:2.0:1746065142.035762:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273141760 00000100:00100000:2.0:1746065142.035768:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273141760 00010000:00010000:2.0:1746065142.035789:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 38 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.035821:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14658 00000100:00100000:2.0:1746065142.035921:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273141760:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.035932:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.035948:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 38 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.035962:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 38 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.035980:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065a00/0x392ae0376f8806b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6625 expref: 38 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.036003:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.036005:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.036011:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.036018:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.036042:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.036051:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267774208:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.036129:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.036686:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.036772:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273141888 00000100:00100000:3.0:1746065142.036775:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273141888 00000100:00100000:3.0:1746065142.036806:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30687 00000100:00100000:3.0:1746065142.036812:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:1791:x1830881273141888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.036822:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.036831:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6633 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.036847:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.036852:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.036853:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.036855:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.036869:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.036877:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.036884:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267774336:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.036917:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.038222:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267774336:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.038238:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.038246:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:3.0:1746065142.038269:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1791:x1830881273141888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1457us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.038275:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30687 00000100:00100000:2.0:1746065142.038339:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267774208:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.038348:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.038364:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273141760:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2457us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.038371:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14658 00000100:00100000:0.0:1746065142.038672:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.038861:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273142144 00000100:00100000:1.0:1746065142.038866:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273142144 00002000:00100000:1.0:1746065142.038894:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b89500 x1830881273142144/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.038917:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b89500 with x1830881273142144 ext(0->4095) 00010000:00010000:1.0:1746065142.038923:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.038932:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.038936:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b89500 00000100:00100000:1.0:1746065142.038960:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3056 00000100:00100000:1.0:1746065142.038966:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273142144:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.039073:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273142144:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 107us (402us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.039078:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3056 00002000:00100000:1.0:1746065142.039105:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b89500 x1830881273142144/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.039112:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b89500 with x1830881273142144 ext(0->4095) 00010000:00010000:1.0:1746065142.039116:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.039123:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.039128:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880124b89500 00000100:00100000:0.0:1746065142.041461:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.041510:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273142272 00000100:00100000:2.0:1746065142.041516:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273142272 00010000:00010000:2.0:1746065142.041543:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.041573:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14659 00000100:00100000:2.0:1746065142.041579:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273142272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.041589:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.041603:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.041617:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.041634:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f8806bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e662c expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.041645:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.041647:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.041653:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 37 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.041659:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 37 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.041684:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 37 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.041695:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267774464:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.041767:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.043603:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267774464:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.043622:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.043662:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273142272:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2082us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.043669:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14659 00000100:00100000:0.0:1746065142.043734:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.044063:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273142528 00000100:00100000:2.0:1746065142.044068:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273142528 00002000:00100000:2.0:1746065142.044108:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e3480 x1830881273142528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.044116:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3480 with x1830881273142528 ext(0->4095) 00002000:00010000:2.0:1746065142.044119:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e3480 00000100:00100000:2.0:1746065142.044301:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13784 00000100:00100000:2.0:1746065142.044307:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273142528:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.044410:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273142528:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (676us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.044416:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13784 00002000:00100000:2.0:1746065142.044420:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e3480 x1830881273142528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.044427:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3480 with x1830881273142528 ext(0->4095) 00002000:00010000:2.0:1746065142.044429:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e3480 00000100:00100000:0.0:1746065142.051732:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.051838:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273142656 00000100:00100000:3.0:1746065142.051846:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273142656 00000100:00100000:3.0:1746065142.051895:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30688 00000100:00100000:3.0:1746065142.051902:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273142656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.051926:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.051940:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e663a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.051964:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 37 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.051970:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.051972:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.051975:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.051997:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 37 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.052007:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 37 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.052016:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267774592:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.052105:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.056190:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267774592:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065142.056403:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065142.056461:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.056476:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065142.056704:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273142656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4802us (4979us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.056712:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30688 00000100:00100000:2.0:1746065142.056975:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273142784 00000100:00100000:2.0:1746065142.056982:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273142784 00002000:00100000:2.0:1746065142.057011:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d1e1c00 x1830881273142784/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.057020:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1c00 with x1830881273142784 ext(0->7) 00010000:00010000:2.0:1746065142.057025:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 38 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.057036:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 38 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.057041:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e1c00 00000100:00100000:2.0:1746065142.057055:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3057 00000100:00100000:2.0:1746065142.057060:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+38:2005:x1830881273142784:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065142.059051:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2005:x1830881273142784:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1984us (2643us total) trans 4294972137 rc 0/0 00000100:00100000:0.0:1746065142.059059:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3057 00002000:00100000:0.0:1746065142.059066:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d1e1c00 x1830881273142784/t4294972137(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.059074:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1c00 with x1830881273142784 ext(0->7) 00010000:00010000:0.0:1746065142.059110:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.059122:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746065142.059138:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e1c00 00000100:00100000:0.0:1746065142.066746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.067056:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273142912 00000100:00100000:3.0:1746065142.067063:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273142912 00000100:00100000:3.0:1746065142.067531:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30689 00000100:00100000:3.0:1746065142.067539:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:1791:x1830881273142912:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.067550:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.067563:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6641 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.067583:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.067587:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.067591:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065142.067594:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 41 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.067621:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.067631:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 41 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.067639:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065142.067685:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:1791:x1830881273142912:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 133us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.067694:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30689 00000100:00100000:0.0:1746065142.070685:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.070831:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273143040 00000100:00100000:3.0:1746065142.070838:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273143040 00010000:00010000:3.0:1746065142.070864:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 41 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.071379:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14660 00000100:00100000:3.0:1746065142.071386:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:2005:x1830881273143040:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.071403:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.071431:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 41 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.071442:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 41 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.071459:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8806c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6633 expref: 41 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.071738:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.071740:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.071747:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.071754:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.071780:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.071790:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.071799:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267774848:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.071870:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.076234:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267774848:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.076248:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.076533:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2005:x1830881273143040:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5145us (5852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.076543:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14660 00000100:00100000:0.0:1746065142.077151:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.077232:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273143296 00000100:00100000:2.0:1746065142.077238:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273143296 00002000:00100000:2.0:1746065142.077270:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e2300 x1830881273143296/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.077277:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2300 with x1830881273143296 ext(0->4095) 00010000:00010000:2.0:1746065142.077284:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.077295:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.077302:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e2300 00000100:00100000:2.0:1746065142.077332:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3058 00000100:00100000:2.0:1746065142.077338:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273143296:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065142.077434:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273143296:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (285us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.077439:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3058 00002000:00100000:2.0:1746065142.077443:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e2300 x1830881273143296/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.077449:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2300 with x1830881273143296 ext(0->4095) 00010000:00010000:2.0:1746065142.077454:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.077467:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.077472:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1e2300 00000100:00100000:0.0:1746065142.080063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.080117:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273143424 00000100:00100000:3.0:1746065142.080123:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273143424 00010000:00010000:3.0:1746065142.080146:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.080172:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14661 00000100:00100000:3.0:1746065142.080180:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273143424:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.080188:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.080201:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.080403:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.080421:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e663a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.080433:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.080435:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.080440:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.080448:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.080474:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.080484:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267774976:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.080556:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.081661:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267774976:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.081671:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.082016:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273143424:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1835us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.082023:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14661 00000100:00100000:0.0:1746065142.082966:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.083103:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273143680 00000100:00100000:2.0:1746065142.083109:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273143680 00002000:00100000:2.0:1746065142.083410:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fc700 x1830881273143680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.083419:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fc700 with x1830881273143680 ext(0->4095) 00002000:00010000:2.0:1746065142.083423:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fc700 00000100:00100000:2.0:1746065142.083445:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13785 00000100:00100000:2.0:1746065142.083536:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2004:x1830881273143680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065142.083645:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2004:x1830881273143680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 194us (680us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.083651:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13785 00002000:00100000:2.0:1746065142.083656:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fc700 x1830881273143680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.083663:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fc700 with x1830881273143680 ext(0->4095) 00002000:00010000:2.0:1746065142.083665:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fc700 00000100:00100000:0.0:1746065142.084893:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.085222:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273143808 00000100:00100000:1.0:1746065142.085228:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273143808 00000100:00100000:1.0:1746065142.085259:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30690 00000100:00100000:1.0:1746065142.085519:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273143808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065142.085529:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.085543:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6648 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.085657:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.085664:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065142.085666:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065142.085669:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.085693:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.085703:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065142.085712:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267775104:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065142.086029:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065142.086894:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267775104:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065142.086919:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.086927:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00000100:00100000:1.0:1746065142.086944:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273143808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1544us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.086949:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30690 00000100:00100000:0.0:1746065142.087009:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.087096:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273143936 00000100:00100000:3.0:1746065142.087100:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273143936 00010000:00010000:3.0:1746065142.087116:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.087136:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14662 00000100:00100000:3.0:1746065142.087140:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2004:x1830881273143936:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.087150:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.087162:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.087379:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.087394:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f8806d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6641 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.087403:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.087404:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.087410:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.087416:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.087436:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.087445:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267775232:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.088202:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.090515:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267775232:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065142.090515:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.090565:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273144192 00000100:00100000:1.0:1746065142.090570:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273144192 00002000:00100000:1.0:1746065142.090600:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fd180 x1830881273144192/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.090608:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fd180 with x1830881273144192 ext(0->4095) 00002000:00010000:1.0:1746065142.090611:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fd180 00000100:00100000:1.0:1746065142.090642:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13786 00000100:00100000:1.0:1746065142.090648:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273144192:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.090742:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273144192:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 93us (231us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.090747:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13786 00002000:00100000:1.0:1746065142.090752:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fd180 x1830881273144192/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.090758:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fd180 with x1830881273144192 ext(0->4095) 00002000:00010000:1.0:1746065142.090760:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fd180 00010000:00010000:3.0:1746065142.090795:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.090819:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:2004:x1830881273143936:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3677us (3810us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.090829:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14662 00000100:00100000:0.0:1746065142.092343:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.092411:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273144320 00000100:00100000:1.0:1746065142.092416:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273144320 00000100:00100000:1.0:1746065142.092449:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30691 00000100:00100000:1.0:1746065142.092454:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:1795:x1830881273144320:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065142.092462:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.092474:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e664f expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.092496:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.092502:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.092504:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.092507:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.092528:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.092538:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 5 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065142.092548:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267775360:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065142.092607:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.092607:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.092693:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273144448 00000100:00100000:3.0:1746065142.092696:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273144448 00000100:00100000:3.0:1746065142.092713:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30692 00000100:00100000:3.0:1746065142.092718:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:1791:x1830881273144448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.092724:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.092729:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6656 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.092739:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.092743:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 42 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.092748:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.092751:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.092771:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 42 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.092781:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.092788:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065142.092820:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1791:x1830881273144448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.092824:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30692 00000100:00100000:1.0:1746065142.093957:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267775360:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065142.093972:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 41 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.093981:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:1.0:1746065142.094010:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:1795:x1830881273144320:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1555us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.094015:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30691 00000100:00100000:0.0:1746065142.094238:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.094363:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273144576 00000100:00100000:2.0:1746065142.094368:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273144576 00010000:00010000:2.0:1746065142.094390:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.094421:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14663 00000100:00100000:2.0:1746065142.094427:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273144576:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.094437:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.094451:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.094460:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.094475:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8806d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6648 expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.094497:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.094499:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.094505:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.094512:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.094533:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 40 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.094541:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 40 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.094554:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267775616:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.094607:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.095595:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267775616:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.095606:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.095634:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273144576:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1207us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.095640:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14663 00000100:00100000:0.0:1746065142.096075:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.096167:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273144832 00000100:00100000:2.0:1746065142.096171:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273144832 00002000:00100000:2.0:1746065142.096196:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0e00 x1830881273144832/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.096205:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0e00 with x1830881273144832 ext(0->4095) 00010000:00010000:2.0:1746065142.096211:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 41 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.096226:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 41 pid: 21550 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.096232:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0e00 00000100:00100000:2.0:1746065142.096251:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3059 00000100:00100000:2.0:1746065142.096257:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:2004:x1830881273144832:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065142.096339:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:2004:x1830881273144832:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 82us (266us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.096348:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3059 00002000:00100000:2.0:1746065142.096353:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0e00 x1830881273144832/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.096360:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0e00 with x1830881273144832 ext(0->4095) 00010000:00010000:2.0:1746065142.096364:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 41 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.096373:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 41 pid: 21550 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.096378:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0e00 00000100:00100000:0.0:1746065142.100678:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.100756:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273144960 00000100:00100000:1.0:1746065142.100765:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273144960 00000100:00100000:1.0:1746065142.100812:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30693 00000100:00100000:1.0:1746065142.100819:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273144960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065142.100832:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.100846:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e665d expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.100866:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065142.100871:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 40 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.100877:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065142.100880:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.100936:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 40 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.100947:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.100954:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:1.0:1746065142.100996:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273144960:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 177us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.101001:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30693 00000100:00100000:0.0:1746065142.101804:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.101903:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273145088 00000100:00100000:2.0:1746065142.101920:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273145088 00010000:00010000:2.0:1746065142.101959:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 41 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.101987:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14664 00000100:00100000:2.0:1746065142.101993:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:2005:x1830881273145088:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.102003:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.102018:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 41 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.102029:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 41 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.102043:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8806de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e664f expref: 41 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.102064:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.102066:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.102071:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 40 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.102078:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 40 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.102113:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 40 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.102123:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.102133:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267775872:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.102183:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.103369:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267775872:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.103380:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.103397:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2005:x1830881273145088:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1405us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.103404:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14664 00000100:00100000:0.0:1746065142.104180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.104230:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273145344 00000100:00100000:2.0:1746065142.104236:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273145344 00002000:00100000:2.0:1746065142.104261:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c1880 x1830881273145344/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.104277:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1880 with x1830881273145344 ext(0->4095) 00010000:00010000:2.0:1746065142.104283:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.104294:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.104300:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c1880 00000100:00100000:2.0:1746065142.104328:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3060 00000100:00100000:2.0:1746065142.104334:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2005:x1830881273145344:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.104539:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2005:x1830881273145344:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 204us (361us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.104545:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3060 00002000:00100000:2.0:1746065142.104550:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c1880 x1830881273145344/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.104556:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1880 with x1830881273145344 ext(0->4095) 00010000:00010000:2.0:1746065142.104560:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.104568:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.104573:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c1880 00000100:00100000:0.0:1746065142.106208:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.106477:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.106645:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273145472 00000100:00100000:2.0:1746065142.106645:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273145600 00000100:00100000:3.0:1746065142.106652:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273145472 00000100:00100000:2.0:1746065142.106652:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273145600 00010000:00010000:2.0:1746065142.106674:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 41 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.106690:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30694 00000100:00100000:2.0:1746065142.106692:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14665 00000100:00100000:2.0:1746065142.106696:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:2005:x1830881273145600:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065142.106697:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:1791:x1830881273145472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.106706:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.106706:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.106717:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6664 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.106721:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 41 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.106729:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 42 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.106808:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.106814:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.106819:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065142.106822:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.106848:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.106859:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.106867:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065142.106904:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1791:x1830881273145472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 208us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.106922:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30694 00010000:00010000:2.0:1746065142.107073:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10200/0x392ae0376f8806e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6656 expref: 41 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.107117:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.107119:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.107125:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.107132:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.107151:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.107161:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 5 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.107172:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267776128:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.107234:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.108987:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267776128:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.109001:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.109241:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2005:x1830881273145600:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2384us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.109250:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14665 00000100:00100000:0.0:1746065142.109788:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.109954:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273145856 00000100:00100000:2.0:1746065142.109959:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273145856 00002000:00100000:2.0:1746065142.109987:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c2d80 x1830881273145856/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.109995:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2d80 with x1830881273145856 ext(0->4095) 00010000:00010000:2.0:1746065142.110001:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.110012:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.110018:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c2d80 00000100:00100000:2.0:1746065142.110038:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3061 00000100:00100000:2.0:1746065142.110044:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273145856:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.110218:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273145856:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 174us (429us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.110226:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3061 00002000:00100000:2.0:1746065142.110232:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c2d80 x1830881273145856/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.110238:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2d80 with x1830881273145856 ext(0->4095) 00010000:00010000:2.0:1746065142.110243:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.110251:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.110257:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c2d80 00000100:00100000:0.0:1746065142.111466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.111528:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273145984 00000100:00100000:2.0:1746065142.111533:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273145984 00010000:00010000:2.0:1746065142.111550:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.111567:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14666 00000100:00100000:2.0:1746065142.111573:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273145984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.111583:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.111595:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.111604:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.111626:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8806ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e665d expref: 6 pid: 21550 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.111652:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.111680:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.111687:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.111695:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.111721:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.111731:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267776256:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.111796:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.113899:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267776256:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.113928:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.113960:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273145984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2386us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.113967:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14666 00000100:00100000:0.0:1746065142.114369:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.115388:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273146240 00000100:00100000:3.0:1746065142.115395:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273146240 00002000:00100000:3.0:1746065142.115426:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0700 x1830881273146240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.115435:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0700 with x1830881273146240 ext(0->4095) 00002000:00010000:3.0:1746065142.115438:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c0700 00000100:00100000:3.0:1746065142.115501:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13787 00000100:00100000:3.0:1746065142.115507:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2005:x1830881273146240:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065142.116866:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2005:x1830881273146240:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 1354us (2492us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.116873:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13787 00002000:00100000:3.0:1746065142.116880:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0700 x1830881273146240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.116889:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0700 with x1830881273146240 ext(0->4095) 00002000:00010000:3.0:1746065142.116892:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c0700 00000100:00100000:0.0:1746065142.120168:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.122928:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273146368 00000100:00100000:3.0:1746065142.122937:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273146368 00000100:00100000:3.0:1746065142.122988:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30695 00000100:00100000:3.0:1746065142.122995:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273146368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.123008:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.123023:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e666b expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.123048:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.123054:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.123056:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.123059:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.123111:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 39 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.123122:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 39 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.123131:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267776384:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.124108:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.126001:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267776384:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.126025:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.126039:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065142.126114:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273146368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3119us (6031us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.126121:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30695 00000100:00100000:0.0:1746065142.127310:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.128754:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273146496 00000100:00100000:3.0:1746065142.128764:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273146496 00002000:00100000:3.0:1746065142.128956:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f7c1c00 x1830881273146496/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.128966:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1c00 with x1830881273146496 ext(0->7) 00010000:00010000:3.0:1746065142.128979:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.128998:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 40 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.129010:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c1c00 00000100:00100000:3.0:1746065142.129404:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3062 00000100:00100000:3.0:1746065142.129412:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2005:x1830881273146496:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065142.130215:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881273146496:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 802us (2905us total) trans 4294972138 rc 0/0 00000100:00100000:0.0:1746065142.130222:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3062 00002000:00100000:0.0:1746065142.130229:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f7c1c00 x1830881273146496/t4294972138(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.130236:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1c00 with x1830881273146496 ext(0->7) 00010000:00010000:0.0:1746065142.130241:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 42 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.130252:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 42 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746065142.130258:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c1c00 00000100:00100000:0.0:1746065142.131850:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.131938:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273146624 00000100:00100000:2.0:1746065142.131944:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273146624 00010000:00010000:2.0:1746065142.131970:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 42 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.132003:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14667 00000100:00100000:2.0:1746065142.132010:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881273146624:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.132024:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.132036:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 42 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.132047:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 42 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.132065:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8806f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6664 expref: 42 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.133320:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.133323:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.133331:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.133339:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.133369:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.133380:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267776512:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.133644:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.135793:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267776512:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.135809:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.135854:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:2004:x1830881273146624:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3843us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.135867:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14667 00000100:00100000:0.0:1746065142.136213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.136238:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273146880 00000100:00100000:1.0:1746065142.136244:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273146880 00002000:00100000:1.0:1746065142.137698:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c3100 x1830881273146880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.137726:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3100 with x1830881273146880 ext(0->4095) 00002000:00010000:1.0:1746065142.137731:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c3100 00000100:00100000:1.0:1746065142.137794:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13788 00000100:00100000:1.0:1746065142.137814:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273146880:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.137966:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273146880:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 165us (1753us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.137992:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13788 00002000:00100000:1.0:1746065142.137998:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c3100 x1830881273146880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.138016:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3100 with x1830881273146880 ext(0->4095) 00002000:00010000:1.0:1746065142.138019:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c3100 00000100:00100000:0.0:1746065142.140986:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.147942:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273147008 00000100:00100000:3.0:1746065142.147953:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273147008 00000100:00100000:3.0:1746065142.148005:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30696 00000100:00100000:3.0:1746065142.148012:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:1791:x1830881273147008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.148024:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.148037:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6672 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.148060:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.148065:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.148067:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.148070:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.148106:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.148117:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.148128:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267776640:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065142.148132:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.148151:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273147136 00000100:00100000:0.0:1746065142.148155:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273147136 00000100:00100000:0.0:1746065142.148178:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30697 00000100:00100000:0.0:1746065142.148183:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1795:x1830881273147136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065142.148189:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.148195:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6679 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.148207:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.148211:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 44 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.148216:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065142.148220:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 44 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.148240:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 44 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.148252:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 44 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.148260:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06200, rc 0) 00000100:00100000:0.0:1746065142.148279:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1795:x1830881273147136:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 95us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.149017:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30697 00000100:00100000:3.0:1746065142.150314:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.152015:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267776640:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.152035:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.152047:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065142.152106:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1791:x1830881273147008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4093us (11124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.152113:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30696 00000100:00100000:0.0:1746065142.157936:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.158043:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273147264 00000100:00100000:2.0:1746065142.158051:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273147264 00010000:00010000:2.0:1746065142.158107:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.158133:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14668 00000100:00100000:2.0:1746065142.158140:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273147264:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.158154:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.158170:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.158180:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.158199:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8806fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e666b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.158903:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.158914:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.158922:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.158930:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.158960:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.158971:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 42 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.158981:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267776896:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.159065:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.161434:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267776896:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.161452:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.161496:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273147264:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3355us (3566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.161504:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14668 00000100:00100000:0.0:1746065142.162484:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.162590:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273147520 00000100:00100000:2.0:1746065142.162597:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273147520 00002000:00100000:2.0:1746065142.162626:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0919f80 x1830881273147520/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.162633:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919f80 with x1830881273147520 ext(0->4095) 00010000:00010000:2.0:1746065142.162639:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.162648:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.162652:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0919f80 00000100:00100000:2.0:1746065142.162675:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3063 00000100:00100000:2.0:1746065142.162680:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2004:x1830881273147520:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065142.162781:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2004:x1830881273147520:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (298us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.162787:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3063 00002000:00100000:2.0:1746065142.162792:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0919f80 x1830881273147520/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.162799:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919f80 with x1830881273147520 ext(0->4095) 00010000:00010000:2.0:1746065142.162804:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.162813:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.162819:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0919f80 00000100:00100000:0.0:1746065142.164189:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.164233:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273147648 00000100:00100000:2.0:1746065142.164238:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273147648 00010000:00010000:2.0:1746065142.164254:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.164281:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14669 00000100:00100000:2.0:1746065142.164285:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2004:x1830881273147648:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.164298:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.164312:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.164319:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.164336:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880701 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6672 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.164352:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.164354:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.164359:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 42 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.164365:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 42 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.164386:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 42 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.164394:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267777024:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.165109:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.166918:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267777024:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.166937:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.166969:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881273147648:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2683us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.166979:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14669 00000100:00100000:0.0:1746065142.167162:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.167200:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273147904 00000100:00100000:3.0:1746065142.167206:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273147904 00002000:00100000:3.0:1746065142.167245:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918000 x1830881273147904/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.167253:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918000 with x1830881273147904 ext(0->4095) 00002000:00010000:3.0:1746065142.167257:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918000 00000100:00100000:3.0:1746065142.167283:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13789 00000100:00100000:3.0:1746065142.167289:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881273147904:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065142.167405:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881273147904:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 115us (243us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.167410:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13789 00002000:00100000:3.0:1746065142.167415:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918000 x1830881273147904/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.167428:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918000 with x1830881273147904 ext(0->4095) 00002000:00010000:3.0:1746065142.167430:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918000 00000100:00100000:0.0:1746065142.169991:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.170237:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273148032 00000100:00100000:3.0:1746065142.170244:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273148032 00000100:00100000:3.0:1746065142.170374:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30698 00000100:00100000:3.0:1746065142.170381:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273148032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.170394:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.170407:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6680 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.170431:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.170437:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.170439:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.170441:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.170462:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.170472:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 41 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.170481:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267777152:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.171311:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.176280:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.176284:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267777152:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.176308:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.176323:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:3.0:1746065142.176386:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273148032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6005us (6400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.176393:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30698 00000100:00100000:2.0:1746065142.176397:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273148160 00000100:00100000:2.0:1746065142.176403:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273148160 00010000:00010000:2.0:1746065142.176445:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 42 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.176488:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14670 00000100:00100000:2.0:1746065142.176512:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881273148160:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.176521:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.176535:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 42 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.176543:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 42 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.176648:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x392ae0376f880708 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6679 expref: 42 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.176671:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.176673:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.176678:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.176685:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.176705:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.176714:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267777280:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.176763:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.179640:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.180030:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273148288 00000100:00100000:3.0:1746065142.180038:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273148288 00000100:00100000:3.0:1746065142.180266:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30699 00000100:00100000:3.0:1746065142.180274:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1791:x1830881273148288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.180289:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.180302:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6687 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.180316:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065142.180325:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.180332:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.180334:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.180337:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.180360:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.180370:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.180381:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267777408:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.180434:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.180448:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273148544 00000100:00100000:3.0:1746065142.180451:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273148544 00002000:00100000:3.0:1746065142.180473:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091b480 x1830881273148544/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.180481:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091b480 with x1830881273148544 ext(0->4095) 00010000:00010000:3.0:1746065142.180486:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.180495:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.180497:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267777280:192.168.202.8@tcp:105: 00002000:00010000:3.0:1746065142.180501:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091b480 00010000:00010000:2.0:1746065142.180511:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.180648:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2005:x1830881273148160:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4153us (4391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.180797:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14670 00000100:00100000:3.0:1746065142.181063:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3064 00000100:00100000:3.0:1746065142.181069:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273148544:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746065142.181635:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273148544:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 565us (1319us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.181641:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3064 00002000:00100000:3.0:1746065142.181646:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091b480 x1830881273148544/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.181654:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091b480 with x1830881273148544 ext(0->4095) 00010000:00010000:3.0:1746065142.181658:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.181667:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.181673:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091b480 00000100:00100000:3.0:1746065142.182228:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267777408:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.182243:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.182255:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065142.182286:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1791:x1830881273148288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2013us (2652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.182293:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30699 00000100:00100000:0.0:1746065142.183392:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.183450:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.183553:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273148800 00000100:00100000:2.0:1746065142.183559:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273148800 00000100:00100000:3.0:1746065142.183593:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273148672 00000100:00100000:3.0:1746065142.183601:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273148672 00000100:00100000:3.0:1746065142.183634:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30700 00000100:00100000:3.0:1746065142.183658:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1795:x1830881273148672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.183668:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.183677:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e668e expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.183878:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.183884:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.183889:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.183895:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746065142.183898:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14671 00010000:00010000:3.0:1746065142.183899:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.183903:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273148800:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.183921:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.183933:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.183940:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.183943:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.183958:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.183965:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.183966:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.183971:0:9635:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.183977:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.183992:0:9635:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.184000:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.184010:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267777664:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.184301:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x392ae0376f88070f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6680 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.184313:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.184332:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273148800:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 429us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.184337:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14671 00000100:00100000:3.0:1746065142.184844:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.187485:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267777664:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.187506:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065142.187553:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1795:x1830881273148672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3895us (4161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.187562:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30700 00000100:00100000:0.0:1746065142.188004:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.188834:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273149056 00000100:00100000:3.0:1746065142.188842:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273149056 00002000:00100000:3.0:1746065142.188874:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918700 x1830881273149056/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.188889:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918700 with x1830881273149056 ext(0->4095) 00010000:00010000:3.0:1746065142.188897:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.188918:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.188924:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918700 00000100:00100000:3.0:1746065142.188953:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3065 00000100:00100000:3.0:1746065142.188959:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2005:x1830881273149056:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065142.189078:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2005:x1830881273149056:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 118us (1074us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.189106:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3065 00002000:00100000:3.0:1746065142.189112:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918700 x1830881273149056/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.189118:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918700 with x1830881273149056 ext(0->4095) 00010000:00010000:3.0:1746065142.189123:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.189136:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.189140:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918700 00000100:00100000:0.0:1746065142.194356:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.194441:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273149184 00000100:00100000:2.0:1746065142.194450:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273149184 00010000:00010000:2.0:1746065142.194481:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.194519:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14672 00000100:00100000:2.0:1746065142.194529:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2004:x1830881273149184:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.194540:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.194556:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.194567:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.194595:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880716 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6687 expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.194617:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.194619:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.194625:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.194632:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.194658:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 42 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.194668:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267777792:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.194737:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.196793:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267777792:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.196810:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.196855:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881273149184:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2329us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.196864:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14672 00000100:00100000:0.0:1746065142.197171:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.197226:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273149440 00000100:00100000:1.0:1746065142.197231:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273149440 00002000:00100000:1.0:1746065142.197259:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918a80 x1830881273149440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.197268:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918a80 with x1830881273149440 ext(0->4095) 00002000:00010000:1.0:1746065142.197272:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918a80 00000100:00100000:1.0:1746065142.197299:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13790 00000100:00100000:1.0:1746065142.197305:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881273149440:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.197397:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881273149440:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 92us (227us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.197403:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13790 00002000:00100000:1.0:1746065142.197409:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918a80 x1830881273149440/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.197416:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918a80 with x1830881273149440 ext(0->4095) 00002000:00010000:1.0:1746065142.197418:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918a80 00000100:00100000:0.0:1746065142.200623:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.200808:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273149568 00000100:00100000:3.0:1746065142.200816:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273149568 00000100:00100000:3.0:1746065142.200930:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30701 00000100:00100000:3.0:1746065142.200939:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273149568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.200954:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.200968:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6695 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.200992:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 41 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.200998:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.201000:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.201003:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.201028:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 41 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.201040:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 41 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.201051:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267777920:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.202191:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.210422:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.210492:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.210653:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273149824 00000100:00100000:1.0:1746065142.210661:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273149824 00000100:00100000:1.0:1746065142.210693:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30702 00000100:00100000:1.0:1746065142.210700:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:1791:x1830881273149824:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065142.210716:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.210730:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e669c expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.210752:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065142.210757:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.210761:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065142.210764:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.210791:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.210801:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 43 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.210810:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd000, rc 0) 00000100:00100000:1.0:1746065142.210846:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:1791:x1830881273149824:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 147us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.210851:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30702 00000100:00100000:3.0:1746065142.211132:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267777920:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.211147:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.211154:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:3.0:1746065142.211176:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273149568:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 10239us (10561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.211182:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30701 00000100:00100000:2.0:1746065142.211246:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273149696 00000100:00100000:2.0:1746065142.211250:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273149696 00010000:00010000:2.0:1746065142.211267:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.211507:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14673 00000100:00100000:2.0:1746065142.211513:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:2004:x1830881273149696:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.211521:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.211535:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.211545:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.211558:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88071d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e668e expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.211748:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.211750:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.211757:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.211768:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.211787:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.211797:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.211807:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267778176:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.220212:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.220243:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267778176:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.220260:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.220872:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2004:x1830881273149696:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 9357us (10454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.220882:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14673 00000100:00100000:2.0:1746065142.221862:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.221918:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273150080 00000100:00100000:3.0:1746065142.221924:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273150080 00002000:00100000:3.0:1746065142.221953:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0000 x1830881273150080/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.221962:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0000 with x1830881273150080 ext(0->4095) 00010000:00010000:3.0:1746065142.221969:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.221981:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.221986:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f0000 00000100:00100000:3.0:1746065142.222555:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3066 00000100:00100000:3.0:1746065142.222562:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273150080:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065142.226021:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273150080:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 3448us (4149us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.226037:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3066 00002000:00100000:3.0:1746065142.226048:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f0000 x1830881273150080/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.226057:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f0000 with x1830881273150080 ext(0->4095) 00010000:00010000:3.0:1746065142.226067:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.226095:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.226102:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f0000 00000100:00100000:0.0:1746065142.233200:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.234504:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273150208 00000100:00100000:2.0:1746065142.234514:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273150208 00010000:00010000:2.0:1746065142.234543:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.234584:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14674 00000100:00100000:2.0:1746065142.234592:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273150208:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.234603:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.234619:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.235201:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.235220:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880724 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6695 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.235234:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.235236:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.235242:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.235249:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.236027:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.236040:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267778304:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.237118:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.240008:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.240210:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267778304:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.240226:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.240276:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273150208:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5684us (7082us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.240285:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14674 00010000:00010000:3.0:1746065142.240355:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065142.241575:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273150464 00000100:00100000:3.0:1746065142.241582:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273150464 00002000:00100000:3.0:1746065142.241618:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4eb480 x1830881273150464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.241627:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eb480 with x1830881273150464 ext(0->4095) 00002000:00010000:3.0:1746065142.241631:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4eb480 00000100:00100000:3.0:1746065142.241660:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13791 00000100:00100000:3.0:1746065142.241667:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881273150464:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065142.241768:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2005:x1830881273150464:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 101us (1767us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.241773:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13791 00002000:00100000:3.0:1746065142.241777:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4eb480 x1830881273150464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.241784:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eb480 with x1830881273150464 ext(0->4095) 00002000:00010000:3.0:1746065142.241786:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4eb480 00000100:00100000:0.0:1746065142.249996:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.251507:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273150592 00000100:00100000:3.0:1746065142.251516:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273150592 00000100:00100000:3.0:1746065142.251572:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30703 00000100:00100000:3.0:1746065142.251581:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273150592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.251594:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.251609:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66a3 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.251635:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.251641:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.251642:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.251645:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.251671:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 41 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.251681:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 41 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.251692:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267778432:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.251768:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.253734:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267778432:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.253755:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.253767:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065142.253806:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273150592:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2226us (3817us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.253812:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30703 00000100:00100000:0.0:1746065142.255478:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.255803:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273150720 00000100:00100000:3.0:1746065142.255811:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273150720 00002000:00100000:3.0:1746065142.255847:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4e9880 x1830881273150720/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.255856:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9880 with x1830881273150720 ext(0->7) 00010000:00010000:3.0:1746065142.255862:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 42 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.255875:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 42 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.255881:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9880 00000100:00100000:3.0:1746065142.255899:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3067 00000100:00100000:3.0:1746065142.255917:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:2003:x1830881273150720:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065142.256805:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2003:x1830881273150720:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 898us (1329us total) trans 4294972139 rc 0/0 00000100:00100000:0.0:1746065142.256811:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3067 00002000:00100000:0.0:1746065142.256817:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4e9880 x1830881273150720/t4294972139(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.256824:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9880 with x1830881273150720 ext(0->7) 00010000:00010000:0.0:1746065142.256829:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 44 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.256837:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 44 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746065142.256842:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9880 00000100:00100000:0.0:1746065142.266430:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.266487:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.266541:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273150976 00000100:00100000:3.0:1746065142.266549:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273150976 00000100:00100000:3.0:1746065142.266588:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30704 00000100:00100000:3.0:1746065142.266594:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:1791:x1830881273150976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.266606:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.266620:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66aa expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.266640:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.266644:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.266649:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065142.266652:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 45 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.266677:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.266686:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 45 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.266694:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065142.266735:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:1791:x1830881273150976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.266740:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30704 00000100:00100000:2.0:1746065142.270396:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273150848 00000100:00100000:2.0:1746065142.270407:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273150848 00010000:00010000:2.0:1746065142.270443:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 45 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.270991:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14675 00000100:00100000:2.0:1746065142.270999:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2002:x1830881273150848:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.271011:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.271027:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 45 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.271038:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 45 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.271056:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f88072b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e669c expref: 45 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.271879:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.271882:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.271890:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.271898:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.271934:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.271943:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.271953:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267778688:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.272032:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.280594:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.280686:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273151232 00000100:00100000:1.0:1746065142.280693:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273151232 00002000:00100000:1.0:1746065142.280730:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e8e00 x1830881273151232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.280740:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8e00 with x1830881273151232 ext(0->4095) 00010000:00010000:1.0:1746065142.280747:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.280762:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.280768:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e8e00 00000100:00100000:1.0:1746065142.280785:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3068 00000100:00100000:1.0:1746065142.280792:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273151232:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.280938:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273151232:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 145us (349us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.280945:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3068 00002000:00100000:1.0:1746065142.280950:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e8e00 x1830881273151232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.280957:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8e00 with x1830881273151232 ext(0->4095) 00010000:00010000:1.0:1746065142.280961:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.280974:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.280979:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e8e00 00000100:00100000:2.0:1746065142.281114:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267778688:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.281130:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.281429:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2002:x1830881273150848:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 10430us (15006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.281436:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14675 00000100:00100000:0.0:1746065142.295019:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.295553:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273151360 00000100:00100000:2.0:1746065142.295562:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273151360 00010000:00010000:2.0:1746065142.295591:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.295625:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14676 00000100:00100000:2.0:1746065142.295630:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273151360:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.295641:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.295656:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.295665:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.295683:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880732 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66a3 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.295711:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.295714:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.295720:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.295727:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.295751:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.295761:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267778816:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.295835:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.297893:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.299419:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267778816:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.299436:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.299468:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273151360:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3837us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.299476:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14676 00000100:00100000:1.0:1746065142.299661:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273151616 00000100:00100000:1.0:1746065142.299667:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273151616 00002000:00100000:1.0:1746065142.299692:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9f80 x1830881273151616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.299700:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9f80 with x1830881273151616 ext(0->4095) 00002000:00010000:1.0:1746065142.299704:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4e9f80 00000100:00100000:1.0:1746065142.299725:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13792 00000100:00100000:1.0:1746065142.299730:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2005:x1830881273151616:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.299823:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2005:x1830881273151616:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 93us (1935us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.299828:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13792 00002000:00100000:1.0:1746065142.299831:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9f80 x1830881273151616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.299837:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9f80 with x1830881273151616 ext(0->4095) 00002000:00010000:1.0:1746065142.299839:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4e9f80 00000100:00100000:0.0:1746065142.318267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.318311:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273151744 00000100:00100000:2.0:1746065142.318320:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273151744 00000100:00100000:2.0:1746065142.318628:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30705 00000100:00100000:2.0:1746065142.318637:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273151744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.318651:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.318665:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66b1 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.318689:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.318700:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.318702:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.318705:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.318730:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 43 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.318741:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 43 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.318752:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267778944:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.319552:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.324013:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.324161:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273151872 00000100:00100000:3.0:1746065142.324168:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273151872 00000100:00100000:2.0:1746065142.324169:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267778944:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.324194:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065142.324204:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4e9180 x1830881273151872/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1746065142.324207:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00002000:00100000:3.0:1746065142.324212:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9180 with x1830881273151872 ext(0->7) 00010000:00010000:3.0:1746065142.324218:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 44 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.324229:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 44 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.324235:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9180 00000100:00100000:2.0:1746065142.324238:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273151744:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5603us (5977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.324243:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30705 00000100:00100000:3.0:1746065142.324259:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3069 00000100:00100000:3.0:1746065142.324266:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2004:x1830881273151872:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065142.325284:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2004:x1830881273151872:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1017us (1276us total) trans 4294972140 rc 0/0 00000100:00100000:0.0:1746065142.325294:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3069 00002000:00100000:0.0:1746065142.325299:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4e9180 x1830881273151872/t4294972140(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.325307:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9180 with x1830881273151872 ext(0->7) 00010000:00010000:0.0:1746065142.325311:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 46 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.325321:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 46 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746065142.325326:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9180 00000100:00100000:0.0:1746065142.333891:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.333940:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.334005:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273152128 00000100:00100000:2.0:1746065142.334012:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273152128 00010000:00010000:2.0:1746065142.334040:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 46 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.334078:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14677 00000100:00100000:2.0:1746065142.334100:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2004:x1830881273152128:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.334113:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.334128:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 46 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.334139:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 46 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.334157:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880739 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66aa expref: 46 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.334173:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.334175:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.334181:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.334188:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.334215:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.334226:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267779072:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.334288:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.334369:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273152000 00000100:00100000:3.0:1746065142.334373:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273152000 00000100:00100000:3.0:1746065142.334396:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30706 00000100:00100000:3.0:1746065142.334400:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:1791:x1830881273152000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.334409:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.334418:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66b8 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.334433:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.334438:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.334440:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.334443:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 47 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.334457:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.334469:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 5 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.334476:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267779200:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.334495:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.337940:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267779200:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.337968:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 47 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.337985:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065142.338032:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:1791:x1830881273152000:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3630us (4090us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.338039:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30706 00000100:00100000:2.0:1746065142.338148:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267779072:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.338160:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.338174:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2004:x1830881273152128:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4076us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.338182:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14677 00000100:00100000:0.0:1746065142.338213:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.338248:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273152384 00000100:00100000:1.0:1746065142.338253:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273152384 00002000:00100000:1.0:1746065142.338283:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9c00 x1830881273152384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.338298:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9c00 with x1830881273152384 ext(0->4095) 00010000:00010000:1.0:1746065142.338304:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.338314:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.338320:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9c00 00000100:00100000:1.0:1746065142.338335:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3070 00000100:00100000:1.0:1746065142.338341:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273152384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.338436:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273152384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (223us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.338441:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3070 00002000:00100000:1.0:1746065142.338446:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e9c00 x1830881273152384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.338453:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9c00 with x1830881273152384 ext(0->4095) 00010000:00010000:1.0:1746065142.338458:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.338467:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.338473:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e9c00 00000100:00100000:0.0:1746065142.341564:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.341872:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273152512 00000100:00100000:2.0:1746065142.341880:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273152512 00010000:00010000:2.0:1746065142.341915:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.341947:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14678 00000100:00100000:2.0:1746065142.341954:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273152512:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.341966:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.341980:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.341991:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.342009:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880740 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b1 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.342032:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.342034:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.342040:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 45 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.342048:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 45 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.342074:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 45 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.342103:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267779328:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.342174:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.343833:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267779328:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.343847:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.343879:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273152512:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1925us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.344004:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.344052:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273152768 00000100:00100000:0.0:1746065142.344057:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273152768 00000100:00100000:2.0:1746065142.344076:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14678 00002000:00100000:0.0:1746065142.344099:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e8700 x1830881273152768/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.344107:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8700 with x1830881273152768 ext(0->4095) 00002000:00010000:0.0:1746065142.344110:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4e8700 00000100:00100000:0.0:1746065142.344124:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13793 00000100:00100000:0.0:1746065142.344129:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881273152768:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065142.344286:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2005:x1830881273152768:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 155us (281us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065142.344292:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13793 00002000:00100000:0.0:1746065142.344297:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4e8700 x1830881273152768/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.344303:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8700 with x1830881273152768 ext(0->4095) 00002000:00010000:0.0:1746065142.344306:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4e8700 00000100:00100000:2.0:1746065142.345698:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.345779:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273152896 00000100:00100000:3.0:1746065142.345784:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273152896 00000100:00100000:3.0:1746065142.345810:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30707 00000100:00100000:3.0:1746065142.345815:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273152896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.345824:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.345836:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66bf expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.345855:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 45 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.345865:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.345866:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.345869:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.345890:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 45 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.345899:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 45 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.346032:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267779456:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.346245:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.347746:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267779456:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.347771:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.347785:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065142.347829:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273152896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2012us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.347836:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30707 00000100:00100000:0.0:1746065142.348353:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.348627:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273153024 00000100:00100000:2.0:1746065142.348633:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273153024 00002000:00100000:2.0:1746065142.348667:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4e8380 x1830881273153024/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.348675:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8380 with x1830881273153024 ext(0->7) 00010000:00010000:2.0:1746065142.348681:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 46 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.348691:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 46 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.348696:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e8380 00000100:00100000:2.0:1746065142.349066:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3071 00000100:00100000:2.0:1746065142.349073:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+46:2003:x1830881273153024:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065142.351033:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2003:x1830881273153024:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1955us (2675us total) trans 4294972141 rc 0/0 00000100:00100000:0.0:1746065142.351042:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3071 00002000:00100000:0.0:1746065142.351050:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4e8380 x1830881273153024/t4294972141(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.351058:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8380 with x1830881273153024 ext(0->7) 00010000:00010000:0.0:1746065142.351064:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.351078:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746065142.351103:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4e8380 00000100:00100000:0.0:1746065142.357352:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.357843:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273153152 00000100:00100000:2.0:1746065142.357850:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273153152 00010000:00010000:2.0:1746065142.357882:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.357926:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14679 00000100:00100000:2.0:1746065142.357934:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2003:x1830881273153152:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.357945:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.357960:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.357971:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.357988:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880747 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66b8 expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.359204:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.359207:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.359216:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.359224:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.361345:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.361363:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267779584:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.362121:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.363956:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.364053:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267779584:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.364072:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065142.364098:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273153408 00000100:00100000:1.0:1746065142.364105:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273153408 00000100:00100000:3.0:1746065142.364132:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+47:2003:x1830881273153152:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6198us (6787us total) trans 0 rc 0/0 00002000:00100000:1.0:1746065142.364137:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4ea680 x1830881273153408/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065142.364140:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14679 00002000:00100000:1.0:1746065142.364145:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ea680 with x1830881273153408 ext(0->4095) 00002000:00010000:1.0:1746065142.364150:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4ea680 00000100:00100000:1.0:1746065142.364166:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13794 00000100:00100000:1.0:1746065142.364172:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273153408:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.364262:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273153408:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 91us (311us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.364268:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13794 00002000:00100000:1.0:1746065142.364273:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4ea680 x1830881273153408/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.364279:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ea680 with x1830881273153408 ext(0->4095) 00002000:00010000:1.0:1746065142.364282:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4ea680 00000100:00100000:0.0:1746065142.367494:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.367573:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.367660:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273153536 00000100:00100000:2.0:1746065142.367667:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273153536 00000100:00100000:2.0:1746065142.367706:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273153664 00000100:00100000:2.0:1746065142.367709:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273153664 00000100:00100000:2.0:1746065142.367722:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30708 00000100:00100000:2.0:1746065142.367728:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:1795:x1830881273153536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.367740:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.367753:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66c6 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.367774:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.367781:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.367783:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.367786:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 49 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.367808:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.367818:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 5 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.367828:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267779712:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.367881:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.369379:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30709 00000100:00100000:3.0:1746065142.369394:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:1791:x1830881273153664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.369405:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.369416:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66cd expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.369432:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.369436:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 50 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.369452:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.369455:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 50 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.369478:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 50 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.369489:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 50 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.369497:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065142.369524:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:1791:x1830881273153664:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 137us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.370142:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30709 00000100:00100000:2.0:1746065142.371015:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267779712:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.371034:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 49 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.371047:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:2.0:1746065142.371071:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:1795:x1830881273153536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3343us (3582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.371076:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30708 00000100:00100000:0.0:1746065142.371740:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.373552:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273153792 00000100:00100000:3.0:1746065142.373561:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273153792 00010000:00010000:3.0:1746065142.373591:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.374802:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14680 00000100:00100000:3.0:1746065142.374815:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273153792:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.374828:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.374845:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.374857:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.374875:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f88074e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66bf expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.374914:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.374916:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.374921:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 48 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.374928:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 48 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.374960:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 48 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.374970:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 48 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.374979:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267779968:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.375043:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.380709:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267779968:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.380727:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.380769:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273153792:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5958us (9030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.380779:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14680 00000100:00100000:3.0:1746065142.380847:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.387543:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273154048 00000100:00100000:1.0:1746065142.387553:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273154048 00002000:00100000:1.0:1746065142.387591:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88ad80 x1830881273154048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.387601:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88ad80 with x1830881273154048 ext(0->4095) 00010000:00010000:1.0:1746065142.387609:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 49 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.387621:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 49 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.387632:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e88ad80 00000100:00100000:1.0:1746065142.387649:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3072 00000100:00100000:1.0:1746065142.387655:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881273154048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.387786:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881273154048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 131us (6938us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.387793:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3072 00002000:00100000:1.0:1746065142.387798:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88ad80 x1830881273154048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.387805:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88ad80 with x1830881273154048 ext(0->4095) 00010000:00010000:1.0:1746065142.387809:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 49 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.387817:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 49 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.387822:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e88ad80 00000100:00100000:0.0:1746065142.390803:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.390889:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273154176 00000100:00100000:2.0:1746065142.390895:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273154176 00000100:00100000:3.0:1746065142.392141:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30710 00000100:00100000:3.0:1746065142.392151:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273154176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.392166:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.392182:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66d4 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.392204:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.392210:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.392215:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065142.392219:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.392248:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.392257:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.392266:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065142.392319:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273154176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 169us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.392325:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30710 00000100:00100000:0.0:1746065142.392728:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.393462:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273154304 00000100:00100000:3.0:1746065142.393468:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273154304 00010000:00010000:3.0:1746065142.393488:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 49 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.395076:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14681 00000100:00100000:3.0:1746065142.395110:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2004:x1830881273154304:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.395122:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.395139:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 49 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.395151:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 49 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.395168:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880755 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66c6 expref: 49 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.395717:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.395720:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.395882:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.395979:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.396206:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.396218:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.396228:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267780224:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.396743:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.399945:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267780224:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.399962:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.400005:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2004:x1830881273154304:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4900us (7276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.400014:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14681 00000100:00100000:0.0:1746065142.400806:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.400977:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273154560 00000100:00100000:3.0:1746065142.400982:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273154560 00002000:00100000:3.0:1746065142.401010:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54aa00 x1830881273154560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.401022:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54aa00 with x1830881273154560 ext(0->4095) 00010000:00010000:3.0:1746065142.401029:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.401039:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.401045:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54aa00 00000100:00100000:3.0:1746065142.401602:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3073 00000100:00100000:3.0:1746065142.401610:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2004:x1830881273154560:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065142.401727:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2004:x1830881273154560:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 117us (922us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.401733:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3073 00002000:00100000:3.0:1746065142.401738:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54aa00 x1830881273154560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.401744:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54aa00 with x1830881273154560 ext(0->4095) 00010000:00010000:3.0:1746065142.401749:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.401758:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.401763:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54aa00 00000100:00100000:0.0:1746065142.405758:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.406287:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.406435:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273154816 00000100:00100000:3.0:1746065142.406443:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273154816 00010000:00010000:3.0:1746065142.406474:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 48 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.406644:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273154688 00000100:00100000:2.0:1746065142.406647:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273154688 00000100:00100000:2.0:1746065142.406679:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30711 00000100:00100000:2.0:1746065142.406685:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:1791:x1830881273154688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.406697:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.406708:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66db expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.406738:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.406743:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.406748:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:3.0:1746065142.407193:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14682 00000100:00100000:3.0:1746065142.407199:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2005:x1830881273154816:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.407208:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.407257:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 50 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.407311:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 50 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.407322:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 50 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.407336:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88075c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66cd expref: 50 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.407354:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.407355:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.407360:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.407366:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.407388:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.407397:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 5 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.407407:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267780352:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.407458:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00010000:00010000:2.0:1746065142.407677:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 5 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.407685:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 5 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.407696:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267780480:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.407730:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.413588:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267780352:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.413604:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.413638:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+49:2005:x1830881273154816:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6439us (7351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.413647:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14682 00000100:00100000:2.0:1746065142.413728:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267780480:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.413747:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 48 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.413761:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065142.413779:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:1791:x1830881273154688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7095us (8029us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.413785:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30711 00000100:00100000:0.0:1746065142.415024:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.415116:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273155072 00000100:00100000:1.0:1746065142.415123:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273155072 00002000:00100000:1.0:1746065142.415154:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549500 x1830881273155072/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.415162:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549500 with x1830881273155072 ext(0->4095) 00010000:00010000:1.0:1746065142.415168:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.415183:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.415189:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549500 00000100:00100000:1.0:1746065142.415263:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3074 00000100:00100000:1.0:1746065142.415300:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273155072:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.415708:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273155072:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 407us (685us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.415714:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3074 00002000:00100000:1.0:1746065142.415720:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549500 x1830881273155072/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.415726:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549500 with x1830881273155072 ext(0->4095) 00010000:00010000:1.0:1746065142.415730:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.415739:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.415744:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549500 00000100:00100000:0.0:1746065142.417977:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.418141:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273155200 00000100:00100000:3.0:1746065142.418148:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273155200 00010000:00010000:3.0:1746065142.418171:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.418284:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14683 00000100:00100000:3.0:1746065142.418291:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273155200:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.418301:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.418316:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.418326:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.418344:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880763 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66d4 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.418358:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.418361:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.418367:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 47 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.418373:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 47 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.418397:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 47 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.418406:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267780608:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.418468:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.423158:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267780608:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.423175:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.423217:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273155200:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4926us (5244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.423225:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14683 00000100:00100000:0.0:1746065142.425305:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.425984:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273155456 00000100:00100000:1.0:1746065142.425992:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273155456 00002000:00100000:1.0:1746065142.426025:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549f80 x1830881273155456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.426034:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549f80 with x1830881273155456 ext(0->4095) 00002000:00010000:1.0:1746065142.426040:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d549f80 00000100:00100000:1.0:1746065142.426068:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13795 00000100:00100000:1.0:1746065142.426075:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2004:x1830881273155456:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.426567:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2004:x1830881273155456:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 491us (1267us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.426573:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13795 00002000:00100000:1.0:1746065142.426579:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549f80 x1830881273155456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.426585:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549f80 with x1830881273155456 ext(0->4095) 00002000:00010000:1.0:1746065142.426588:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d549f80 00000100:00100000:0.0:1746065142.432312:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.432482:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273155584 00000100:00100000:2.0:1746065142.432490:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273155584 00000100:00100000:2.0:1746065142.432535:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30712 00000100:00100000:2.0:1746065142.432542:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273155584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.432556:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.432570:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66e2 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.432594:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 47 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.432601:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.432602:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.432605:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.432632:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 47 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.432641:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 47 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.432650:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267780736:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.432709:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.436474:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267780736:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.436501:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.436516:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064000, rc 0) 00000100:00100000:2.0:1746065142.436555:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273155584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4013us (4251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.436562:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30712 00000100:00100000:0.0:1746065142.440982:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.441485:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273155712 00000100:00100000:1.0:1746065142.441495:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273155712 00002000:00100000:1.0:1746065142.441535:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d548380 x1830881273155712/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.441544:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548380 with x1830881273155712 ext(0->7) 00010000:00010000:1.0:1746065142.441553:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 48 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.441567:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 48 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.441574:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548380 00000100:00100000:1.0:1746065142.441606:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3075 00000100:00100000:1.0:1746065142.441613:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+48:2002:x1830881273155712:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065142.442889:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2002:x1830881273155712:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1272us (1911us total) trans 4294972142 rc 0/0 00000100:00100000:0.0:1746065142.442896:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3075 00002000:00100000:0.0:1746065142.442910:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d548380 x1830881273155712/t4294972142(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.442918:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548380 with x1830881273155712 ext(0->7) 00010000:00010000:0.0:1746065142.442924:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 50 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.442934:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 50 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746065142.442940:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548380 00000100:00100000:0.0:1746065142.469789:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.470442:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273155968 00000100:00100000:2.0:1746065142.470450:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273155968 00000100:00100000:0.0:1746065142.470472:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.471257:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30713 00000100:00100000:2.0:1746065142.471265:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:1791:x1830881273155968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.471281:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.471297:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66e9 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.471320:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.471326:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.471331:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065142.471334:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 51 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.471364:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.471376:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 51 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.471385:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065142.471423:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+51:1791:x1830881273155968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 158us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.471428:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30713 00000100:00100000:2.0:1746065142.472584:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273155840 00000100:00100000:2.0:1746065142.472590:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273155840 00010000:00010000:2.0:1746065142.472607:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 51 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.472992:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14684 00000100:00100000:2.0:1746065142.472999:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+51:2003:x1830881273155840:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.473009:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.473024:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 51 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.473038:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 51 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.473053:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88076a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66db expref: 51 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.473243:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.473244:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.473250:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.473258:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.473278:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.473287:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.473297:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267780992:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.473358:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.475636:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267780992:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.475650:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.476377:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2003:x1830881273155840:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3375us (5902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.476389:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14684 00000100:00100000:0.0:1746065142.476791:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.477115:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273156224 00000100:00100000:2.0:1746065142.477121:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273156224 00002000:00100000:2.0:1746065142.477150:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548a80 x1830881273156224/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.477159:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548a80 with x1830881273156224 ext(0->4095) 00010000:00010000:2.0:1746065142.477166:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.477177:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.477182:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548a80 00000100:00100000:2.0:1746065142.477206:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3076 00000100:00100000:2.0:1746065142.477213:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273156224:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.477316:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273156224:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 102us (526us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.477322:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3076 00002000:00100000:2.0:1746065142.477326:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548a80 x1830881273156224/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.477334:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548a80 with x1830881273156224 ext(0->4095) 00010000:00010000:2.0:1746065142.477338:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.477351:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.477357:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548a80 00000100:00100000:0.0:1746065142.479864:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.480545:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273156352 00000100:00100000:2.0:1746065142.480552:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273156352 00010000:00010000:2.0:1746065142.480574:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.480761:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14685 00000100:00100000:2.0:1746065142.480768:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273156352:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.480780:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.480794:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.480804:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.480821:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880771 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e2 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.481073:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.481075:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.481102:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 49 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.481113:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 49 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.481140:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 49 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.481464:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267781120:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.481540:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.485149:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267781120:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065142.485168:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065142.485215:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273156352:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4446us (5356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.485225:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14685 00000100:00100000:0.0:1746065142.485976:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.486488:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273156608 00000100:00100000:3.0:1746065142.486494:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273156608 00002000:00100000:3.0:1746065142.486525:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548000 x1830881273156608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.486535:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548000 with x1830881273156608 ext(0->4095) 00002000:00010000:3.0:1746065142.486540:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548000 00000100:00100000:3.0:1746065142.486565:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13796 00000100:00100000:3.0:1746065142.486571:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2005:x1830881273156608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065142.486680:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2005:x1830881273156608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 109us (705us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.486686:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13796 00002000:00100000:3.0:1746065142.486690:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548000 x1830881273156608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.486696:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548000 with x1830881273156608 ext(0->4095) 00002000:00010000:3.0:1746065142.486699:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548000 00000100:00100000:0.0:1746065142.491751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.491958:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273156736 00000100:00100000:3.0:1746065142.491966:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273156736 00000100:00100000:3.0:1746065142.492018:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30714 00000100:00100000:3.0:1746065142.492026:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273156736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.492042:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.492057:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66f0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.492112:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 49 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.492119:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.492121:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.492124:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.492150:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 49 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.492160:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 49 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.492174:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267781248:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.492247:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.494025:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.494126:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273156864 00000100:00100000:2.0:1746065142.494132:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273156864 00002000:00100000:2.0:1746065142.494165:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d54b480 x1830881273156864/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.494174:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b480 with x1830881273156864 ext(0->7) 00010000:00010000:2.0:1746065142.494181:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 50 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.494192:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 50 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.494198:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54b480 00000100:00100000:2.0:1746065142.494225:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3077 00000100:00100000:2.0:1746065142.494231:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+50:2004:x1830881273156864:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746065142.494393:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267781248:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.494413:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.494428:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:3.0:1746065142.494476:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273156736:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2451us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.494483:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30714 00000100:00100000:0.0:1746065142.505200:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2004:x1830881273156864:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 10959us (11170us total) trans 4294972143 rc 0/0 00000100:00100000:0.0:1746065142.505211:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3077 00002000:00100000:0.0:1746065142.505222:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d54b480 x1830881273156864/t4294972143(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.505230:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b480 with x1830881273156864 ext(0->7) 00010000:00010000:0.0:1746065142.505238:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 52 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.505253:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 52 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746065142.505259:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54b480 00000100:00100000:0.0:1746065142.506811:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.506879:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273156992 00000100:00100000:3.0:1746065142.506886:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273156992 00000100:00100000:3.0:1746065142.506935:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30715 00000100:00100000:3.0:1746065142.506942:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:1791:x1830881273156992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.506954:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.506967:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66f7 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.506988:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.506992:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.506997:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065142.506999:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 53 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.507195:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.507207:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 53 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.507215:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065142.507276:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:1791:x1830881273156992:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 334us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.507280:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30715 00000100:00100000:0.0:1746065142.508925:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.509039:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273157120 00000100:00100000:2.0:1746065142.509045:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273157120 00010000:00010000:2.0:1746065142.509068:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 53 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.509121:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14686 00000100:00100000:2.0:1746065142.509127:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2005:x1830881273157120:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.509137:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.509151:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 53 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.509160:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 53 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.509177:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880778 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66e9 expref: 53 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.509191:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.509192:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.509198:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.509205:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.509227:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.509236:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 5 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.509250:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267781504:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.509315:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.511487:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.511636:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273157376 00000100:00100000:1.0:1746065142.511643:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273157376 00002000:00100000:1.0:1746065142.511675:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548e00 x1830881273157376/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.511683:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548e00 with x1830881273157376 ext(0->4095) 00010000:00010000:1.0:1746065142.511690:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.511701:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.511706:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548e00 00000100:00100000:1.0:1746065142.511721:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3078 00000100:00100000:1.0:1746065142.511727:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273157376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.511826:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273157376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 98us (343us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.511831:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3078 00002000:00100000:1.0:1746065142.511835:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d548e00 x1830881273157376/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.511841:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548e00 with x1830881273157376 ext(0->4095) 00010000:00010000:1.0:1746065142.511845:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.511853:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.511858:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d548e00 00000100:00100000:2.0:1746065142.512218:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267781504:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.512233:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.512652:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2005:x1830881273157120:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3524us (3730us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.512660:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14686 00000100:00100000:0.0:1746065142.520829:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.521027:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273157504 00000100:00100000:2.0:1746065142.521036:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273157504 00010000:00010000:2.0:1746065142.521064:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.522113:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14687 00000100:00100000:2.0:1746065142.522123:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273157504:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.522136:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.522153:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.522164:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.522179:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88077f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f0 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.522198:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.522200:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.522205:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 51 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.522212:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 51 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.522236:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 51 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.522245:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267781632:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.522305:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.524817:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267781632:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.524834:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.526777:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273157504:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4650us (5949us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.526788:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14687 00000100:00100000:3.0:1746065142.527571:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.527947:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273157760 00000100:00100000:1.0:1746065142.527954:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273157760 00002000:00100000:1.0:1746065142.527987:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e889f80 x1830881273157760/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.527996:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889f80 with x1830881273157760 ext(0->4095) 00002000:00010000:1.0:1746065142.528001:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e889f80 00000100:00100000:1.0:1746065142.528028:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13797 00000100:00100000:1.0:1746065142.528034:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2004:x1830881273157760:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.528183:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2004:x1830881273157760:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 148us (612us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.528189:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13797 00002000:00100000:1.0:1746065142.528195:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e889f80 x1830881273157760/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.528201:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e889f80 with x1830881273157760 ext(0->4095) 00002000:00010000:1.0:1746065142.528204:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e889f80 00000100:00100000:0.0:1746065142.531162:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.531314:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273157888 00000100:00100000:3.0:1746065142.531321:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273157888 00000100:00100000:3.0:1746065142.531542:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30716 00000100:00100000:3.0:1746065142.531550:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273157888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.531563:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.531577:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e66fe expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.531600:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 51 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.531606:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.531608:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.531611:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.531639:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 51 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.531650:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 51 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.531659:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267781760:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.533088:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.533798:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.533891:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267781760:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.533921:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.533934:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:2.0:1746065142.534572:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273158016 00000100:00100000:2.0:1746065142.534577:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273158016 00010000:00010000:2.0:1746065142.534598:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 52 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.534616:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14688 00000100:00100000:2.0:1746065142.534621:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2005:x1830881273158016:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.534630:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.534644:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 52 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.534655:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 52 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.534672:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f880786 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66f7 expref: 52 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.534685:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.534687:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.534693:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.534699:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.534740:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.534749:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267781888:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.534806:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273157888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3257us (3650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.534813:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30716 00000100:00100000:2.0:1746065142.535785:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.537459:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.538251:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273158144 00000100:00100000:3.0:1746065142.538257:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273158144 00000100:00100000:3.0:1746065142.538501:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30717 00000100:00100000:3.0:1746065142.538508:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:1791:x1830881273158144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.538521:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.538533:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6705 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.538554:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.538561:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.538562:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.538565:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.538587:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.538598:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 5 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.538608:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267782016:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.538666:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.538804:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.539271:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267781888:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.539284:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.539315:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2005:x1830881273158016:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4692us (5519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.539323:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14688 00000100:00100000:3.0:1746065142.541546:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273158400 00000100:00100000:3.0:1746065142.541556:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273158400 00002000:00100000:3.0:1746065142.541590:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb95880 x1830881273158400/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.541600:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb95880 with x1830881273158400 ext(0->4095) 00010000:00010000:3.0:1746065142.541606:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.541618:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.541624:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb95880 00000100:00100000:3.0:1746065142.541656:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3079 00000100:00100000:3.0:1746065142.541663:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273158400:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065142.541768:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273158400:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 105us (2963us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.541774:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3079 00002000:00100000:3.0:1746065142.541779:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb95880 x1830881273158400/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.541786:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb95880 with x1830881273158400 ext(0->4095) 00010000:00010000:3.0:1746065142.541790:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.541799:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.541804:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb95880 00000100:00100000:3.0:1746065142.543764:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267782016:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.543785:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 52 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.543799:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065142.543842:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:1791:x1830881273158144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5334us (6389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.543848:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30717 00000100:00100000:0.0:1746065142.545547:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.545762:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.545859:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273158656 00000100:00100000:2.0:1746065142.545865:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273158656 00010000:00010000:2.0:1746065142.545893:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.546040:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273158528 00000100:00100000:3.0:1746065142.546044:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273158528 00000100:00100000:3.0:1746065142.546073:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30718 00000100:00100000:3.0:1746065142.546102:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:1795:x1830881273158528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.546115:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.546128:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e670c expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.546146:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.546150:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.546156:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.546158:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.546184:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.546194:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.546202:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:3.0:1746065142.546230:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:1795:x1830881273158528:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 151us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.546235:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30718 00000100:00100000:2.0:1746065142.546380:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14689 00000100:00100000:2.0:1746065142.546386:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273158656:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.546395:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.546410:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.546419:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.546434:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88078d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e66fe expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.546446:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.546447:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.546452:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 52 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.546458:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 52 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.546476:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 52 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.546485:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 52 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.546498:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267782272:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.546535:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.550635:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.550649:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267782272:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.550673:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.550706:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273158656:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4320us (5164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.550715:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14689 00000100:00100000:1.0:1746065142.550885:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273158912 00000100:00100000:1.0:1746065142.550891:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273158912 00002000:00100000:1.0:1746065142.550955:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d652680 x1830881273158912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.550963:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652680 with x1830881273158912 ext(0->4095) 00010000:00010000:1.0:1746065142.550970:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.550981:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.550991:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d652680 00000100:00100000:1.0:1746065142.551014:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3080 00000100:00100000:1.0:1746065142.551020:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2004:x1830881273158912:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.551212:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2004:x1830881273158912:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 192us (583us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.551218:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3080 00002000:00100000:1.0:1746065142.551233:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d652680 x1830881273158912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.551239:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652680 with x1830881273158912 ext(0->4095) 00010000:00010000:1.0:1746065142.551250:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.552158:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.552165:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d652680 00000100:00100000:0.0:1746065142.554034:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.554435:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273159040 00000100:00100000:2.0:1746065142.554442:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273159040 00010000:00010000:2.0:1746065142.554465:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.554504:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14690 00000100:00100000:2.0:1746065142.554510:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2002:x1830881273159040:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.554521:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.554536:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.554546:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.554564:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880794 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6705 expref: 53 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.554860:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.554863:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.554869:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 52 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.554876:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 52 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.554909:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 52 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.554919:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267782400:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.554992:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.557705:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.557783:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273159296 00000100:00100000:1.0:1746065142.557792:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273159296 00002000:00100000:1.0:1746065142.557827:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d651c00 x1830881273159296/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.557836:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651c00 with x1830881273159296 ext(0->4095) 00002000:00010000:1.0:1746065142.557842:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d651c00 00000100:00100000:1.0:1746065142.557866:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13798 00000100:00100000:1.0:1746065142.557871:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2004:x1830881273159296:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.557980:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2004:x1830881273159296:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 108us (279us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.557986:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13798 00002000:00100000:1.0:1746065142.557991:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d651c00 x1830881273159296/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.557998:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651c00 with x1830881273159296 ext(0->4095) 00002000:00010000:1.0:1746065142.558000:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d651c00 00000100:00100000:2.0:1746065142.558265:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267782400:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.558282:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.558303:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2002:x1830881273159040:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3794us (4278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.558310:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14690 00000100:00100000:0.0:1746065142.560603:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.561965:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273159424 00000100:00100000:3.0:1746065142.561975:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273159424 00000100:00100000:3.0:1746065142.562047:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30719 00000100:00100000:3.0:1746065142.562054:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273159424:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.562069:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.562096:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6713 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.562122:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 51 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.562128:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.562129:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.562132:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.562156:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 51 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.562165:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 51 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.562176:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267782528:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.562881:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.564739:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e88b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267782528:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.564769:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.564782:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065142.564814:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273159424:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2761us (4216us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.564823:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30719 00000100:00100000:0.0:1746065142.567588:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.567670:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.567982:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273159552 00000100:00100000:2.0:1746065142.567990:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273159552 00010000:00010000:2.0:1746065142.568017:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 52 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.568106:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273159680 00000100:00100000:3.0:1746065142.568110:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273159680 00000100:00100000:3.0:1746065142.568134:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30720 00000100:00100000:3.0:1746065142.568141:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:1791:x1830881273159680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.568153:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.568165:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e671a expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.568184:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.568190:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.568195:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065142.568198:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 54 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.568225:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.568235:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 54 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.568242:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065142.568276:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:1791:x1830881273159680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 136us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.568281:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30720 00000100:00100000:2.0:1746065142.568472:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14691 00000100:00100000:2.0:1746065142.568478:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2005:x1830881273159552:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.568486:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.568501:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 53 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.568516:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 53 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.568529:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f88079b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e670c expref: 53 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.568541:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.568542:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.568547:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.568553:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.568568:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.568576:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 5 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.568585:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267782784:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.568625:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.570652:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.570738:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267782784:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.570754:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.570781:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2005:x1830881273159552:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2304us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.570792:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14691 00000100:00100000:3.0:1746065142.570863:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273159936 00000100:00100000:3.0:1746065142.570868:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273159936 00002000:00100000:3.0:1746065142.570936:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d650e00 x1830881273159936/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.570944:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d650e00 with x1830881273159936 ext(0->4095) 00010000:00010000:3.0:1746065142.570951:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.570961:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.570966:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d650e00 00000100:00100000:3.0:1746065142.571269:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3081 00000100:00100000:3.0:1746065142.571276:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273159936:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746065142.571357:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273159936:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 82us (711us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.571361:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3081 00002000:00100000:3.0:1746065142.571365:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d650e00 x1830881273159936/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.571372:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d650e00 with x1830881273159936 ext(0->4095) 00010000:00010000:3.0:1746065142.571376:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.571384:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.571393:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d650e00 00000100:00100000:0.0:1746065142.574780:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.574874:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273160064 00000100:00100000:2.0:1746065142.574882:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273160064 00010000:00010000:2.0:1746065142.574917:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.575071:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14692 00000100:00100000:2.0:1746065142.575078:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273160064:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.575189:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.575205:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.575216:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.575234:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8807a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6713 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.575371:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.575373:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.575378:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 51 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.575385:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 51 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.575410:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 51 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.575419:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267782912:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.575731:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.578356:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267782912:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.578376:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.578417:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273160064:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3339us (3643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.578425:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14692 00000100:00100000:0.0:1746065142.580368:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.580470:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273160320 00000100:00100000:1.0:1746065142.580478:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273160320 00002000:00100000:1.0:1746065142.580523:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d650000 x1830881273160320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.580534:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d650000 with x1830881273160320 ext(0->4095) 00002000:00010000:1.0:1746065142.580538:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d650000 00000100:00100000:1.0:1746065142.580571:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13799 00000100:00100000:1.0:1746065142.580578:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2005:x1830881273160320:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.580695:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2005:x1830881273160320:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 118us (332us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.580701:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13799 00002000:00100000:1.0:1746065142.580705:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d650000 x1830881273160320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.580711:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d650000 with x1830881273160320 ext(0->4095) 00002000:00010000:1.0:1746065142.580714:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d650000 00000100:00100000:0.0:1746065142.589683:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.589863:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273160448 00000100:00100000:2.0:1746065142.589870:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273160448 00000100:00100000:2.0:1746065142.589920:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30721 00000100:00100000:2.0:1746065142.589927:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273160448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.589941:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.589954:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6721 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.589986:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 51 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.589992:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.589993:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.589996:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.590019:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 51 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.590034:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 51 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.590045:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267783040:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.590128:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.593898:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267783040:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.593935:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.593950:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065142.593986:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273160448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4059us (4310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.593994:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30721 00000100:00100000:0.0:1746065142.606888:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.606989:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273160576 00000100:00100000:3.0:1746065142.606997:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273160576 00002000:00100000:3.0:1746065142.607035:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d652300 x1830881273160576/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.607044:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652300 with x1830881273160576 ext(0->7) 00010000:00010000:3.0:1746065142.607052:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 52 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.607065:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 52 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065142.607071:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d652300 00000100:00100000:3.0:1746065142.607129:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3082 00000100:00100000:3.0:1746065142.607136:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+52:2004:x1830881273160576:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746065142.607766:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c4d7531-7474-4559-997c-c1b3824c301a:3765:1830881267783168:0@lo:400:kworker.0 00000100:00100000:1.0:1746065142.607810:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065142.607854:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065142.607859:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830881267783296:0@lo:400:kworker.0 00000100:00100000:1.0:1746065142.607878:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065142.607913:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267783168 00000100:00100000:1.0:1746065142.607917:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267783168 00000100:00100000:1.0:1746065142.607939:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1746065142.607944:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3765:x1830881267783168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065142.607972:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3765:x1830881267783168:12345-0@lo:400:kworker.0 Request processed in 28us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.607978:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1746065142.608010:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c4d7531-7474-4559-997c-c1b3824c301a:3765:1830881267783168:0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608071:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267783296 00000100:00100000:3.0:1746065142.608074:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267783296 00000100:00100000:3.0:1746065142.608109:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1746065142.608114:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3765:x1830881267783296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608144:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3765:x1830881267783296:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.608149:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1746065142.608340:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267783424:0@lo:400:kworker.0 00000100:00100000:1.0:1746065142.608363:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065142.608395:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830881267783296:0@lo:400:kworker.0 00000100:00100000:2.0:1746065142.608501:0:8373:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267783424 00000100:00100000:2.0:1746065142.608505:0:8373:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267783424 00000100:00100000:3.0:1746065142.608538:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3768:1830881267783552:0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608558:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065142.608570:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267784064:0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608586:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065142.608597:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267784576:0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608610:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065142.608619:0:3768:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065142.608623:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a091a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3768:1830881267783936:0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608635:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065142.608643:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3768:1830881267784448:0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608657:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065142.608672:0:11924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267783552 00000100:00100000:3.0:1746065142.608675:0:11924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267783552 00000100:00100000:3.0:1746065142.608689:0:11924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267783936 00000100:00100000:3.0:1746065142.608690:0:11924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267783936 00000100:00100000:3.0:1746065142.608705:0:11924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267784448 00000100:00100000:3.0:1746065142.608707:0:11924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267784448 00000100:00100000:3.0:1746065142.608719:0:11924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1746065142.608723:0:11924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3768:x1830881267783552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608747:0:11924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3768:x1830881267783552:12345-0@lo:400:kworker.0 Request processed in 24us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.608751:0:11924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1746065142.608759:0:11924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1746065142.608762:0:11924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3768:x1830881267783936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608778:0:11924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3768:x1830881267783936:12345-0@lo:400:kworker.0 Request processed in 16us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.608782:0:11924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1746065142.608788:0:11924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1746065142.608801:0:11924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3768:x1830881267784448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608818:0:11924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3768:x1830881267784448:12345-0@lo:400:kworker.0 Request processed in 26us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.608822:0:11924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1746065142.608846:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a091a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3768:1830881267783936:0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608853:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3768:1830881267784448:0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608860:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3768:1830881267783552:0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608875:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267784064 00000100:00100000:3.0:1746065142.608877:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267784064 00000100:00100000:3.0:1746065142.608894:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267784576 00000100:00100000:3.0:1746065142.608896:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267784576 00000100:00100000:3.0:1746065142.608924:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:3.0:1746065142.608929:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267784064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608953:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267784064:12345-0@lo:400:kworker.0 Request processed in 24us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.608957:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:3.0:1746065142.608965:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:3.0:1746065142.608969:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267784576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.608986:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267784576:12345-0@lo:400:kworker.0 Request processed in 17us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.608989:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:3.0:1746065142.609006:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267784064:0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.609013:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267784576:0@lo:400:kworker.0 00000100:00080000:3.0:1746065142.609043:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746065142.609046:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746065142.609049:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065142.609127:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267783680:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.609149:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065142.609482:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a091a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267784192:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.609498:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065142.609535:0:8373:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267783680 00000100:00100000:2.0:1746065142.609537:0:8373:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267783680 00000100:00100000:2.0:1746065142.609555:0:8373:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1746065142.609559:0:8373:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3767:x1830881267783424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065142.609584:0:8373:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3767:x1830881267783424:12345-0@lo:400:kworker.0 Request processed in 25us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.609588:0:8373:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1746065142.609596:0:8373:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1746065142.609599:0:8373:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267783680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065142.609613:0:8373:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267783680:12345-0@lo:400:kworker.0 Request processed in 14us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.609617:0:8373:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1746065142.609632:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267783424:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.610450:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267784704:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.610471:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065142.610782:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267783680:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.610791:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065142.610796:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3765:1830881267783808:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.610813:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065142.610825:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3765:1830881267784320:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.610839:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065142.611120:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267784192 00000100:00100000:1.0:1746065142.611124:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267784192 00000100:00100000:1.0:1746065142.611152:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267784704 00000100:00100000:1.0:1746065142.611154:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267784704 00000100:00100000:1.0:1746065142.611178:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1746065142.611183:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267784192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065142.611215:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267784192:12345-0@lo:400:kworker.0 Request processed in 32us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.611220:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1746065142.611229:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1746065142.611234:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267784704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065142.611252:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267784704:12345-0@lo:400:kworker.0 Request processed in 19us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.611257:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1746065142.611919:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267783808 00000100:00100000:3.0:1746065142.611923:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267783808 00000100:00100000:3.0:1746065142.611958:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267784320 00000100:00100000:3.0:1746065142.611961:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267784320 00000100:00100000:3.0:1746065142.611974:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1746065142.611984:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830881267783808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.612020:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830881267783808:12345-0@lo:400:kworker.0 Request processed in 35us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.612024:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1746065142.612033:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1746065142.612037:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3765:x1830881267784320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065142.612061:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3765:x1830881267784320:12345-0@lo:400:kworker.0 Request processed in 24us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.612065:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:0.0:1746065142.612169:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746065142.612173:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065142.612176:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065142.612198:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3765:1830881267783808:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.612205:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3765:1830881267784320:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.612212:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a091a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267784192:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.612220:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267784704:0@lo:400:kworker.0 00000100:00100000:0.0:1746065142.612427:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273160576:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 5289us (5544us total) trans 4294972144 rc 0/0 00000100:00100000:0.0:1746065142.612434:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3082 00002000:00100000:0.0:1746065142.612441:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d652300 x1830881273160576/t4294972144(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.612455:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d652300 with x1830881273160576 ext(0->7) 00010000:00010000:0.0:1746065142.612462:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 54 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.612474:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 54 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746065142.612485:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d652300 00000100:00100000:2.0:1746065142.621487:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.621558:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273160704 00000100:00100000:0.0:1746065142.621565:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273160704 00010000:00010000:0.0:1746065142.621590:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 54 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746065142.622457:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14693 00000100:00100000:0.0:1746065142.622464:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2002:x1830881273160704:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.622476:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065142.622490:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 54 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.622501:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 54 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.622517:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8807a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e671a expref: 54 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065142.623486:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.623489:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.623498:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.623505:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.623533:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.623544:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d650a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267784832:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065142.623637:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.625638:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.625710:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273160960 00000100:00100000:1.0:1746065142.625718:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273160960 00002000:00100000:1.0:1746065142.625750:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb94380 x1830881273160960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.625758:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb94380 with x1830881273160960 ext(0->4095) 00002000:00010000:1.0:1746065142.625763:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb94380 00000100:00100000:1.0:1746065142.625781:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13800 00000100:00100000:1.0:1746065142.625787:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273160960:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065142.625914:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273160960:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 127us (280us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.625921:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13800 00002000:00100000:1.0:1746065142.625926:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb94380 x1830881273160960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.625933:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb94380 with x1830881273160960 ext(0->4095) 00002000:00010000:1.0:1746065142.625936:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb94380 00000100:00100000:2.0:1746065142.626011:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d650a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267784832:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.626025:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.626045:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2002:x1830881273160704:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3582us (4566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.626052:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14693 00000100:00100000:0.0:1746065142.630977:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.632223:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.632254:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273161088 00000100:00100000:3.0:1746065142.632261:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273161088 00000100:00100000:3.0:1746065142.632311:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30722 00000100:00100000:3.0:1746065142.632318:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:1791:x1830881273161088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.632333:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.632346:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6728 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.632368:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.632374:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.632375:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.632379:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.632404:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.632414:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.632424:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267784960:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.632663:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273161216 00000100:00100000:2.0:1746065142.632667:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273161216 00000100:00100000:3.0:1746065142.632977:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.633049:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30723 00000100:00100000:2.0:1746065142.633055:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1795:x1830881273161216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.633062:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.633068:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e672f expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.633079:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.633097:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.633102:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.633105:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.633125:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.633136:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.633143:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065142.633526:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1795:x1830881273161216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 470us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.633532:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30723 00000100:00100000:3.0:1746065142.635551:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267784960:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.635569:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 55 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.635579:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065142.635610:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1791:x1830881273161088:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3293us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.635616:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30722 00000100:00100000:0.0:1746065142.635839:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.636784:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273161344 00000100:00100000:2.0:1746065142.636789:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273161344 00010000:00010000:2.0:1746065142.636812:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.637099:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14694 00000100:00100000:2.0:1746065142.637106:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273161344:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.637115:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.637129:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.637138:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.637153:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8807b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6721 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.637250:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.637252:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.637258:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.637264:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.637285:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.637293:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.637302:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267785216:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.637645:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.639369:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267785216:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.639384:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.639412:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273161344:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2305us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.639420:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14694 00000100:00100000:1.0:1746065142.639773:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.639954:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273161600 00000100:00100000:2.0:1746065142.639959:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273161600 00002000:00100000:2.0:1746065142.639987:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4000 x1830881273161600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.639997:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4000 with x1830881273161600 ext(0->4095) 00010000:00010000:2.0:1746065142.640003:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.640018:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.640024:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff4000 00000100:00100000:2.0:1746065142.640050:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3083 00000100:00100000:2.0:1746065142.640057:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2004:x1830881273161600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065142.640312:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2004:x1830881273161600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 254us (539us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.640326:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3083 00002000:00100000:2.0:1746065142.640331:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fff4000 x1830881273161600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.640338:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4000 with x1830881273161600 ext(0->4095) 00010000:00010000:2.0:1746065142.640342:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.640350:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.640356:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff4000 00000100:00100000:0.0:1746065142.641839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.642566:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273161728 00000100:00100000:2.0:1746065142.642573:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273161728 00010000:00010000:2.0:1746065142.642593:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.643029:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14695 00000100:00100000:2.0:1746065142.643038:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273161728:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.643052:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.643067:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.643078:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.643121:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8807b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6728 expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.643134:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.643136:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.643142:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.643149:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.643188:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.643198:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267785344:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.643438:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.645144:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.645229:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273161984 00000100:00100000:3.0:1746065142.645235:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273161984 00002000:00100000:3.0:1746065142.645264:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b800 x1830881273161984/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.645273:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b800 with x1830881273161984 ext(0->4095) 00002000:00010000:3.0:1746065142.645277:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077b800 00000100:00100000:3.0:1746065142.645292:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13801 00000100:00100000:3.0:1746065142.645298:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273161984:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065142.645409:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273161984:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 110us (267us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.645414:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13801 00002000:00100000:3.0:1746065142.645419:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b800 x1830881273161984/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.645426:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b800 with x1830881273161984 ext(0->4095) 00002000:00010000:3.0:1746065142.645428:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077b800 00000100:00100000:2.0:1746065142.645510:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267785344:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.645525:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.645544:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881273161728:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2508us (3709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.645551:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14695 00000100:00100000:0.0:1746065142.648126:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.648237:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273162112 00000100:00100000:3.0:1746065142.648244:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273162112 00000100:00100000:3.0:1746065142.648381:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30724 00000100:00100000:3.0:1746065142.648388:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273162112:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.648402:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.648415:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6736 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.648441:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.648447:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.648448:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.648452:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.648474:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.648487:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 53 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.648497:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267785472:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.649196:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.652250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.652825:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267785472:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.652849:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.652863:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:2.0:1746065142.653165:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273162240 00000100:00100000:2.0:1746065142.653171:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273162240 00010000:00010000:2.0:1746065142.653195:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.653372:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273162112:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4983us (5250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.653379:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30724 00000100:00100000:2.0:1746065142.653592:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14696 00000100:00100000:2.0:1746065142.653599:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881273162240:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.653609:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.653624:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.653633:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.653649:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f8807be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e672f expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.653669:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.653671:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.653677:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.653683:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.653708:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.653720:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267785600:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.653768:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.656488:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.656947:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267785600:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.656963:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065142.657202:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.657388:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273162368 00000100:00100000:3.0:1746065142.657394:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273162368 00000100:00100000:3.0:1746065142.657436:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30725 00000100:00100000:3.0:1746065142.657443:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:1791:x1830881273162368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.657456:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.657469:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e673d expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.657492:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.657502:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.657504:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.657507:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.657530:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.657540:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 5 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.657550:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267785728:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.657719:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273162240:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4120us (5475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.657727:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14696 00000100:00100000:2.0:1746065142.658345:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065142.658670:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273162624 00000100:00100000:1.0:1746065142.658675:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273162624 00002000:00100000:1.0:1746065142.658702:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130778e00 x1830881273162624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.658711:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130778e00 with x1830881273162624 ext(0->4095) 00010000:00010000:1.0:1746065142.658718:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.658730:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.658735:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130778e00 00000100:00100000:1.0:1746065142.658759:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3084 00000100:00100000:1.0:1746065142.658764:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273162624:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.658864:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273162624:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 100us (1661us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.658869:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3084 00002000:00100000:1.0:1746065142.658874:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130778e00 x1830881273162624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.658880:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130778e00 with x1830881273162624 ext(0->4095) 00010000:00010000:1.0:1746065142.658884:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.658893:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.658914:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130778e00 00000100:00100000:2.0:1746065142.662186:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267785728:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.662216:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.662247:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:2.0:1746065142.662283:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:1791:x1830881273162368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4840us (5801us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.662291:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30725 00000100:00100000:0.0:1746065142.663171:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.663218:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.663384:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273162752 00000100:00100000:2.0:1746065142.663389:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273162752 00000100:00100000:2.0:1746065142.663416:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30726 00000100:00100000:2.0:1746065142.663422:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:1795:x1830881273162752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.663433:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.663445:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6744 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.663465:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.663469:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.663474:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.663476:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 55 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.663499:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.663508:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 55 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.663514:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065c00, rc 0) 00000100:00100000:2.0:1746065142.663548:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1795:x1830881273162752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 126us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.663552:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30726 00000100:00100000:3.0:1746065142.664056:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273162880 00000100:00100000:3.0:1746065142.664060:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273162880 00010000:00010000:3.0:1746065142.664078:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.664123:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14697 00000100:00100000:3.0:1746065142.664129:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273162880:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.664138:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.664152:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.664161:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.664181:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f8807c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6736 expref: 6 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.664195:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.664196:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.664201:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.664208:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.664226:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.664236:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.664246:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267785984:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.664287:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.667236:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267785984:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.667253:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065142.667514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.667799:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273162880:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3667us (4578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.667808:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14697 00000100:00100000:2.0:1746065142.668049:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273163136 00000100:00100000:2.0:1746065142.668055:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273163136 00002000:00100000:2.0:1746065142.668098:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130779180 x1830881273163136/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.668106:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779180 with x1830881273163136 ext(0->4095) 00010000:00010000:2.0:1746065142.668113:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.668128:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.668133:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130779180 00000100:00100000:2.0:1746065142.668485:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3085 00000100:00100000:2.0:1746065142.668491:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273163136:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.668589:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273163136:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (1076us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.668594:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3085 00002000:00100000:2.0:1746065142.668599:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130779180 x1830881273163136/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.668606:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779180 with x1830881273163136 ext(0->4095) 00010000:00010000:2.0:1746065142.668610:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.668618:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.668623:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130779180 00000100:00100000:0.0:1746065142.670816:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.670934:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273163264 00000100:00100000:3.0:1746065142.670941:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273163264 00010000:00010000:3.0:1746065142.670967:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.671106:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14698 00000100:00100000:3.0:1746065142.671112:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2002:x1830881273163264:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.671123:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.671139:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.671149:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.671167:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8807cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e673d expref: 55 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.671190:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.671191:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.671198:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.671205:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065142.671312:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267786240:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1746065142.671327:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.671336:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267786112:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.671389:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065142.671437:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065142.671567:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267786240 00000100:00100000:3.0:1746065142.671570:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267786240 00000100:00100000:3.0:1746065142.671587:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1746065142.671592:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3766:x1830881267786240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746065142.671604:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 503192384 pending 688128 free 3920867328 avail 3689345024 00000100:00100000:3.0:1746065142.671628:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3766:x1830881267786240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.671633:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1746065142.671698:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267786240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746065142.674208:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267786112:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.674224:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.674261:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2002:x1830881273163264:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3149us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.674270:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14698 00000100:00100000:0.0:1746065142.674655:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.674780:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273163520 00000100:00100000:2.0:1746065142.674786:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273163520 00002000:00100000:2.0:1746065142.674816:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b3800 x1830881273163520/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.674824:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b3800 with x1830881273163520 ext(0->4095) 00002000:00010000:2.0:1746065142.674829:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b3800 00000100:00100000:2.0:1746065142.674856:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13802 00000100:00100000:2.0:1746065142.674862:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881273163520:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.674962:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881273163520:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 100us (308us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.674967:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13802 00002000:00100000:2.0:1746065142.674971:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b3800 x1830881273163520/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.674978:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b3800 with x1830881273163520 ext(0->4095) 00002000:00010000:2.0:1746065142.674980:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b3800 00000100:00100000:2.0:1746065142.677488:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.677602:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273163648 00000100:00100000:0.0:1746065142.677609:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273163648 00000100:00100000:0.0:1746065142.677653:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30727 00000100:00100000:0.0:1746065142.677660:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273163648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065142.677671:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.677684:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e674b expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.677705:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 53 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.677712:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065142.677713:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065142.677716:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.677737:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 53 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.677748:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 53 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746065142.677757:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800729b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267786368:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065142.677823:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.681168:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800729b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267786368:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.681194:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.681207:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd11800, rc 0) 00000100:00100000:2.0:1746065142.681251:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273163648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3591us (3767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.681258:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30727 00000100:00100000:0.0:1746065142.682631:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.682721:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273163776 00000100:00100000:3.0:1746065142.682728:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273163776 00010000:00010000:3.0:1746065142.682751:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.682781:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14699 00000100:00100000:3.0:1746065142.682787:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273163776:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.682797:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.682811:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.682821:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.682839:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f8807d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6744 expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.682860:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.682861:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.682867:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.682874:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.682927:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.682937:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267786496:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.683662:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.684980:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.685889:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267786496:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.685912:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.685953:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2004:x1830881273163776:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3165us (3323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.685962:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14699 00000100:00100000:2.0:1746065142.686503:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273163904 00000100:00100000:2.0:1746065142.686509:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273163904 00000100:00100000:2.0:1746065142.686547:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30728 00000100:00100000:2.0:1746065142.686552:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:1791:x1830881273163904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.686566:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.686579:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6752 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.686600:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.686606:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.686608:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.686611:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.686631:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.686640:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.686649:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267786624:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.686699:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.688169:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.688363:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273164160 00000100:00100000:2.0:1746065142.688367:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273164160 00002000:00100000:2.0:1746065142.688392:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2680 x1830881273164160/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.688400:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2680 with x1830881273164160 ext(0->4095) 00010000:00010000:2.0:1746065142.688405:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.688415:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.688421:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b2680 00000100:00100000:2.0:1746065142.688444:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3086 00000100:00100000:2.0:1746065142.688449:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273164160:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.689131:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273164160:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 679us (963us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.689137:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3086 00002000:00100000:2.0:1746065142.689142:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b2680 x1830881273164160/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.689149:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b2680 with x1830881273164160 ext(0->4095) 00010000:00010000:2.0:1746065142.689154:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.689162:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.689167:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800729b2680 00000100:00100000:2.0:1746065142.689378:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267786624:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.689393:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.689404:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065142.689430:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:1791:x1830881273163904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2878us (4454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.689438:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30728 00000100:00100000:0.0:1746065142.691330:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.692201:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273164288 00000100:00100000:2.0:1746065142.692209:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273164288 00000100:00100000:2.0:1746065142.692255:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30729 00000100:00100000:2.0:1746065142.692262:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:1795:x1830881273164288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.692276:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.692290:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6759 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.692309:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.692314:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.692319:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.692322:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.692349:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.692360:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.692368:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065142.693327:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1795:x1830881273164288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1061us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.693335:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30729 00000100:00100000:0.0:1746065142.693555:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.693687:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273164416 00000100:00100000:3.0:1746065142.693693:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273164416 00010000:00010000:3.0:1746065142.693714:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.693743:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14700 00000100:00100000:3.0:1746065142.693748:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273164416:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.693756:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.693769:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.693778:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.693792:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11800/0x392ae0376f8807da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e674b expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.693811:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.693813:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.693818:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.693824:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.693842:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.693850:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.693863:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267786880:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.693921:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.696457:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.696526:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273164672 00000100:00100000:2.0:1746065142.696532:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273164672 00002000:00100000:2.0:1746065142.696564:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffdf80 x1830881273164672/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.696573:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffdf80 with x1830881273164672 ext(0->4095) 00010000:00010000:2.0:1746065142.696580:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.696592:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.696598:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffdf80 00000100:00100000:2.0:1746065142.696704:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3087 00000100:00100000:2.0:1746065142.696710:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273164672:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065142.697056:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267786880:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.697069:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.697218:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273164672:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 507us (766us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.697224:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3087 00002000:00100000:2.0:1746065142.697230:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffdf80 x1830881273164672/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.697238:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffdf80 with x1830881273164672 ext(0->4095) 00010000:00010000:2.0:1746065142.697242:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.697250:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.697260:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffdf80 00000100:00100000:3.0:1746065142.697311:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273164416:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3562us (3756us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.697318:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14700 00000100:00100000:0.0:1746065142.700015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.700185:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273164800 00000100:00100000:3.0:1746065142.700192:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273164800 00010000:00010000:3.0:1746065142.700218:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.700545:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14701 00000100:00100000:3.0:1746065142.700552:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273164800:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.700564:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.700580:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.700590:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.700608:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f8807e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6752 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.700712:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.700715:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.700721:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.700728:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.700754:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.700764:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267787008:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.701502:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.704210:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.704296:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267787008:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.704311:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.704354:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881273164800:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3801us (4342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.704363:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14701 00000100:00100000:0.0:1746065142.704425:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273165056 00000100:00100000:0.0:1746065142.704432:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273165056 00002000:00100000:0.0:1746065142.704461:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b89f80 x1830881273165056/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.704469:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b89f80 with x1830881273165056 ext(0->4095) 00002000:00010000:0.0:1746065142.704473:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b89f80 00000100:00100000:0.0:1746065142.704486:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13803 00000100:00100000:0.0:1746065142.704492:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273165056:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065142.704581:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273165056:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 89us (378us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065142.704587:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13803 00002000:00100000:0.0:1746065142.704591:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b89f80 x1830881273165056/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.704598:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b89f80 with x1830881273165056 ext(0->4095) 00002000:00010000:0.0:1746065142.704600:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b89f80 00000100:00100000:0.0:1746065142.706607:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.707317:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273165184 00000100:00100000:2.0:1746065142.707324:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273165184 00000100:00100000:2.0:1746065142.707364:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30730 00000100:00100000:2.0:1746065142.707370:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273165184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.707384:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.707397:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6760 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.707418:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.707424:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.707425:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.707428:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.707450:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.707459:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 53 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.707468:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267787136:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.707842:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.709249:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267787136:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.709268:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.709280:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065142.709307:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273165184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1937us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.709314:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30730 00000100:00100000:0.0:1746065142.711155:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.711267:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273165312 00000100:00100000:3.0:1746065142.711274:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273165312 00010000:00010000:3.0:1746065142.711298:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.711393:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14702 00000100:00100000:3.0:1746065142.711399:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273165312:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.711412:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.711429:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.711444:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.711461:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8807e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6759 expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.711663:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.711664:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.711672:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.711680:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.711704:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.711714:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267787264:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.711835:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.714825:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.714861:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.714893:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273165696 00000100:00100000:0.0:1746065142.714910:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273165696 00000100:00100000:0.0:1746065142.714944:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30731 00000100:00100000:0.0:1746065142.714950:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:1791:x1830881273165696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065142.714964:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.714978:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6767 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.714999:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.715005:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.715006:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.715009:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.715032:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.715043:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746065142.715054:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072a05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267787392:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065142.715157:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.715265:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267787264:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.715279:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.715299:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2004:x1830881273165312:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3900us (4149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.715307:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14702 00000100:00100000:2.0:1746065142.715399:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273165568 00000100:00100000:2.0:1746065142.715403:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273165568 00002000:00100000:2.0:1746065142.715424:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1880 x1830881273165568/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.715432:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1880 with x1830881273165568 ext(0->4095) 00010000:00010000:2.0:1746065142.715437:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.715445:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.715451:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a1880 00000100:00100000:2.0:1746065142.715462:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3088 00000100:00100000:2.0:1746065142.715466:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273165568:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.715545:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273165568:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 78us (726us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.715550:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3088 00002000:00100000:2.0:1746065142.715554:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306a1880 x1830881273165568/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.715561:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306a1880 with x1830881273165568 ext(0->4095) 00010000:00010000:2.0:1746065142.715565:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.715573:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.715578:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306a1880 00000100:00100000:2.0:1746065142.719129:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.719507:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273165824 00000100:00100000:0.0:1746065142.719516:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273165824 00000100:00100000:0.0:1746065142.719557:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30732 00000100:00100000:0.0:1746065142.719564:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1795:x1830881273165824:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065142.719580:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.719594:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e676e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.719616:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.719621:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.719626:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065142.719630:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.719662:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.719674:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.719687:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd10000, rc 0) 00000100:00100000:0.0:1746065142.721121:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1795:x1830881273165824:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1551us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.721129:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30732 00000100:00100000:2.0:1746065142.722236:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072a05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267787392:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.722261:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.722274:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd10200, rc 0) 00000100:00100000:2.0:1746065142.722320:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1791:x1830881273165696:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7370us (7458us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.722327:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30731 00000100:00100000:0.0:1746065142.722815:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.722952:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273165952 00000100:00100000:3.0:1746065142.722957:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273165952 00010000:00010000:3.0:1746065142.722981:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.723011:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14703 00000100:00100000:3.0:1746065142.723016:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273165952:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.723027:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.723042:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.723052:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.723069:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f8807ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6760 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.723097:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.723098:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.723104:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.723111:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.723136:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.723145:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.723160:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267787648:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.723220:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.725980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.726573:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267787648:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.726590:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.726629:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273165952:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3611us (3813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.726637:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14703 00000100:00100000:1.0:1746065142.727406:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273166208 00000100:00100000:1.0:1746065142.727413:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273166208 00002000:00100000:1.0:1746065142.727446:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f980380 x1830881273166208/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.727455:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980380 with x1830881273166208 ext(0->4095) 00010000:00010000:1.0:1746065142.727461:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.727473:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.727478:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f980380 00000100:00100000:1.0:1746065142.727505:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3089 00000100:00100000:1.0:1746065142.727511:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273166208:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.727611:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273166208:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 100us (1639us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.727616:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3089 00002000:00100000:1.0:1746065142.727621:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f980380 x1830881273166208/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.727628:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980380 with x1830881273166208 ext(0->4095) 00010000:00010000:1.0:1746065142.727632:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.727641:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.727651:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f980380 00000100:00100000:0.0:1746065142.730793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.730880:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273166336 00000100:00100000:3.0:1746065142.730887:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273166336 00010000:00010000:3.0:1746065142.730925:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.731070:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14704 00000100:00100000:3.0:1746065142.731077:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2004:x1830881273166336:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.731225:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.731241:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.731253:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.731272:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10200/0x392ae0376f8807f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6767 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.731294:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.731296:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.731302:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.731309:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.731336:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.731347:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267787776:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.731809:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.733889:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267787776:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.733912:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.733942:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273166336:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2865us (3157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.733951:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14704 00000100:00100000:0.0:1746065142.735355:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.735413:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273166592 00000100:00100000:2.0:1746065142.735420:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273166592 00002000:00100000:2.0:1746065142.735451:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f981c00 x1830881273166592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.735460:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981c00 with x1830881273166592 ext(0->4095) 00002000:00010000:2.0:1746065142.735464:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f981c00 00000100:00100000:2.0:1746065142.735618:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13804 00000100:00100000:2.0:1746065142.735625:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881273166592:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.735726:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881273166592:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 102us (374us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.735731:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13804 00002000:00100000:2.0:1746065142.735736:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f981c00 x1830881273166592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.735742:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f981c00 with x1830881273166592 ext(0->4095) 00002000:00010000:2.0:1746065142.735745:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f981c00 00000100:00100000:0.0:1746065142.737504:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.737568:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273166720 00000100:00100000:2.0:1746065142.737572:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273166720 00000100:00100000:2.0:1746065142.737790:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30733 00000100:00100000:2.0:1746065142.737796:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273166720:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.737807:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.737820:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6775 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.737840:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 53 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.737847:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.737848:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.737851:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.737871:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 53 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.737885:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 53 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.737894:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267787904:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.737965:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.739375:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267787904:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.739393:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.739404:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:2.0:1746065142.739427:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273166720:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1630us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.739434:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30733 00000100:00100000:0.0:1746065142.741007:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.741282:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273166848 00000100:00100000:3.0:1746065142.741289:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273166848 00010000:00010000:3.0:1746065142.741317:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.741353:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14705 00000100:00100000:3.0:1746065142.741360:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273166848:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.741372:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.741392:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.741407:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.741425:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8807fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e676e expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.741443:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.741444:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.741451:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.741457:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.741483:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.741493:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267788032:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.741563:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.744020:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.744143:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267788032:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.744157:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.744189:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:2004:x1830881273166848:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2829us (3189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.744199:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14705 00000100:00100000:1.0:1746065142.744271:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273167104 00000100:00100000:1.0:1746065142.744277:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273167104 00002000:00100000:1.0:1746065142.744305:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91500 x1830881273167104/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.744312:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91500 with x1830881273167104 ext(0->4095) 00002000:00010000:1.0:1746065142.744317:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c91500 00000100:00100000:1.0:1746065142.744338:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13805 00000100:00100000:1.0:1746065142.744344:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273167104:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.744435:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273167104:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 91us (422us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.744440:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13805 00002000:00100000:1.0:1746065142.744445:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91500 x1830881273167104/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.744452:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91500 with x1830881273167104 ext(0->4095) 00002000:00010000:1.0:1746065142.744454:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c91500 00000100:00100000:0.0:1746065142.747678:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.747918:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273167232 00000100:00100000:2.0:1746065142.747927:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273167232 00000100:00100000:2.0:1746065142.747962:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30734 00000100:00100000:2.0:1746065142.747968:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+53:1791:x1830881273167232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.747983:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.747997:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e677c expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.748023:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.748033:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.748035:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.748038:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.748062:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.748071:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.748114:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267788160:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.748187:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.749511:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.750414:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273167360 00000100:00100000:0.0:1746065142.750423:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273167360 00000100:00100000:0.0:1746065142.750462:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30735 00000100:00100000:0.0:1746065142.750468:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1795:x1830881273167360:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065142.750481:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.750495:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6783 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.750516:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.750520:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.750526:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065142.750529:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.750559:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.750569:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.750576:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd11200, rc 0) 00000100:00100000:0.0:1746065142.750612:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1795:x1830881273167360:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 144us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.750617:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30735 00000100:00100000:3.0:1746065142.750832:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267788160:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.750848:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.750855:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065c00, rc 0) 00000100:00100000:3.0:1746065142.750872:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1791:x1830881273167232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2905us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.750877:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30734 00000100:00100000:0.0:1746065142.752403:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.752832:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273167488 00000100:00100000:3.0:1746065142.752839:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273167488 00010000:00010000:3.0:1746065142.752867:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.753073:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14706 00000100:00100000:3.0:1746065142.753104:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273167488:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.753115:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.753130:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.753140:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.753157:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880804 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6775 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.753174:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.753176:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.753181:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.753189:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.753212:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 54 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.753220:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.753229:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267788416:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.753292:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.755348:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267788416:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.755366:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.755839:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273167488:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2757us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.755850:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14706 00000100:00100000:0.0:1746065142.756300:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.756815:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273167744 00000100:00100000:2.0:1746065142.756821:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273167744 00002000:00100000:2.0:1746065142.756855:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5c00 x1830881273167744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.756864:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5c00 with x1830881273167744 ext(0->4095) 00010000:00010000:2.0:1746065142.756871:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.756883:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.756889:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a5c00 00000100:00100000:2.0:1746065142.756921:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3090 00000100:00100000:2.0:1746065142.756927:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273167744:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.757042:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273167744:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 115us (743us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.757047:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3090 00002000:00100000:2.0:1746065142.757052:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5c00 x1830881273167744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.757058:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5c00 with x1830881273167744 ext(0->4095) 00010000:00010000:2.0:1746065142.757063:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.757071:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.757076:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979a5c00 00000100:00100000:0.0:1746065142.759691:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.760069:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273167872 00000100:00100000:3.0:1746065142.760077:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273167872 00010000:00010000:3.0:1746065142.760132:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.760169:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14707 00000100:00100000:3.0:1746065142.760177:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273167872:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.760188:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.760205:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.760216:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.760233:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065c00/0x392ae0376f88080b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e677c expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.760250:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.760252:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.760259:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.760267:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.760295:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 54 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.760305:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267788544:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.760379:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.764265:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.764399:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267788544:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.764414:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.764448:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881273167872:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4271us (4763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.764457:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14707 00000100:00100000:1.0:1746065142.764579:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273168128 00000100:00100000:1.0:1746065142.764586:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273168128 00002000:00100000:1.0:1746065142.764618:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5f80 x1830881273168128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.764627:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5f80 with x1830881273168128 ext(0->4095) 00002000:00010000:1.0:1746065142.764631:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a5f80 00000100:00100000:1.0:1746065142.764789:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13806 00000100:00100000:1.0:1746065142.764796:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273168128:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.764894:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273168128:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (637us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.764910:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13806 00002000:00100000:1.0:1746065142.764914:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a5f80 x1830881273168128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.764921:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a5f80 with x1830881273168128 ext(0->4095) 00002000:00010000:1.0:1746065142.764923:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a5f80 00000100:00100000:0.0:1746065142.767974:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.768151:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267788672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746065142.768191:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065142.768267:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267788672 00000100:00100000:0.0:1746065142.768273:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267788672 00000100:00100000:0.0:1746065142.768302:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1746065142.768308:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267788672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746065142.768324:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 503192384 pending 688128 free 3920867328 avail 3689345024 00000100:00100000:0.0:1746065142.768355:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267788672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.768360:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1746065142.768428:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273168256 00000100:00100000:3.0:1746065142.768432:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273168256 00000100:00100000:3.0:1746065142.768454:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30736 00000100:00100000:3.0:1746065142.768459:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273168256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.768467:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.768481:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e678a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.768502:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 53 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.768508:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.768510:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.768513:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.768531:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 53 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.768541:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 53 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.768549:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267788800:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.768647:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267788672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746065142.769000:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.770674:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267788800:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.770693:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.770706:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065142.770735:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273168256:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2275us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.770742:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30736 00000100:00100000:0.0:1746065142.771820:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.772108:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273168384 00000100:00100000:3.0:1746065142.772114:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273168384 00010000:00010000:3.0:1746065142.772135:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.772167:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14708 00000100:00100000:3.0:1746065142.772172:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881273168384:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.772182:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.772195:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.772205:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.772222:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11200/0x392ae0376f880812 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6783 expref: 54 pid: 9560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.772244:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.772245:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.772252:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.772258:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.772286:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.772296:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267788928:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.772359:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.774353:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.775609:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273168512 00000100:00100000:3.0:1746065142.775615:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273168512 00000100:00100000:3.0:1746065142.775648:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30737 00000100:00100000:3.0:1746065142.775655:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:1791:x1830881273168512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.775669:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.775682:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6791 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.775703:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.775709:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.775711:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.775714:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.775737:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.775747:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.775762:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d548700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267789056:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.775831:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.778050:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.778186:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d548700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267789056:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065142.778205:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.778219:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:0.0:1746065142.778251:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1791:x1830881273168512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2597us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.778258:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30737 00000100:00100000:2.0:1746065142.778326:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273168768 00000100:00100000:2.0:1746065142.778330:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273168768 00002000:00100000:2.0:1746065142.778355:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ce00 x1830881273168768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.778363:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ce00 with x1830881273168768 ext(0->4095) 00010000:00010000:2.0:1746065142.778368:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.778378:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.778384:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ce00 00000100:00100000:2.0:1746065142.778397:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3091 00000100:00100000:2.0:1746065142.778402:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273168768:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065142.778493:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273168768:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (448us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.778499:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3091 00002000:00100000:2.0:1746065142.778503:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549ce00 x1830881273168768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.778510:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549ce00 with x1830881273168768 ext(0->4095) 00010000:00010000:2.0:1746065142.778515:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.778523:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.778529:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009549ce00 00000100:00100000:3.0:1746065142.779067:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267788928:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.779076:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.779579:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2005:x1830881273168384:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 7405us (7759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.779586:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14708 00000100:00100000:0.0:1746065142.783018:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.783118:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273168896 00000100:00100000:3.0:1746065142.783125:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273168896 00010000:00010000:3.0:1746065142.783153:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.783189:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14709 00000100:00100000:3.0:1746065142.783197:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273168896:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.783207:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.783223:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.783233:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.783251:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880819 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e678a expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.783274:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.783277:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.783282:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.783289:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.783314:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.783325:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267789184:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.783394:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.785218:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.785668:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267789184:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.785683:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.785711:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273168896:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2515us (2699us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.785719:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14709 00000100:00100000:1.0:1746065142.785927:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273169152 00000100:00100000:1.0:1746065142.785932:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273169152 00002000:00100000:1.0:1746065142.785960:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549d180 x1830881273169152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.785968:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d180 with x1830881273169152 ext(0->4095) 00002000:00010000:1.0:1746065142.785972:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549d180 00000100:00100000:1.0:1746065142.785998:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13807 00000100:00100000:1.0:1746065142.786004:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273169152:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.786124:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273169152:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 119us (910us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.786129:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13807 00002000:00100000:1.0:1746065142.786133:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549d180 x1830881273169152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.786140:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d180 with x1830881273169152 ext(0->4095) 00002000:00010000:1.0:1746065142.786142:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549d180 00000100:00100000:0.0:1746065142.797448:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.797783:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273169280 00000100:00100000:2.0:1746065142.797790:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273169280 00000100:00100000:2.0:1746065142.797828:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30738 00000100:00100000:2.0:1746065142.797834:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273169280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.797846:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.797860:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6798 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.797882:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.797888:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.797889:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.797892:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.797926:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 53 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.797936:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 53 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.797946:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267789312:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.798021:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.806606:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267789312:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.806631:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.806647:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065142.806693:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273169280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8858us (9251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.806701:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30738 00000100:00100000:0.0:1746065142.811058:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.811745:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273169408 00000100:00100000:2.0:1746065142.811753:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273169408 00002000:00100000:2.0:1746065142.812025:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a091ed80 x1830881273169408/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.812036:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ed80 with x1830881273169408 ext(0->7) 00010000:00010000:2.0:1746065142.812043:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.812056:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 54 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.812063:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091ed80 00000100:00100000:2.0:1746065142.812107:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3092 00000100:00100000:2.0:1746065142.812115:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+54:2004:x1830881273169408:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065142.814144:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.814198:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273169408:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2082us (3145us total) trans 4294972145 rc 0/0 00000100:00100000:2.0:1746065142.814206:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3092 00002000:00100000:2.0:1746065142.814212:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a091ed80 x1830881273169408/t4294972145(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 496/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.814221:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ed80 with x1830881273169408 ext(0->7) 00010000:00010000:2.0:1746065142.814228:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 56 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.814239:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 56 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.814245:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091ed80 00000100:00100000:3.0:1746065142.815567:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273169536 00000100:00100000:3.0:1746065142.815574:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273169536 00000100:00100000:3.0:1746065142.815614:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30739 00000100:00100000:3.0:1746065142.815621:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1791:x1830881273169536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.815633:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.815644:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e679f expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.815663:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.815668:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.815676:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065142.815679:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.815706:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.815716:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.815724:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065142.815761:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1791:x1830881273169536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.815766:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30739 00000100:00100000:0.0:1746065142.817687:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.817976:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273169664 00000100:00100000:3.0:1746065142.817981:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273169664 00010000:00010000:3.0:1746065142.818003:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 57 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.818032:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14710 00000100:00100000:3.0:1746065142.818037:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273169664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.818047:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065142.818058:0:8359:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1746065141 -> 1746065142 00002000:00010000:3.0:1746065142.818061:0:8359:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1746065141 -> 1746065142 00010000:00010000:3.0:1746065142.818065:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 57 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.818075:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 57 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.818118:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f880820 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6791 expref: 57 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.818143:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.818145:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.818151:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.818158:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.818180:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.818189:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 5 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.818199:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267789568:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.818255:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.820718:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.820816:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267789568:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.820829:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.821004:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273169664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2965us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.821015:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14710 00000100:00100000:2.0:1746065142.821314:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273169920 00000100:00100000:2.0:1746065142.821319:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273169920 00002000:00100000:2.0:1746065142.821346:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091ea00 x1830881273169920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.821355:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ea00 with x1830881273169920 ext(0->4095) 00010000:00010000:2.0:1746065142.821361:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.821371:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.821376:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091ea00 00000100:00100000:2.0:1746065142.821402:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3093 00000100:00100000:2.0:1746065142.821408:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273169920:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065142.821495:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273169920:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 87us (782us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.821500:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3093 00002000:00100000:2.0:1746065142.821505:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091ea00 x1830881273169920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.821512:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091ea00 with x1830881273169920 ext(0->4095) 00010000:00010000:2.0:1746065142.821516:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.821525:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.821535:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091ea00 00000100:00100000:0.0:1746065142.824251:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.824407:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273170048 00000100:00100000:3.0:1746065142.824413:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273170048 00010000:00010000:3.0:1746065142.824438:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.824472:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14711 00000100:00100000:3.0:1746065142.824478:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273170048:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.824490:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.824504:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.824512:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.824529:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880827 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6798 expref: 6 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.824757:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.824760:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.824767:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.824774:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.824799:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.824810:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267789696:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.824874:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.827770:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267789696:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.827786:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.827819:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273170048:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3340us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.827827:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14711 00000100:00100000:0.0:1746065142.829120:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.829190:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273170304 00000100:00100000:1.0:1746065142.829197:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273170304 00002000:00100000:1.0:1746065142.829229:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a3800 x1830881273170304/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.829238:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a3800 with x1830881273170304 ext(0->4095) 00002000:00010000:1.0:1746065142.829242:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a3800 00000100:00100000:1.0:1746065142.829298:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13808 00000100:00100000:1.0:1746065142.829303:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273170304:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.829478:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273170304:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 174us (360us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.829483:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13808 00002000:00100000:1.0:1746065142.829487:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d4a3800 x1830881273170304/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.829493:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a3800 with x1830881273170304 ext(0->4095) 00002000:00010000:1.0:1746065142.829496:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d4a3800 00000100:00100000:0.0:1746065142.831573:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.831694:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273170432 00000100:00100000:2.0:1746065142.831700:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273170432 00000100:00100000:2.0:1746065142.831739:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30740 00000100:00100000:2.0:1746065142.831744:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273170432:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.831756:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.831768:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67a6 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.831789:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.831795:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.831797:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.831799:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.831820:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.831829:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.831837:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267789824:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.831912:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.834067:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.834182:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273170560 00000100:00100000:3.0:1746065142.834188:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273170560 00010000:00010000:3.0:1746065142.834211:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 56 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.834236:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14712 00000100:00100000:3.0:1746065142.834241:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273170560:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.834250:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.834265:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 56 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.834275:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 56 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.834293:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.834294:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.834300:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.834312:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.834333:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.834342:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267789952:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.834389:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00010000:00010000:2.0:1746065142.834567:0:9558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88082e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e679f expref: 56 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.834582:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267789824:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.834599:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.834606:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065142.834626:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273170432:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2882us (3059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.834632:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30740 00000100:00100000:3.0:1746065142.837520:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267789952:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.837535:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.837562:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2004:x1830881273170560:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3320us (3499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.837570:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14712 00000100:00100000:0.0:1746065142.837754:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.837836:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273170816 00000100:00100000:1.0:1746065142.837842:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273170816 00002000:00100000:1.0:1746065142.837868:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbc000 x1830881273170816/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.837876:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc000 with x1830881273170816 ext(0->4095) 00002000:00010000:1.0:1746065142.837879:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbc000 00000100:00100000:1.0:1746065142.838677:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13809 00000100:00100000:1.0:1746065142.838684:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273170816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.838785:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273170816:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (1031us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.838790:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13809 00002000:00100000:1.0:1746065142.838795:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fbbc000 x1830881273170816/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.838802:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc000 with x1830881273170816 ext(0->4095) 00002000:00010000:1.0:1746065142.838804:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbc000 00000100:00100000:0.0:1746065142.840939:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.841098:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273170944 00000100:00100000:2.0:1746065142.841105:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273170944 00000100:00100000:2.0:1746065142.841145:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30741 00000100:00100000:2.0:1746065142.841150:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1791:x1830881273170944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.841162:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.841176:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67ad expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.841198:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.841205:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.841206:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.841209:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.841231:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.841241:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 5 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.841251:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267790080:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.841311:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.842006:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.842265:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273171072 00000100:00100000:3.0:1746065142.842269:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273171072 00000100:00100000:3.0:1746065142.842291:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30742 00000100:00100000:3.0:1746065142.842297:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1795:x1830881273171072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.842305:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.842314:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67b4 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.842326:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.842330:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 58 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.842339:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.842342:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.842361:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 58 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.842370:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.842378:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:3.0:1746065142.842411:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1795:x1830881273171072:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 114us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.842416:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30742 00000100:00100000:2.0:1746065142.844431:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267790080:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.844450:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 57 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.844461:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065142.844496:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1791:x1830881273170944:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3345us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.844502:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30741 00000100:00100000:0.0:1746065142.845668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.845816:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273171200 00000100:00100000:3.0:1746065142.845821:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273171200 00010000:00010000:3.0:1746065142.845844:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.845871:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14713 00000100:00100000:3.0:1746065142.845876:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273171200:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.845886:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.845909:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.845919:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.845937:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880835 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67a6 expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.845958:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.845960:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.845966:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.845973:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.845995:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.846004:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 56 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.846013:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267790336:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.846068:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.847863:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267790464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065142.847910:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065142.848244:0:8658:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267790464 00000100:00100000:1.0:1746065142.848250:0:8658:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267790464 00000100:00100000:1.0:1746065142.848285:0:8658:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1746065142.848291:0:8658:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3768:x1830881267790464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746065142.848315:0:8658:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1445990400 avail 1316528128 00000100:00100000:1.0:1746065142.848351:0:8658:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3768:x1830881267790464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.848356:0:8658:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1746065142.848848:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267790464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746065142.849322:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267790336:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.849333:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.849366:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273171200:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3489us (3701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.849374:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14713 00000100:00100000:0.0:1746065142.849821:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.850211:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273171456 00000100:00100000:2.0:1746065142.850216:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273171456 00002000:00100000:2.0:1746065142.850242:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9fa680 x1830881273171456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.850250:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9fa680 with x1830881273171456 ext(0->4095) 00010000:00010000:2.0:1746065142.850257:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.850267:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.850277:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9fa680 00000100:00100000:2.0:1746065142.850298:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3094 00000100:00100000:2.0:1746065142.850303:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273171456:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.850384:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273171456:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 81us (564us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.850389:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3094 00002000:00100000:2.0:1746065142.850393:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f9fa680 x1830881273171456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.850399:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9fa680 with x1830881273171456 ext(0->4095) 00010000:00010000:2.0:1746065142.850403:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065142.850410:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065142.850414:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9fa680 00000100:00100000:0.0:1746065142.852058:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.852229:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273171584 00000100:00100000:3.0:1746065142.852235:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273171584 00010000:00010000:3.0:1746065142.852257:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.852280:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14714 00000100:00100000:3.0:1746065142.852286:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2003:x1830881273171584:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.852294:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.852307:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.852317:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.852334:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88083c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ad expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.852345:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.852346:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.852352:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.852359:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.852381:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.852392:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267790592:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.852449:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.854520:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267790592:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.854534:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.854562:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2003:x1830881273171584:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2276us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.854570:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14714 00000100:00100000:0.0:1746065142.855052:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.855453:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273171840 00000100:00100000:1.0:1746065142.855459:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273171840 00002000:00100000:1.0:1746065142.855489:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c3480 x1830881273171840/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.855497:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3480 with x1830881273171840 ext(0->4095) 00002000:00010000:1.0:1746065142.855500:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c3480 00000100:00100000:1.0:1746065142.855529:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13810 00000100:00100000:1.0:1746065142.855535:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2005:x1830881273171840:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.855646:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2005:x1830881273171840:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 111us (595us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.855651:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13810 00002000:00100000:1.0:1746065142.855657:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c3480 x1830881273171840/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.855663:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3480 with x1830881273171840 ext(0->4095) 00002000:00010000:1.0:1746065142.855666:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c3480 00000100:00100000:0.0:1746065142.858526:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.858616:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273171968 00000100:00100000:2.0:1746065142.858623:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273171968 00000100:00100000:2.0:1746065142.858657:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30743 00000100:00100000:2.0:1746065142.858663:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273171968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.858676:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.858690:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67bb expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.858716:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.858722:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.858724:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.858727:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.858752:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.858762:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 55 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.858771:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267790720:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.858845:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.860860:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267790720:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.860880:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.860897:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065142.860941:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273171968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2277us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.860947:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30743 00000100:00100000:0.0:1746065142.862278:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.862356:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273172096 00000100:00100000:3.0:1746065142.862362:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273172096 00010000:00010000:3.0:1746065142.862387:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 56 pid: 9635 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.862458:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14715 00000100:00100000:3.0:1746065142.862469:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273172096:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.862479:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.862494:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 56 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.862504:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 56 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.862522:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880843 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67b4 expref: 56 pid: 9635 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.862607:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.862608:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.862745:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.862761:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.862794:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.862805:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267790848:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.862871:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.864319:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267790848:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.864333:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.864358:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2004:x1830881273172096:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1893us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.864367:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14715 00000100:00100000:0.0:1746065142.864632:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.864792:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273172352 00000100:00100000:2.0:1746065142.864798:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273172352 00002000:00100000:2.0:1746065142.864826:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c2300 x1830881273172352/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.864840:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2300 with x1830881273172352 ext(0->4095) 00002000:00010000:2.0:1746065142.864843:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c2300 00000100:00100000:2.0:1746065142.864858:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13811 00000100:00100000:2.0:1746065142.864864:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273172352:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065142.864981:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273172352:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 117us (349us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.864986:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13811 00002000:00100000:2.0:1746065142.864991:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c2300 x1830881273172352/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.864998:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2300 with x1830881273172352 ext(0->4095) 00002000:00010000:2.0:1746065142.865001:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c2300 00000100:00100000:0.0:1746065142.865462:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.865641:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273172480 00000100:00100000:2.0:1746065142.865644:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273172480 00000100:00100000:2.0:1746065142.865668:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30744 00000100:00100000:2.0:1746065142.865672:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1791:x1830881273172480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.865681:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.865693:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67c2 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.865712:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.865722:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.865724:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.865727:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.865747:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.865758:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 5 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065142.865768:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267790976:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.865825:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.866500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.866537:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273172608 00000100:00100000:2.0:1746065142.866541:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273172608 00000100:00100000:2.0:1746065142.866570:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30745 00000100:00100000:2.0:1746065142.866575:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1795:x1830881273172608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.866637:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.866645:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67c9 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.866657:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.866660:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 58 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.866664:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.866667:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 58 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.866686:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 58 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.866696:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 58 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.866704:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:2.0:1746065142.866726:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1795:x1830881273172608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 151us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.866731:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30745 00000100:00100000:2.0:1746065142.866756:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267790976:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.866766:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 57 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.866772:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064000, rc 0) 00000100:00100000:2.0:1746065142.866784:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1791:x1830881273172480:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1112us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.866789:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30744 00000100:00100000:0.0:1746065142.868561:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.868613:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273172736 00000100:00100000:3.0:1746065142.868618:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273172736 00010000:00010000:3.0:1746065142.868640:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.868660:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14716 00000100:00100000:3.0:1746065142.868665:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273172736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.868675:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.868689:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.868699:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.868717:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f88084a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67bb expref: 6 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.868730:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.868731:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.868737:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.868744:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.868767:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.868777:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 56 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.868787:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267791232:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.868850:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.870538:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267791232:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.870554:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.870581:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273172736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1915us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.870589:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14716 00000100:00100000:0.0:1746065142.871966:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.872044:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273172992 00000100:00100000:1.0:1746065142.872050:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273172992 00002000:00100000:1.0:1746065142.872100:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0a80 x1830881273172992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.872109:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0a80 with x1830881273172992 ext(0->4095) 00010000:00010000:1.0:1746065142.872117:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.872128:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.872134:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0a80 00000100:00100000:1.0:1746065142.872560:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3095 00000100:00100000:1.0:1746065142.872567:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273172992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.872770:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273172992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 203us (808us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.872777:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3095 00002000:00100000:1.0:1746065142.872782:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0a80 x1830881273172992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.872789:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0a80 with x1830881273172992 ext(0->4095) 00010000:00010000:1.0:1746065142.872794:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065142.872803:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746065142.872809:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c0a80 00000100:00100000:0.0:1746065142.875363:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.875600:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273173120 00000100:00100000:3.0:1746065142.875608:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273173120 00010000:00010000:3.0:1746065142.875632:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065142.875663:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14717 00000100:00100000:3.0:1746065142.875669:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273173120:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.875679:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.875692:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.875701:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.875717:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880851 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c2 expref: 57 pid: 9558 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065142.875821:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.875824:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.875829:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.875836:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.875860:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.875870:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267791360:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.876384:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.878141:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267791360:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.878156:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.878186:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273173120:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2517us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.878195:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14717 00000100:00100000:0.0:1746065142.881425:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.881545:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273173376 00000100:00100000:1.0:1746065142.881552:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273173376 00002000:00100000:1.0:1746065142.881588:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0000 x1830881273173376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.881597:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0000 with x1830881273173376 ext(0->4095) 00002000:00010000:1.0:1746065142.881602:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c0000 00000100:00100000:1.0:1746065142.881632:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13812 00000100:00100000:1.0:1746065142.881639:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273173376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.881748:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273173376:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 109us (329us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.881754:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13812 00002000:00100000:1.0:1746065142.881760:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0000 x1830881273173376/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.881766:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0000 with x1830881273173376 ext(0->4095) 00002000:00010000:1.0:1746065142.881769:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c0000 00000100:00100000:0.0:1746065142.884501:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.884650:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273173504 00000100:00100000:2.0:1746065142.884658:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273173504 00000100:00100000:2.0:1746065142.884703:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30746 00000100:00100000:2.0:1746065142.884710:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273173504:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.884724:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.884737:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67d0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.884759:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 55 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.884766:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.884767:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.884771:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.884797:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 55 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.884807:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 55 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.884816:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267791488:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.884895:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.887064:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267791488:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.887115:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.887128:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065142.887163:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273173504:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2452us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.887170:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30746 00000100:00100000:0.0:1746065142.887739:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.888049:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273173632 00000100:00100000:3.0:1746065142.888055:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273173632 00010000:00010000:3.0:1746065142.888099:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 56 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065142.888362:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14718 00000100:00100000:3.0:1746065142.888368:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2005:x1830881273173632:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.888379:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.888394:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 56 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065142.888403:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 56 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065142.888420:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880858 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67c9 expref: 56 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065142.888441:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.888442:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.888448:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.888458:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.888478:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.888486:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267791616:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.888536:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.892231:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267791616:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.892247:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.892288:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2005:x1830881273173632:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3919us (4549us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.892297:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14718 00000100:00100000:0.0:1746065142.895215:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.895250:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.895335:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273173888 00000100:00100000:2.0:1746065142.895342:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273173888 00002000:00100000:2.0:1746065142.895374:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1e680 x1830881273173888/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.895384:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1e680 with x1830881273173888 ext(0->4095) 00002000:00010000:2.0:1746065142.895388:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1e680 00000100:00100000:2.0:1746065142.895413:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13813 00000100:00100000:2.0:1746065142.895420:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273173888:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065142.895533:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273173888:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 113us (324us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.895538:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13813 00002000:00100000:2.0:1746065142.895543:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1e680 x1830881273173888/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.895548:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1e680 with x1830881273173888 ext(0->4095) 00002000:00010000:2.0:1746065142.895551:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1e680 00000100:00100000:3.0:1746065142.895875:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273174016 00000100:00100000:3.0:1746065142.895879:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273174016 00000100:00100000:3.0:1746065142.895907:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30747 00000100:00100000:3.0:1746065142.895912:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1791:x1830881273174016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.895920:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.895932:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67d7 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.895949:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.895955:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.895957:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.895960:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.895981:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.895990:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 5 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065142.895999:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267791744:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.896956:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.899867:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.901046:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273174144 00000100:00100000:2.0:1746065142.901054:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273174144 00000100:00100000:2.0:1746065142.901098:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30748 00000100:00100000:2.0:1746065142.901104:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1795:x1830881273174144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.901118:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.901130:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67de expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.901150:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.901154:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 58 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.901163:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.901166:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 58 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.901191:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 58 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.901201:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 58 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.901209:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065142.901238:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1795:x1830881273174144:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 134us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.901242:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30748 00000100:00100000:0.0:1746065142.901368:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.901480:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267791744:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.901493:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 57 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.901501:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065142.901527:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1791:x1830881273174016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5615us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.901532:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30747 00000100:00100000:2.0:1746065142.902039:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273174272 00000100:00100000:2.0:1746065142.902043:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273174272 00010000:00010000:2.0:1746065142.902056:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.902495:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14719 00000100:00100000:2.0:1746065142.902502:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273174272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.902510:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.902524:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.902533:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.902547:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f88085f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d0 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.902568:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.902570:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.902575:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.902581:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.902600:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.902610:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 56 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.902618:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267792000:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.902669:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.904262:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267792000:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.904280:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.904304:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273174272:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1803us (2936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.904311:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14719 00000100:00100000:0.0:1746065142.904428:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.904525:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273174528 00000100:00100000:1.0:1746065142.904530:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273174528 00002000:00100000:1.0:1746065142.904555:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0e00 x1830881273174528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.904569:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0e00 with x1830881273174528 ext(0->4095) 00010000:00010000:1.0:1746065142.904574:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065142.904583:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065142.904588:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a0e00 00000100:00100000:1.0:1746065142.904612:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3096 00000100:00100000:1.0:1746065142.904618:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273174528:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.905146:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273174528:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 526us (717us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.905151:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3096 00002000:00100000:1.0:1746065142.905156:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a0e00 x1830881273174528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.905163:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a0e00 with x1830881273174528 ext(0->4095) 00010000:00010000:1.0:1746065142.905167:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065142.905176:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065142.905180:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a0e00 00000100:00100000:0.0:1746065142.906679:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.906741:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273174656 00000100:00100000:2.0:1746065142.906747:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273174656 00010000:00010000:2.0:1746065142.906762:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.906829:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14720 00000100:00100000:2.0:1746065142.906835:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b403c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273174656:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.906843:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.906856:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.906864:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.907157:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880866 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67d7 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.907169:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.907171:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.907176:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.907182:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.907204:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 56 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.907214:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267792128:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.907278:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.909465:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267792128:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.909480:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.909514:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b403c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273174656:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2678us (2837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.909521:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14720 00000100:00100000:0.0:1746065142.910759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.910975:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273174912 00000100:00100000:1.0:1746065142.911059:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273174912 00002000:00100000:1.0:1746065142.911124:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a2680 x1830881273174912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.911134:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2680 with x1830881273174912 ext(0->4095) 00002000:00010000:1.0:1746065142.911139:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a2680 00000100:00100000:1.0:1746065142.911157:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13814 00000100:00100000:1.0:1746065142.911164:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273174912:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.911272:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273174912:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 108us (516us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.911277:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13814 00002000:00100000:1.0:1746065142.911282:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a2680 x1830881273174912/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.911289:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a2680 with x1830881273174912 ext(0->4095) 00002000:00010000:1.0:1746065142.911291:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d5a2680 00000100:00100000:0.0:1746065142.914396:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.914666:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273175040 00000100:00100000:3.0:1746065142.914673:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273175040 00000100:00100000:3.0:1746065142.914721:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30749 00000100:00100000:3.0:1746065142.914728:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273175040:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.914742:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.914756:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67e5 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.914785:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 55 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.914791:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.914792:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.914796:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.914820:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 55 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.914831:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 55 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065142.914841:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267792256:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.914933:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.916293:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267792256:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.916315:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.916328:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065142.916800:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273175040:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2071us (2409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.916807:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30749 00000100:00100000:0.0:1746065142.917557:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.917727:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273175168 00000100:00100000:2.0:1746065142.917733:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273175168 00010000:00010000:2.0:1746065142.917756:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 56 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.917884:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14721 00000100:00100000:2.0:1746065142.917892:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273175168:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.917914:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.917931:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 56 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.917942:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 56 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.917959:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f88086d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67de expref: 56 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.917982:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.917984:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.917997:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.918011:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.918101:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.918113:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267792384:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.918160:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.919628:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267792384:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.919644:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.919829:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2004:x1830881273175168:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1936us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.919837:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14721 00000100:00100000:0.0:1746065142.920995:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.921067:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273175424 00000100:00100000:2.0:1746065142.921073:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273175424 00002000:00100000:2.0:1746065142.921126:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f085c00 x1830881273175424/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.921135:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f085c00 with x1830881273175424 ext(0->4095) 00002000:00010000:2.0:1746065142.921139:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f085c00 00000100:00100000:2.0:1746065142.921512:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13815 00000100:00100000:2.0:1746065142.921519:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273175424:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065142.921737:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273175424:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 218us (743us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.921746:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13815 00002000:00100000:2.0:1746065142.921751:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f085c00 x1830881273175424/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065142.921758:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f085c00 with x1830881273175424 ext(0->4095) 00002000:00010000:2.0:1746065142.921761:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f085c00 00000100:00100000:0.0:1746065142.922828:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.923396:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273175552 00000100:00100000:3.0:1746065142.923403:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273175552 00000100:00100000:3.0:1746065142.923434:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30750 00000100:00100000:3.0:1746065142.923440:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:1791:x1830881273175552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.923458:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.923472:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67ec expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.923496:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.923503:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.923504:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.923508:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.923544:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.923555:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 5 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065142.923565:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267792512:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.924446:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.926930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.926993:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273175680 00000100:00100000:2.0:1746065142.927001:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273175680 00000100:00100000:2.0:1746065142.927237:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30751 00000100:00100000:2.0:1746065142.927245:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1795:x1830881273175680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.927259:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.927273:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67f3 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.927294:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.927298:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 58 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.927304:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.927307:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.927387:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 58 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.927398:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267792512:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.927398:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.927412:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00010000:00010000:3.0:1746065142.927413:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 58 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.927419:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065142.927453:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1791:x1830881273175552:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4012us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.927453:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1795:x1830881273175680:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 208us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.927458:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30751 00000100:00100000:3.0:1746065142.927461:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30750 00000100:00100000:0.0:1746065142.929398:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.930832:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273175808 00000100:00100000:2.0:1746065142.930842:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273175808 00010000:00010000:2.0:1746065142.930870:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.930914:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14722 00000100:00100000:2.0:1746065142.930922:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273175808:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.930933:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.930948:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.930959:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.930977:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880874 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67e5 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.930996:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.930998:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.931004:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.932440:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.932473:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.932483:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 56 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.932494:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267792768:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.932576:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.935191:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267792768:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.935209:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.935312:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273175808:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4388us (5916us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.935321:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14722 00000100:00100000:0.0:1746065142.936433:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.936503:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273176064 00000100:00100000:1.0:1746065142.936509:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273176064 00002000:00100000:1.0:1746065142.936540:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0938000 x1830881273176064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.936549:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0938000 with x1830881273176064 ext(0->4095) 00010000:00010000:1.0:1746065142.936556:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065142.936567:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065142.936577:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0938000 00000100:00100000:1.0:1746065142.936606:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3097 00000100:00100000:1.0:1746065142.936612:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273176064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065142.936707:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273176064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (277us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.936712:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3097 00002000:00100000:1.0:1746065142.936717:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0938000 x1830881273176064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.936724:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0938000 with x1830881273176064 ext(0->4095) 00010000:00010000:1.0:1746065142.936728:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065142.936735:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065142.936745:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0938000 00000100:00100000:0.0:1746065142.939202:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.939310:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273176192 00000100:00100000:2.0:1746065142.939318:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273176192 00010000:00010000:2.0:1746065142.939344:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.939377:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14723 00000100:00100000:2.0:1746065142.939384:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273176192:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.939394:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.939411:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.939421:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.939440:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88087b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67ec expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.939464:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.939466:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.939472:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.939479:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.939506:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.939517:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267792896:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.939585:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.944224:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.944513:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273176448 00000100:00100000:3.0:1746065142.944520:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273176448 00002000:00100000:3.0:1746065142.944557:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfbb80 x1830881273176448/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.944566:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfbb80 with x1830881273176448 ext(0->4095) 00002000:00010000:3.0:1746065142.944570:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfbb80 00000100:00100000:3.0:1746065142.944586:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13816 00000100:00100000:3.0:1746065142.944591:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273176448:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065142.944596:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267792896:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.944612:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.944645:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273176192:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5262us (5450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.944653:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14723 00000100:00100000:3.0:1746065142.944682:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273176448:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 90us (466us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.944688:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13816 00002000:00100000:3.0:1746065142.944693:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012fbfbb80 x1830881273176448/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.944699:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fbfbb80 with x1830881273176448 ext(0->4095) 00002000:00010000:3.0:1746065142.944702:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fbfbb80 00000100:00100000:0.0:1746065142.947587:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.947729:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273176576 00000100:00100000:3.0:1746065142.947736:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273176576 00000100:00100000:3.0:1746065142.947783:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30752 00000100:00100000:3.0:1746065142.947790:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273176576:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065142.947802:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.947816:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e67fa expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.947841:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.947847:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.947849:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.947852:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.947876:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.947888:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 55 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065142.947908:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267793024:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.949331:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.950352:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267793024:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065142.950372:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.950386:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:3.0:1746065142.950418:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273176576:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2629us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.950425:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30752 00000100:00100000:0.0:1746065142.951189:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.951517:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273176704 00000100:00100000:3.0:1746065142.951524:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273176704 00010000:00010000:3.0:1746065142.951543:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 56 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065142.952187:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14724 00000100:00100000:3.0:1746065142.952194:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2005:x1830881273176704:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.952205:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.952219:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 56 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065142.952230:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 56 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065142.952247:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880882 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67f3 expref: 56 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065142.952267:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.952269:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.952275:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.952282:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.952307:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.952317:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267793152:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065142.952376:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.953384:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.954482:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273176832 00000100:00100000:2.0:1746065142.954490:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273176832 00000100:00100000:2.0:1746065142.954532:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30753 00000100:00100000:2.0:1746065142.954538:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1791:x1830881273176832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.954550:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.954562:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6801 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.954582:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.954588:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.954589:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.954592:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.954612:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.954622:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 5 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.954632:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267793280:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065142.955418:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d549180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267793152:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065142.955432:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.955454:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273176704:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3261us (4266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.955463:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14724 00000100:00100000:2.0:1746065142.956111:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.957140:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.957673:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273177088 00000100:00100000:1.0:1746065142.957680:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273177088 00002000:00100000:1.0:1746065142.957712:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549180 x1830881273177088/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.957721:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549180 with x1830881273177088 ext(0->4095) 00010000:00010000:1.0:1746065142.957728:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065142.957743:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065142.957748:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549180 00000100:00100000:1.0:1746065142.957772:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3098 00000100:00100000:1.0:1746065142.957778:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273177088:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.957881:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273177088:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 104us (744us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.957887:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3098 00002000:00100000:1.0:1746065142.957891:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549180 x1830881273177088/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.957962:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549180 with x1830881273177088 ext(0->4095) 00010000:00010000:1.0:1746065142.957967:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065142.957975:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065142.957981:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d549180 00000100:00100000:2.0:1746065142.959046:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267793280:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.959066:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.959102:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065142.959138:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1791:x1830881273176832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4600us (5756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.959144:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30753 00000100:00100000:0.0:1746065142.961338:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.961925:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273177216 00000100:00100000:2.0:1746065142.961932:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273177216 00000100:00100000:2.0:1746065142.961975:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30754 00000100:00100000:2.0:1746065142.961981:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1795:x1830881273177216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.961994:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.962007:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6808 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.962028:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.962032:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.962037:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.962040:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 57 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.962067:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.962077:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 57 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.962109:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065142.962153:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1795:x1830881273177216:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 172us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.962162:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30754 00000100:00100000:3.0:1746065142.962852:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.963130:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273177344 00000100:00100000:0.0:1746065142.963135:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273177344 00010000:00010000:0.0:1746065142.963152:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065142.963339:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14725 00000100:00100000:0.0:1746065142.963345:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273177344:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.963353:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065142.963368:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065142.963377:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065142.963391:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880889 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e67fa expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065142.963413:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.963415:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.963419:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.963429:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.963448:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.963457:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 56 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065142.963466:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267793536:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065142.963521:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.965780:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.965866:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267793536:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.965882:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.965934:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273177344:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2588us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.965941:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14725 00000100:00100000:3.0:1746065142.966006:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273177600 00000100:00100000:3.0:1746065142.966011:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273177600 00002000:00100000:3.0:1746065142.966037:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cb100 x1830881273177600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.966046:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb100 with x1830881273177600 ext(0->4095) 00010000:00010000:3.0:1746065142.966053:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065142.966064:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065142.966070:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6cb100 00000100:00100000:3.0:1746065142.966571:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3099 00000100:00100000:3.0:1746065142.966579:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273177600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065142.966673:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273177600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (899us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.966678:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3099 00002000:00100000:3.0:1746065142.966684:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cb100 x1830881273177600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.966690:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb100 with x1830881273177600 ext(0->4095) 00010000:00010000:3.0:1746065142.966695:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065142.966703:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065142.966709:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d6cb100 00000100:00100000:0.0:1746065142.969488:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.969571:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273177728 00000100:00100000:2.0:1746065142.969577:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273177728 00010000:00010000:2.0:1746065142.969599:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.969631:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14726 00000100:00100000:2.0:1746065142.969636:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273177728:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.969647:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.969660:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.969669:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.969687:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880890 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6801 expref: 57 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.970274:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.970276:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.970282:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.970291:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.970317:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 56 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.970328:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267793664:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.970397:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.974185:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065142.974360:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273177984 00000100:00100000:1.0:1746065142.974367:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273177984 00002000:00100000:1.0:1746065142.974400:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9180 x1830881273177984/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.974410:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9180 with x1830881273177984 ext(0->4095) 00002000:00010000:1.0:1746065142.974415:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c9180 00000100:00100000:1.0:1746065142.974443:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13817 00000100:00100000:1.0:1746065142.974449:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273177984:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065142.974550:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273177984:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 100us (371us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.974555:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13817 00002000:00100000:1.0:1746065142.974561:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6c9180 x1830881273177984/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065142.974567:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9180 with x1830881273177984 ext(0->4095) 00002000:00010000:1.0:1746065142.974569:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6c9180 00000100:00100000:2.0:1746065142.974674:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267793664:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.974689:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.974718:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2005:x1830881273177728:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5081us (5235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.974725:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14726 00000100:00100000:0.0:1746065142.976307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.976414:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273178112 00000100:00100000:2.0:1746065142.976419:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273178112 00000100:00100000:2.0:1746065142.976451:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30755 00000100:00100000:2.0:1746065142.976457:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273178112:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.976469:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.976482:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e680f expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.976500:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 55 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.976506:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.976508:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.976511:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.976532:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 55 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.976542:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 55 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.976552:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267793792:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065142.976918:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.977795:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267793792:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.977814:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.977824:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:2.0:1746065142.977849:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273178112:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1392us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.977856:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30755 00000100:00100000:0.0:1746065142.980033:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.981489:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273178240 00000100:00100000:2.0:1746065142.981498:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273178240 00010000:00010000:2.0:1746065142.981528:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 56 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.981568:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14727 00000100:00100000:2.0:1746065142.981575:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b403dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2005:x1830881273178240:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.981588:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.981603:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 56 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.981614:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 56 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.981631:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880897 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6808 expref: 56 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.981660:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.981662:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.981668:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.981674:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.981976:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.981989:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267793920:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.982070:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800916f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.984755:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065142.984816:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273178624 00000100:00100000:3.0:1746065142.984823:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273178624 00000100:00100000:0.0:1746065142.984828:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065142.984859:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273178368 00000100:00100000:0.0:1746065142.984862:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273178368 00000100:00100000:0.0:1746065142.984917:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30756 00000100:00100000:0.0:1746065142.984924:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1791:x1830881273178368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065142.984938:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.984951:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6816 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.984978:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.984985:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.984987:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.984990:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.985013:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.985024:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065142.985033:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267794048:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065142.985112:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.985317:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267793920:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.985331:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.985351:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b403dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273178240:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3777us (5324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.985363:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14727 00002000:00100000:3.0:1746065142.985444:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728a80 x1830881273178624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.985454:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728a80 with x1830881273178624 ext(0->4095) 00010000:00010000:3.0:1746065142.985464:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065142.985475:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065142.985481:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f728a80 00000100:00100000:3.0:1746065142.985495:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3100 00000100:00100000:3.0:1746065142.985501:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273178624:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065142.985596:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273178624:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 95us (846us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.985605:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3100 00002000:00100000:3.0:1746065142.985610:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f728a80 x1830881273178624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065142.985617:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f728a80 with x1830881273178624 ext(0->4095) 00010000:00010000:3.0:1746065142.985621:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065142.985631:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065142.985636:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f728a80 00000100:00100000:2.0:1746065142.987535:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267794048:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065142.987563:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.987576:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd11600, rc 0) 00000100:00100000:2.0:1746065142.987617:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1791:x1830881273178368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2693us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.987623:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30756 00000100:00100000:0.0:1746065142.988617:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.988825:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273178752 00000100:00100000:2.0:1746065142.988832:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273178752 00000100:00100000:2.0:1746065142.988870:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30757 00000100:00100000:2.0:1746065142.988877:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1795:x1830881273178752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065142.988888:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.988914:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e681d expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.988932:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.988936:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.988942:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.988945:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.988972:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.988983:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.988989:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065142.989173:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1795:x1830881273178752:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 295us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.989178:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30757 00000100:00100000:0.0:1746065142.990550:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.991445:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273178880 00000100:00100000:2.0:1746065142.991452:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273178880 00010000:00010000:2.0:1746065142.991478:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.991525:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14728 00000100:00100000:2.0:1746065142.991532:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273178880:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.991543:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.991559:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.991570:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.991587:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f88089e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e680f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065142.991613:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.991615:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.991622:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.991629:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.991653:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.991663:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 56 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065142.991674:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267794304:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065142.991746:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.994799:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267794304:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065142.994817:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065142.995112:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065142.995331:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273178880:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3798us (4782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.995350:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14728 00000100:00100000:0.0:1746065142.995832:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273179136 00000100:00100000:0.0:1746065142.995838:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273179136 00002000:00100000:0.0:1746065142.995868:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b800 x1830881273179136/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.995877:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b800 with x1830881273179136 ext(0->4095) 00010000:00010000:0.0:1746065142.995884:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065142.995916:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065142.995923:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f93b800 00000100:00100000:0.0:1746065142.995950:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3101 00000100:00100000:0.0:1746065142.995957:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273179136:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065142.996069:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273179136:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (958us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065142.996075:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3101 00002000:00100000:0.0:1746065142.996091:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b800 x1830881273179136/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065142.996098:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b800 with x1830881273179136 ext(0->4095) 00010000:00010000:0.0:1746065142.996102:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065142.996110:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065142.996115:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f93b800 00000100:00100000:2.0:1746065142.999574:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.000439:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273179264 00000100:00100000:0.0:1746065143.000447:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273179264 00010000:00010000:0.0:1746065143.000477:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065143.000515:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14729 00000100:00100000:0.0:1746065143.000524:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273179264:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.000536:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.000551:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.000563:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.000584:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8808a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6816 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.000599:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.000601:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.000607:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.000615:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.000643:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.000653:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267794432:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065143.000710:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.006847:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.007167:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273179520 00000100:00100000:1.0:1746065143.007174:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273179520 00002000:00100000:1.0:1746065143.007209:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1fb80 x1830881273179520/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.007217:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1fb80 with x1830881273179520 ext(0->4095) 00002000:00010000:1.0:1746065143.007221:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1fb80 00000100:00100000:1.0:1746065143.007253:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13818 00000100:00100000:1.0:1746065143.007260:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273179520:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065143.007374:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273179520:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 115us (534us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.007380:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13818 00002000:00100000:1.0:1746065143.007385:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072a1fb80 x1830881273179520/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.007396:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072a1fb80 with x1830881273179520 ext(0->4095) 00002000:00010000:1.0:1746065143.007398:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072a1fb80 00000100:00100000:2.0:1746065143.008733:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267794432:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.008751:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.008786:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273179264:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 8263us (9219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.008793:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14729 00000100:00100000:0.0:1746065143.008825:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.008954:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273179648 00000100:00100000:2.0:1746065143.008959:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273179648 00000100:00100000:2.0:1746065143.008991:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30758 00000100:00100000:2.0:1746065143.008996:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273179648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.009005:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.009016:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6824 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.009036:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.009043:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.009044:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.009046:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.009065:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.009074:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 55 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.009804:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267794560:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.009872:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.011450:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267794560:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.011472:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.011484:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065143.011525:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273179648:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2528us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.011532:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30758 00000100:00100000:0.0:1746065143.011754:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.011790:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273179776 00000100:00100000:2.0:1746065143.011795:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273179776 00010000:00010000:2.0:1746065143.011814:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 56 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.011842:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14730 00000100:00100000:2.0:1746065143.011847:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273179776:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.011856:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.011870:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 56 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.011879:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 56 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.011895:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f8808ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e681d expref: 56 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.011930:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.011932:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.011938:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.011945:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.011971:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.011979:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267794688:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.012029:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.013480:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267794688:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.013490:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.013511:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+55:2004:x1830881273179776:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1664us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.013518:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14730 00000100:00100000:2.0:1746065143.015760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.016064:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273180032 00000100:00100000:3.0:1746065143.016071:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273180032 00002000:00100000:3.0:1746065143.016211:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e1880 x1830881273180032/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.016220:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1880 with x1830881273180032 ext(0->4095) 00002000:00010000:3.0:1746065143.016223:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1880 00000100:00100000:3.0:1746065143.016249:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13819 00000100:00100000:3.0:1746065143.016254:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273180032:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065143.016785:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273180032:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 529us (1029us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.016792:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13819 00002000:00100000:3.0:1746065143.016798:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e1880 x1830881273180032/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.016810:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1880 with x1830881273180032 ext(0->4095) 00002000:00010000:3.0:1746065143.016812:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1880 00000100:00100000:2.0:1746065143.025006:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.025030:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.025120:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273180160 00000100:00100000:1.0:1746065143.025128:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273180160 00000100:00100000:1.0:1746065143.025155:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273180288 00000100:00100000:1.0:1746065143.025157:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273180288 00000100:00100000:1.0:1746065143.025171:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30759 00000100:00100000:1.0:1746065143.025177:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1791:x1830881273180160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.025190:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.025203:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e682b expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.025226:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.025233:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.025234:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.025237:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.025261:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.025271:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 5 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.025281:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267794816:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065143.025380:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30760 00000100:00100000:0.0:1746065143.025387:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1795:x1830881273180288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065143.025394:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065143.025408:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6832 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.025418:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.025422:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.025426:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065143.025428:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.025447:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.025459:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.025468:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd10000, rc 0) 00000100:00100000:1.0:1746065143.028249:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.028413:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1795:x1830881273180288:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3022us (3376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.028422:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30760 00000100:00100000:1.0:1746065143.030519:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267794816:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.030540:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.030554:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfcc00, rc 0) 00000100:00100000:1.0:1746065143.030595:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1791:x1830881273180160:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5419us (5596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.030602:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30759 00000100:00100000:0.0:1746065143.031765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.031812:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273180416 00000100:00100000:2.0:1746065143.031818:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273180416 00010000:00010000:2.0:1746065143.031840:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.031871:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14731 00000100:00100000:2.0:1746065143.031877:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273180416:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.031887:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.031913:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.031923:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.031940:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f8808b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6824 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.033943:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.033947:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.033957:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 56 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.033966:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 56 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.034016:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 56 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.034028:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 56 pid: 21550 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.034039:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f087b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267795072:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.035004:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.035981:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f087b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267795072:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.035995:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.036026:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273180416:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4149us (4263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.036035:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14731 00000100:00100000:0.0:1746065143.037510:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.038730:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273180672 00000100:00100000:3.0:1746065143.038738:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273180672 00002000:00100000:3.0:1746065143.038773:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c1f80 x1830881273180672/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.038783:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1f80 with x1830881273180672 ext(0->4095) 00010000:00010000:3.0:1746065143.038790:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 57 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.038804:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 57 pid: 21550 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.038810:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c1f80 00000100:00100000:3.0:1746065143.038838:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3102 00000100:00100000:3.0:1746065143.038844:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273180672:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065143.038958:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2005:x1830881273180672:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 113us (1452us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.038963:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3102 00002000:00100000:3.0:1746065143.038968:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c1f80 x1830881273180672/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.038975:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1f80 with x1830881273180672 ext(0->4095) 00010000:00010000:3.0:1746065143.038979:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 57 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.038989:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 57 pid: 21550 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.038993:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c1f80 00000100:00100000:0.0:1746065143.041623:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.041866:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273180800 00000100:00100000:2.0:1746065143.041874:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273180800 00010000:00010000:2.0:1746065143.041910:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 57 pid: 21550 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.041943:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14732 00000100:00100000:2.0:1746065143.041950:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273180800:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.041960:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.041975:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 57 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.041986:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 57 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.042003:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8808ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e682b expref: 57 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.042019:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.042020:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.042026:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.042032:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.042059:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 56 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.042069:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f087b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267795200:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.042270:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.049957:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.049971:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f087b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267795200:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.049987:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.050025:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273180800:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 8074us (8408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.050034:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14732 00000100:00100000:1.0:1746065143.050047:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273181056 00000100:00100000:1.0:1746065143.050053:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273181056 00002000:00100000:1.0:1746065143.050102:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0380 x1830881273181056/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.050112:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0380 with x1830881273181056 ext(0->4095) 00002000:00010000:1.0:1746065143.050116:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c0380 00000100:00100000:1.0:1746065143.050143:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13820 00000100:00100000:1.0:1746065143.050150:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273181056:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.050258:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273181056:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 109us (310us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.050264:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13820 00002000:00100000:1.0:1746065143.050269:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c0380 x1830881273181056/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.050276:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c0380 with x1830881273181056 ext(0->4095) 00002000:00010000:1.0:1746065143.050279:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c0380 00000100:00100000:0.0:1746065143.053217:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.054283:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273181184 00000100:00100000:1.0:1746065143.054292:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273181184 00000100:00100000:1.0:1746065143.054333:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30761 00000100:00100000:1.0:1746065143.054341:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273181184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.054353:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.054367:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6839 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.054392:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.054398:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.054400:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.054403:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.054426:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 55 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.054436:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 55 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.054446:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267795328:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065143.055744:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.057346:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267795328:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.057370:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.057387:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:2.0:1746065143.057430:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273181184:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3090us (4220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.057438:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30761 00000100:00100000:0.0:1746065143.058710:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.058830:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273181312 00000100:00100000:3.0:1746065143.058836:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273181312 00000100:00100000:3.0:1746065143.058875:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30762 00000100:00100000:3.0:1746065143.058881:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:1791:x1830881273181312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.058894:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.058917:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6840 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.058936:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.058941:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.058946:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065143.058949:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.058974:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.058985:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.058993:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065143.059032:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:1791:x1830881273181312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 151us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.059037:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30762 00000100:00100000:0.0:1746065143.060967:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.061300:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273181440 00000100:00100000:2.0:1746065143.061306:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273181440 00010000:00010000:2.0:1746065143.061329:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.061498:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14733 00000100:00100000:2.0:1746065143.061505:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2004:x1830881273181440:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.061517:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.061532:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.061542:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.061559:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10000/0x392ae0376f8808c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6832 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.061583:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.061585:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.061591:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.061598:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.061620:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.061629:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 5 pid: 21550 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.061639:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f087b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267795584:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.061702:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.064500:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f087b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267795584:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.064520:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.064561:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273181440:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3056us (3599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.064569:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14733 00000100:00100000:2.0:1746065143.065741:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.065796:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273181696 00000100:00100000:1.0:1746065143.065802:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273181696 00002000:00100000:1.0:1746065143.065828:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f087b80 x1830881273181696/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.065837:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f087b80 with x1830881273181696 ext(0->4095) 00010000:00010000:1.0:1746065143.065844:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.065854:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.065859:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f087b80 00000100:00100000:1.0:1746065143.065884:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3103 00000100:00100000:1.0:1746065143.065889:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273181696:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.066052:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273181696:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 162us (312us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.066058:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3103 00002000:00100000:1.0:1746065143.066063:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012f087b80 x1830881273181696/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.066070:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f087b80 with x1830881273181696 ext(0->4095) 00010000:00010000:1.0:1746065143.066074:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.066102:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.066107:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f087b80 00000100:00100000:0.0:1746065143.070328:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.070791:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273181824 00000100:00100000:2.0:1746065143.070799:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273181824 00010000:00010000:2.0:1746065143.070827:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.070859:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14734 00000100:00100000:2.0:1746065143.070865:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b403e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273181824:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.070876:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.070892:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.070913:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.070931:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6839 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.070955:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.070957:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.070964:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 55 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.070971:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 55 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.070999:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 55 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.071010:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267795712:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.071094:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.075333:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267795712:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.075356:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.075395:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b403e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273181824:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4530us (5075us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.075404:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14734 00000100:00100000:0.0:1746065143.078211:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.078581:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273182080 00000100:00100000:3.0:1746065143.078590:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273182080 00002000:00100000:3.0:1746065143.078625:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb94a80 x1830881273182080/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.078635:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb94a80 with x1830881273182080 ext(0->4095) 00002000:00010000:3.0:1746065143.078639:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb94a80 00000100:00100000:3.0:1746065143.078671:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13821 00000100:00100000:3.0:1746065143.078677:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2002:x1830881273182080:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746065143.078795:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2002:x1830881273182080:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 117us (590us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.078801:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13821 00002000:00100000:3.0:1746065143.078807:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb94a80 x1830881273182080/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.078815:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb94a80 with x1830881273182080 ext(0->4095) 00002000:00010000:3.0:1746065143.078817:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb94a80 00000100:00100000:0.0:1746065143.085344:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.085424:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273182208 00000100:00100000:3.0:1746065143.085432:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273182208 00000100:00100000:3.0:1746065143.085475:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30763 00000100:00100000:3.0:1746065143.085482:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273182208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.085495:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.085510:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6847 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.085536:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 55 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.085543:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.085545:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.085548:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.085571:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 55 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.085580:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 55 pid: 21550 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.085590:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267795840:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.086679:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.088755:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267795840:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.088779:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 6 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.088798:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:3.0:1746065143.088834:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273182208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3351us (3495us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.088840:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30763 00000100:00100000:0.0:1746065143.089597:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.089747:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273182336 00000100:00100000:3.0:1746065143.089755:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273182336 00002000:00100000:3.0:1746065143.089785:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4eb800 x1830881273182336/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.089795:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eb800 with x1830881273182336 ext(0->7) 00010000:00010000:3.0:1746065143.089801:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 56 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.089813:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 56 pid: 21550 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.089818:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4eb800 00000100:00100000:3.0:1746065143.090058:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3104 00000100:00100000:3.0:1746065143.090065:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+56:2004:x1830881273182336:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065143.092962:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881273182336:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2887us (3356us total) trans 4294972146 rc 0/0 00000100:00100000:0.0:1746065143.092972:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3104 00002000:00100000:0.0:1746065143.092981:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009f4eb800 x1830881273182336/t4294972146(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.092989:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eb800 with x1830881273182336 ext(0->7) 00010000:00010000:0.0:1746065143.092997:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 58 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.093013:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 58 pid: 21550 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.093019:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4eb800 00000100:00100000:0.0:1746065143.097228:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.097307:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273182464 00000100:00100000:2.0:1746065143.097314:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273182464 00010000:00010000:2.0:1746065143.097344:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 58 pid: 21550 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.097384:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14735 00000100:00100000:2.0:1746065143.097399:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2003:x1830881273182464:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.097410:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.097430:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 58 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.097440:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 58 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.097458:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x392ae0376f8808cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6840 expref: 58 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.097483:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.097485:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.097492:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.097503:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.097530:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.097540:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267795968:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.097611:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.104149:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267795968:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.104169:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.104212:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+57:2003:x1830881273182464:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6822us (6991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.104222:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14735 00000100:00100000:0.0:1746065143.104676:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.104718:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273182720 00000100:00100000:2.0:1746065143.104724:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273182720 00002000:00100000:2.0:1746065143.104756:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4eaa00 x1830881273182720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.104765:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eaa00 with x1830881273182720 ext(0->4095) 00002000:00010000:2.0:1746065143.104769:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4eaa00 00000100:00100000:2.0:1746065143.104783:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13822 00000100:00100000:2.0:1746065143.104788:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273182720:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.104916:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273182720:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 126us (240us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.104924:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13822 00002000:00100000:2.0:1746065143.104929:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4eaa00 x1830881273182720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.104936:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4eaa00 with x1830881273182720 ext(0->4095) 00002000:00010000:2.0:1746065143.104939:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4eaa00 00000100:00100000:0.0:1746065143.108824:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.108916:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.108990:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273182848 00000100:00100000:1.0:1746065143.108997:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273182848 00000100:00100000:1.0:1746065143.109027:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273182976 00000100:00100000:1.0:1746065143.109029:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273182976 00000100:00100000:1.0:1746065143.109055:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30764 00000100:00100000:1.0:1746065143.109062:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1791:x1830881273182848:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.109077:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.109123:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e684e expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.109147:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.109153:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.109155:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.109158:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.109183:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 5 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.109194:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 5 pid: 21550 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.109206:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267796096:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.109268:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.109388:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30765 00000100:00100000:3.0:1746065143.109395:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1795:x1830881273182976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.109401:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.109408:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6855 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.109418:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.109421:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.109426:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.109428:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 60 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.109450:0:21550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.109461:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 60 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.109470:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065143.109494:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:1795:x1830881273182976:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 100us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.109499:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30765 00000100:00100000:0.0:1746065143.114630:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.114734:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267796096:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.114756:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.114769:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc800, rc 0) 00000100:00100000:1.0:1746065143.114804:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1791:x1830881273182848:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5742us (5987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.114812:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30764 00000100:00100000:2.0:1746065143.114884:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273183104 00000100:00100000:2.0:1746065143.114890:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273183104 00010000:00010000:2.0:1746065143.114923:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.114940:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14736 00000100:00100000:2.0:1746065143.114945:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273183104:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.114955:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.114970:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.114979:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.114996:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8808d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6847 expref: 6 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.115020:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.115022:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.115027:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.115037:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.115061:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 58 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.115071:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 58 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.115102:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267796352:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.115144:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.118571:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.118637:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267796352:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.118651:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.118681:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273183104:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3735us (4058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.118688:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14736 00000100:00100000:3.0:1746065143.118756:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273183360 00000100:00100000:3.0:1746065143.118760:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273183360 00002000:00100000:3.0:1746065143.118786:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88b800 x1830881273183360/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.118794:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88b800 with x1830881273183360 ext(0->4095) 00010000:00010000:3.0:1746065143.118801:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 59 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.118811:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 59 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.118816:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e88b800 00000100:00100000:3.0:1746065143.119053:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3105 00000100:00100000:3.0:1746065143.119059:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881273183360:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065143.119168:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881273183360:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 108us (603us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.119174:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3105 00002000:00100000:3.0:1746065143.119785:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88b800 x1830881273183360/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.119793:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88b800 with x1830881273183360 ext(0->4095) 00010000:00010000:3.0:1746065143.119798:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 59 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.119807:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 59 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.119812:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e88b800 00000100:00100000:0.0:1746065143.121331:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.121403:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273183488 00000100:00100000:2.0:1746065143.121409:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273183488 00010000:00010000:2.0:1746065143.121428:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 59 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.121458:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14737 00000100:00100000:2.0:1746065143.121464:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2004:x1830881273183488:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.121475:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.121489:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 59 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.121499:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 59 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.121516:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8808dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e684e expref: 59 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.121544:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.121545:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.121551:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.121558:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.121585:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 58 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.121596:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267796480:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.121653:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.126525:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267796480:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.126541:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.126586:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881273183488:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5121us (5507us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.126596:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14737 00000100:00100000:0.0:1746065143.126653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.127014:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273183744 00000100:00100000:3.0:1746065143.127020:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273183744 00002000:00100000:3.0:1746065143.127046:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d653480 x1830881273183744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.127055:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d653480 with x1830881273183744 ext(0->4095) 00002000:00010000:3.0:1746065143.127058:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d653480 00000100:00100000:3.0:1746065143.127070:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13823 00000100:00100000:3.0:1746065143.127075:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2005:x1830881273183744:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065143.127183:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2005:x1830881273183744:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 107us (529us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.127188:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13823 00002000:00100000:3.0:1746065143.127193:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d653480 x1830881273183744/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.127770:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d653480 with x1830881273183744 ext(0->4095) 00002000:00010000:3.0:1746065143.127773:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d653480 00000100:00100000:0.0:1746065143.130445:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.131361:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273183872 00000100:00100000:1.0:1746065143.131370:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273183872 00000100:00100000:1.0:1746065143.131409:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30766 00000100:00100000:1.0:1746065143.131416:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273183872:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.131431:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.131446:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e685c expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.131470:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.131477:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.131479:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.131482:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.131505:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 57 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.131515:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 57 pid: 21550 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.131525:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267796608:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.132320:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.136227:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267796608:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.136256:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.136271:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:1.0:1746065143.136309:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273183872:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4893us (5871us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.136317:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30766 00000100:00100000:0.0:1746065143.137865:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.138226:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.138346:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273184000 00000100:00100000:2.0:1746065143.138354:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273184000 00010000:00010000:2.0:1746065143.138380:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 58 pid: 21550 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.138402:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14738 00000100:00100000:2.0:1746065143.138408:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2005:x1830881273184000:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.138419:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.138435:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 58 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.138444:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 58 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.138460:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f8808e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6855 expref: 58 pid: 21550 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.138489:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.138491:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.138498:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.138506:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.138533:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.138543:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267796736:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.138605:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.138661:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273184128 00000100:00100000:1.0:1746065143.138665:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273184128 00000100:00100000:1.0:1746065143.138687:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30767 00000100:00100000:1.0:1746065143.138692:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:1791:x1830881273184128:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.138702:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.138712:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6863 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.138728:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.138734:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.138735:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.138738:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.138752:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.138762:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 5 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.138770:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267796864:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.138790:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.143720:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.143751:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273184384 00000100:00100000:0.0:1746065143.143757:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273184384 00002000:00100000:0.0:1746065143.143792:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d651880 x1830881273184384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.143803:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651880 with x1830881273184384 ext(0->4095) 00010000:00010000:0.0:1746065143.143810:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.143823:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.143829:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d651880 00000100:00100000:0.0:1746065143.143845:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3106 00000100:00100000:0.0:1746065143.143852:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273184384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.144331:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267796864:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.144350:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.144361:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:1.0:1746065143.144398:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1791:x1830881273184128:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5705us (6172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.144405:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30767 00000100:00100000:2.0:1746065143.145172:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267796736:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.145184:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.145203:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2005:x1830881273184000:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6795us (7343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.145210:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14738 00000100:00100000:0.0:1746065143.145389:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273184384:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1536us (1676us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065143.145395:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3106 00002000:00100000:0.0:1746065143.145402:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d651880 x1830881273184384/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.145410:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d651880 with x1830881273184384 ext(0->4095) 00010000:00010000:0.0:1746065143.145416:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.145427:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.145432:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d651880 00000100:00100000:0.0:1746065143.148419:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.148523:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273184512 00000100:00100000:2.0:1746065143.148530:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273184512 00010000:00010000:2.0:1746065143.148554:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.148574:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14739 00000100:00100000:2.0:1746065143.148580:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273184512:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.148590:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.148605:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.148615:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.148631:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfce00/0x392ae0376f8808eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e685c expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.148658:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.148660:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.148665:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.148677:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.148703:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.148713:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267796992:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.151416:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.152067:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267796992:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.152158:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.152203:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273184512:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3621us (3791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.152212:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14739 00000100:00100000:0.0:1746065143.152397:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.152527:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273184768 00000100:00100000:1.0:1746065143.152533:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273184768 00002000:00100000:1.0:1746065143.152564:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0a80 x1830881273184768/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.152573:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0a80 with x1830881273184768 ext(0->4095) 00002000:00010000:1.0:1746065143.152576:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b0a80 00000100:00100000:1.0:1746065143.152603:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13824 00000100:00100000:1.0:1746065143.152609:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881273184768:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.152708:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2004:x1830881273184768:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (311us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.152717:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13824 00002000:00100000:1.0:1746065143.152722:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0a80 x1830881273184768/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.152734:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0a80 with x1830881273184768 ext(0->4095) 00002000:00010000:1.0:1746065143.152736:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b0a80 00000100:00100000:0.0:1746065143.153747:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.153914:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273184896 00000100:00100000:1.0:1746065143.153919:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273184896 00000100:00100000:1.0:1746065143.153953:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30768 00000100:00100000:1.0:1746065143.153958:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273184896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.153966:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.153979:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e686a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.153998:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.154004:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.154005:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.154008:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.154028:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 57 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.154039:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 57 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.154048:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267797120:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.154126:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.155785:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267797120:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.155807:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.155820:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00000100:00100000:1.0:1746065143.156107:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273184896:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2147us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.156113:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30768 00000100:00100000:0.0:1746065143.156284:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.156583:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273185024 00000100:00100000:1.0:1746065143.156587:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273185024 00002000:00100000:1.0:1746065143.156611:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d4a0e00 x1830881273185024/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.156619:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0e00 with x1830881273185024 ext(0->7) 00010000:00010000:1.0:1746065143.156624:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 58 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.156635:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 58 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.156641:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a0e00 00000100:00100000:1.0:1746065143.156653:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3107 00000100:00100000:1.0:1746065143.156658:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+58:2005:x1830881273185024:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065143.157643:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273185024:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 983us (1358us total) trans 4294972147 rc 0/0 00000100:00100000:0.0:1746065143.157650:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3107 00002000:00100000:0.0:1746065143.157655:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d4a0e00 x1830881273185024/t4294972147(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.157662:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d4a0e00 with x1830881273185024 ext(0->7) 00010000:00010000:0.0:1746065143.157666:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.157676:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.157681:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d4a0e00 00000100:00100000:0.0:1746065143.162566:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.162660:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273185152 00000100:00100000:2.0:1746065143.162667:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273185152 00010000:00010000:2.0:1746065143.162694:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.162714:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14740 00000100:00100000:2.0:1746065143.162720:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2003:x1830881273185152:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.162730:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.162745:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.162755:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.162773:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8808f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6863 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.163124:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.163126:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.163133:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.163141:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.163166:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.163176:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267797248:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.163244:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.166192:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.166268:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273185408 00000100:00100000:1.0:1746065143.166274:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273185408 00002000:00100000:1.0:1746065143.166305:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729d4380 x1830881273185408/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.166319:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d4380 with x1830881273185408 ext(0->4095) 00002000:00010000:1.0:1746065143.166323:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729d4380 00000100:00100000:2.0:1746065143.166516:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267797248:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.166531:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.166560:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2003:x1830881273185152:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3840us (4002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.166567:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14740 00000100:00100000:1.0:1746065143.166742:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13825 00000100:00100000:1.0:1746065143.166748:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273185408:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746065143.166842:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273185408:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 94us (656us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.166847:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13825 00002000:00100000:1.0:1746065143.166851:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729d4380 x1830881273185408/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.166857:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729d4380 with x1830881273185408 ext(0->4095) 00002000:00010000:1.0:1746065143.166859:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729d4380 00000100:00100000:0.0:1746065143.169033:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.169156:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273185536 00000100:00100000:1.0:1746065143.169162:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273185536 00000100:00100000:1.0:1746065143.169199:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30769 00000100:00100000:1.0:1746065143.169205:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1795:x1830881273185536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.169217:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.169229:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6871 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.169250:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.169256:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.169257:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.169261:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.169282:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.169291:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 5 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.169301:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267797376:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.169361:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.171409:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267797376:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.171433:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.171447:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd000, rc 0) 00000100:00100000:1.0:1746065143.171489:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:1795:x1830881273185536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2283us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.171496:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30769 00000100:00100000:0.0:1746065143.173038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.173111:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.173367:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273185664 00000100:00100000:2.0:1746065143.173373:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273185664 00010000:00010000:2.0:1746065143.173396:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.173429:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14741 00000100:00100000:2.0:1746065143.173434:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5947850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273185664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.173444:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.173457:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.173466:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.173482:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8808f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e686a expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.173504:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.173507:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.173513:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065143.173516:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273185792 00010000:00010000:2.0:1746065143.173520:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065143.173520:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273185792 00000100:00100000:1.0:1746065143.173538:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30770 00000100:00100000:1.0:1746065143.173542:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:1791:x1830881273185792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.173544:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.173552:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065143.173553:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267797504:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065143.173560:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6878 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.173576:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.173580:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.173581:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.173584:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 61 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.173596:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.173603:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.173604:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.173611:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267797632:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.173627:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.174937:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267797632:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065143.174942:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065143.174953:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 61 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.174963:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc800, rc 0) 00000100:00100000:1.0:1746065143.174991:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1791:x1830881273185792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1448us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.174997:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30770 00000100:00100000:2.0:1746065143.175002:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267797504:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.175009:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.175023:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5947850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273185664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1589us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.175029:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14741 00000100:00100000:3.0:1746065143.175109:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273186048 00000100:00100000:3.0:1746065143.175113:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273186048 00002000:00100000:3.0:1746065143.175136:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fea00 x1830881273186048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.175144:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fea00 with x1830881273186048 ext(0->4095) 00010000:00010000:3.0:1746065143.175150:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.175159:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.175165:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09fea00 00000100:00100000:3.0:1746065143.175176:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3108 00000100:00100000:3.0:1746065143.175181:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2004:x1830881273186048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065143.175269:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2004:x1830881273186048:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 87us (325us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.175274:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3108 00002000:00100000:3.0:1746065143.175279:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fea00 x1830881273186048/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.175286:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fea00 with x1830881273186048 ext(0->4095) 00010000:00010000:3.0:1746065143.175290:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.175299:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.175304:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09fea00 00000100:00100000:0.0:1746065143.176869:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.177009:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.177067:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273186176 00000100:00100000:1.0:1746065143.177073:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273186176 00000100:00100000:1.0:1746065143.177136:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30771 00000100:00100000:1.0:1746065143.177142:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273186176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.177153:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.177164:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e687f expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.177180:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.177184:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.177189:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065143.177192:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.177216:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.177225:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.177233:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc600, rc 0) 00000100:00100000:1.0:1746065143.177263:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273186176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 122us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.177267:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30771 00000100:00100000:2.0:1746065143.177394:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273186304 00000100:00100000:2.0:1746065143.177398:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273186304 00010000:00010000:2.0:1746065143.177414:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.177429:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14742 00000100:00100000:2.0:1746065143.177434:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2003:x1830881273186304:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.177441:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.177453:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.177461:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.177474:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880900 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6871 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.177486:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.177487:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.177492:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.177498:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.177516:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.177525:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.177535:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267797888:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.177578:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.181298:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267797888:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.181316:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.181362:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2003:x1830881273186304:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3928us (4353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.181371:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14742 00000100:00100000:1.0:1746065143.182064:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.182302:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273186560 00000100:00100000:3.0:1746065143.182308:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273186560 00002000:00100000:3.0:1746065143.182339:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3480 x1830881273186560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.182348:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3480 with x1830881273186560 ext(0->4095) 00010000:00010000:3.0:1746065143.182355:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.182367:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.182372:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3480 00000100:00100000:3.0:1746065143.182387:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3109 00000100:00100000:3.0:1746065143.182393:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273186560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065143.182491:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273186560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (429us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.182496:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3109 00002000:00100000:3.0:1746065143.182500:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8801306f3480 x1830881273186560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.182507:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801306f3480 with x1830881273186560 ext(0->4095) 00010000:00010000:3.0:1746065143.182512:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.182519:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.182524:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801306f3480 00000100:00100000:0.0:1746065143.185734:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.186421:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.186501:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273186688 00000100:00100000:3.0:1746065143.186508:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273186688 00000100:00100000:2.0:1746065143.186599:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273186816 00000100:00100000:2.0:1746065143.186603:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273186816 00010000:00010000:2.0:1746065143.186619:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.186641:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14743 00000100:00100000:2.0:1746065143.186647:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273186816:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.186658:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.186674:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.186684:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.186702:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880907 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6878 expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.186717:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.186719:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.186725:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.186732:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.186770:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.186780:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267798016:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.186829:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.186932:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30772 00000100:00100000:3.0:1746065143.186938:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:1791:x1830881273186688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.186949:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.186957:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6886 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.186972:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.186977:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.186978:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.186980:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 61 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.186995:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.187004:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 5 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.187017:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267798144:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.187051:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.188972:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013017ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267798016:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.188984:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.189009:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273186816:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2362us (2589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.189020:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14743 00000100:00100000:2.0:1746065143.190644:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.190693:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267798144:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.190711:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.190724:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065143.190755:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:1791:x1830881273186688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3817us (5028us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.190761:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30772 00000100:00100000:1.0:1746065143.190985:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273187072 00000100:00100000:1.0:1746065143.190990:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273187072 00002000:00100000:1.0:1746065143.191016:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017ad80 x1830881273187072/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.191024:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017ad80 with x1830881273187072 ext(0->4095) 00010000:00010000:1.0:1746065143.191030:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.191040:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.191046:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017ad80 00000100:00100000:1.0:1746065143.191058:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3110 00000100:00100000:1.0:1746065143.191063:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273187072:12345-192.168.202.8@tcp:3:ldlm_bl.0 00000100:00100000:1.0:1746065143.191161:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273187072:12345-192.168.202.8@tcp:3:ldlm_bl.0 Request processed in 98us (520us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.191165:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3110 00002000:00100000:1.0:1746065143.191169:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013017ad80 x1830881273187072/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.191175:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013017ad80 with x1830881273187072 ext(0->4095) 00010000:00010000:1.0:1746065143.191178:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.191186:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.191191:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013017ad80 00000100:00100000:0.0:1746065143.193771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.193866:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273187200 00000100:00100000:2.0:1746065143.193872:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273187200 00010000:00010000:2.0:1746065143.193906:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.193941:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14744 00000100:00100000:2.0:1746065143.193947:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273187200:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.193956:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.193971:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.193981:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.193997:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f88090e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e687f expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.194270:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.194272:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.194279:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 59 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.194286:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 59 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.194311:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 59 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.194322:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267798272:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.194389:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.196939:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267798272:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.196953:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.197259:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273187200:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3311us (3492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.197267:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14744 00000100:00100000:0.0:1746065143.197452:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.197551:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273187456 00000100:00100000:3.0:1746065143.197556:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273187456 00002000:00100000:3.0:1746065143.197581:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788700 x1830881273187456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.197591:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788700 with x1830881273187456 ext(0->4095) 00002000:00010000:3.0:1746065143.197595:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788700 00000100:00100000:3.0:1746065143.197606:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13826 00000100:00100000:3.0:1746065143.197611:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881273187456:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065143.197689:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881273187456:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 78us (238us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.197694:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13826 00002000:00100000:3.0:1746065143.197698:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788700 x1830881273187456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.197709:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788700 with x1830881273187456 ext(0->4095) 00002000:00010000:3.0:1746065143.197711:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788700 00000100:00100000:0.0:1746065143.200622:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.200772:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273187584 00000100:00100000:3.0:1746065143.200816:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273187584 00000100:00100000:3.0:1746065143.200936:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30773 00000100:00100000:3.0:1746065143.200944:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273187584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.200957:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.200970:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e688d expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.200993:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 59 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.200999:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.201000:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.201002:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.201022:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 59 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.201030:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 59 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.201038:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267798400:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.201127:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.201986:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267798400:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.202002:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.202011:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:3.0:1746065143.202033:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273187584:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1090us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.202039:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30773 00000100:00100000:0.0:1746065143.202731:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.202778:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273187712 00000100:00100000:2.0:1746065143.202782:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273187712 00010000:00010000:2.0:1746065143.202799:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 60 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.202819:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14745 00000100:00100000:2.0:1746065143.202823:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273187712:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.202832:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.202845:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 60 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.202854:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 60 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.202869:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880915 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6886 expref: 60 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.202890:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.202891:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.202910:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.202917:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.202939:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.202948:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267798528:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.203024:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.204478:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.204539:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267798528:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.204553:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.204675:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881273187712:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1850us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.204683:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14745 00000100:00100000:1.0:1746065143.205226:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273187968 00000100:00100000:1.0:1746065143.205232:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273187968 00002000:00100000:1.0:1746065143.205264:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789180 x1830881273187968/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.205273:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789180 with x1830881273187968 ext(0->4095) 00002000:00010000:1.0:1746065143.205276:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789180 00000100:00100000:1.0:1746065143.205302:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13827 00000100:00100000:1.0:1746065143.205308:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273187968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.205396:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273187968:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 89us (921us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.205401:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13827 00002000:00100000:1.0:1746065143.205406:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789180 x1830881273187968/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.205412:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789180 with x1830881273187968 ext(0->4095) 00002000:00010000:1.0:1746065143.205414:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789180 00000100:00100000:0.0:1746065143.208550:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.208614:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273188096 00000100:00100000:3.0:1746065143.208621:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273188096 00000100:00100000:3.0:1746065143.209171:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30774 00000100:00100000:3.0:1746065143.209179:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1791:x1830881273188096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.209193:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.209208:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6894 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.209232:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.209238:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.209239:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.209243:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.209266:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.209277:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 5 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.209288:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267798656:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.209358:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.210003:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.210608:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273188224 00000100:00100000:1.0:1746065143.210613:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273188224 00000100:00100000:1.0:1746065143.210647:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30775 00000100:00100000:1.0:1746065143.210652:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1795:x1830881273188224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.210660:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.210668:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e689b expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.210681:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.210685:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.210694:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.210697:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 62 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.210715:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.210725:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 62 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.210732:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd400, rc 0) 00000100:00100000:1.0:1746065143.210756:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:1795:x1830881273188224:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 104us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.210761:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30775 00000100:00100000:3.0:1746065143.211996:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267798656:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.212012:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 61 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.212020:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065143.212043:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1791:x1830881273188096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2866us (3499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.212048:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30774 00000100:00100000:0.0:1746065143.213953:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.214040:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273188352 00000100:00100000:2.0:1746065143.214047:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273188352 00010000:00010000:2.0:1746065143.214071:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.214159:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14746 00000100:00100000:2.0:1746065143.214165:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273188352:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.214176:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.214191:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.214202:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.214218:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88091c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e688d expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.214243:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.214245:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.214251:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.214258:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.214281:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.214290:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 60 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.214300:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267798912:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.214679:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.217242:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.217350:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267798912:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.217365:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.217415:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273188352:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3249us (3466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.217423:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273188608 00000100:00100000:2.0:1746065143.217424:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14746 00000100:00100000:3.0:1746065143.217430:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273188608 00002000:00100000:3.0:1746065143.217464:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789f80 x1830881273188608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.217473:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789f80 with x1830881273188608 ext(0->4095) 00010000:00010000:3.0:1746065143.217480:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.217492:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.217498:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b789f80 00000100:00100000:3.0:1746065143.217513:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3111 00000100:00100000:3.0:1746065143.217519:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273188608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065143.217626:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273188608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 106us (390us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.217632:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3111 00002000:00100000:3.0:1746065143.217636:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789f80 x1830881273188608/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.217643:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789f80 with x1830881273188608 ext(0->4095) 00010000:00010000:3.0:1746065143.217647:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.217655:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.217660:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b789f80 00000100:00100000:0.0:1746065143.220055:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.220286:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273188736 00000100:00100000:2.0:1746065143.220293:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273188736 00010000:00010000:2.0:1746065143.220315:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.220511:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14747 00000100:00100000:2.0:1746065143.220517:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273188736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.220528:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.220542:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.220553:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.220571:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880923 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6894 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.220702:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.220704:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.220710:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.220718:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.220742:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.220751:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267799040:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.221117:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.222941:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.223230:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267799040:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.223245:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.223275:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273188736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2758us (3225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.223283:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14747 00000100:00100000:3.0:1746065143.223353:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273188992 00000100:00100000:3.0:1746065143.223358:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273188992 00002000:00100000:3.0:1746065143.223386:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78a680 x1830881273188992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.223394:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a680 with x1830881273188992 ext(0->4095) 00002000:00010000:3.0:1746065143.223398:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78a680 00000100:00100000:3.0:1746065143.223424:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13828 00000100:00100000:3.0:1746065143.223430:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881273188992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065143.223522:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881273188992:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 91us (585us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.223527:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13828 00002000:00100000:3.0:1746065143.223532:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78a680 x1830881273188992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.223538:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a680 with x1830881273188992 ext(0->4095) 00002000:00010000:3.0:1746065143.223541:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78a680 00000100:00100000:0.0:1746065143.227404:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.227548:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273189120 00000100:00100000:2.0:1746065143.227556:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273189120 00000100:00100000:2.0:1746065143.227589:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30776 00000100:00100000:2.0:1746065143.227596:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273189120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.227610:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.227623:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68a2 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.227647:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.227654:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.227656:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.227659:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.227683:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.227693:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 59 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.227703:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267799168:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.228294:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.230462:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267799168:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.230483:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.230496:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065143.230527:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273189120:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2932us (3131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.230534:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30776 00000100:00100000:0.0:1746065143.231007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.231299:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273189248 00000100:00100000:2.0:1746065143.231304:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273189248 00010000:00010000:2.0:1746065143.231325:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.231345:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14748 00000100:00100000:2.0:1746065143.231350:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5947450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273189248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.231360:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.231376:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.231385:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.231403:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f88092a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e689b expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.231431:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.231433:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.231439:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.231446:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.231468:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.231478:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267799296:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.231532:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.233549:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267799296:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.233564:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.233608:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5947450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881273189248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2256us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.233616:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14748 00000100:00100000:0.0:1746065143.235263:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.235913:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273189504 00000100:00100000:1.0:1746065143.235920:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273189504 00002000:00100000:1.0:1746065143.235956:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78ad80 x1830881273189504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.235966:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78ad80 with x1830881273189504 ext(0->4095) 00002000:00010000:1.0:1746065143.235971:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78ad80 00000100:00100000:1.0:1746065143.236474:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13829 00000100:00100000:1.0:1746065143.236482:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273189504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065143.236596:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273189504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 114us (1336us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.236604:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13829 00002000:00100000:1.0:1746065143.236609:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78ad80 x1830881273189504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.236615:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78ad80 with x1830881273189504 ext(0->4095) 00002000:00010000:1.0:1746065143.236618:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78ad80 00000100:00100000:0.0:1746065143.236913:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.237277:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273189632 00000100:00100000:2.0:1746065143.237281:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273189632 00000100:00100000:2.0:1746065143.237303:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30777 00000100:00100000:2.0:1746065143.237308:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1791:x1830881273189632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.237317:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.237329:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68a9 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.237353:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.237359:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.237360:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.237363:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.237385:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.237395:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 5 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.237404:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267799424:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.238248:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.240913:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.241062:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273189760 00000100:00100000:2.0:1746065143.241069:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273189760 00000100:00100000:2.0:1746065143.241542:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30778 00000100:00100000:2.0:1746065143.241550:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1795:x1830881273189760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.241565:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.241578:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68b0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.241598:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.241602:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.241608:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.241610:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.241639:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.241650:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.241658:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065143.241690:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:1795:x1830881273189760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 142us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.241696:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30778 00000100:00100000:0.0:1746065143.242357:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267799424:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065143.242372:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 61 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.242381:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:0.0:1746065143.242409:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1791:x1830881273189632:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5101us (5514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.242415:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30777 00010000:00010000:2.0:1746065143.243181:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065143.243941:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.244065:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273189888 00000100:00100000:2.0:1746065143.244071:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273189888 00010000:00010000:2.0:1746065143.244119:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.244141:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14749 00000100:00100000:2.0:1746065143.244146:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273189888:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.244155:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.244169:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.244184:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.244201:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880931 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a2 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.244352:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.244354:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.244361:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.244368:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.244391:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.244400:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 60 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.244410:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267799680:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.245046:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.246923:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.247009:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267799680:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.247023:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.247052:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273189888:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2906us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.247064:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14749 00000100:00100000:3.0:1746065143.247313:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273190144 00000100:00100000:3.0:1746065143.247319:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273190144 00002000:00100000:3.0:1746065143.247351:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78bb80 x1830881273190144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.247360:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78bb80 with x1830881273190144 ext(0->4095) 00010000:00010000:3.0:1746065143.247367:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.247380:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.247385:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78bb80 00000100:00100000:3.0:1746065143.247412:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3112 00000100:00100000:3.0:1746065143.247418:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273190144:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065143.247516:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273190144:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 98us (598us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.247521:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3112 00002000:00100000:3.0:1746065143.247525:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78bb80 x1830881273190144/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.247532:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78bb80 with x1830881273190144 ext(0->4095) 00010000:00010000:3.0:1746065143.247536:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.247545:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.247550:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78bb80 00000100:00100000:0.0:1746065143.249873:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.249984:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273190272 00000100:00100000:2.0:1746065143.249990:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273190272 00010000:00010000:2.0:1746065143.250012:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.250032:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14750 00000100:00100000:2.0:1746065143.250037:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2003:x1830881273190272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.250046:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.250060:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.250069:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.250517:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880938 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68a9 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.250529:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.250531:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.250537:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 60 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.250545:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 60 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.250568:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 60 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.250579:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267799808:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.250761:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.252979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.253163:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267799808:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.253178:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.253217:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2003:x1830881273190272:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3179us (3348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.253226:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14750 00000100:00100000:1.0:1746065143.253293:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273190528 00000100:00100000:1.0:1746065143.253299:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273190528 00002000:00100000:1.0:1746065143.253325:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788380 x1830881273190528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.253335:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788380 with x1830881273190528 ext(0->4095) 00002000:00010000:1.0:1746065143.253338:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788380 00000100:00100000:1.0:1746065143.253363:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13830 00000100:00100000:1.0:1746065143.253369:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273190528:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065143.253462:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273190528:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 93us (490us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.253468:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13830 00002000:00100000:1.0:1746065143.253473:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788380 x1830881273190528/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.253480:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788380 with x1830881273190528 ext(0->4095) 00002000:00010000:1.0:1746065143.253483:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788380 00000100:00100000:0.0:1746065143.255879:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.256131:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273190656 00000100:00100000:2.0:1746065143.256138:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273190656 00000100:00100000:2.0:1746065143.256181:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30779 00000100:00100000:2.0:1746065143.256187:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273190656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.256198:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.256211:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68b7 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.256233:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 59 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.256239:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.256241:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.256244:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.256266:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 59 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.256281:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 59 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.256291:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267799936:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.256398:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.258752:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267799936:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.258774:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.258788:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065143.258815:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273190656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2629us (2942us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.258822:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30779 00000100:00100000:0.0:1746065143.259162:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.259251:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273190784 00000100:00100000:3.0:1746065143.259256:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273190784 00010000:00010000:3.0:1746065143.259275:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 60 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.259294:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14751 00000100:00100000:3.0:1746065143.259299:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273190784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.259308:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.259322:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 60 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.259330:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 60 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.259347:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f88093f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b0 expref: 60 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.259367:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.259368:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.259374:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.259385:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.259407:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.259417:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267800064:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.259462:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.262640:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.262841:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273191040 00000100:00100000:2.0:1746065143.262848:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273191040 00002000:00100000:2.0:1746065143.262890:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78a300 x1830881273191040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.262907:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a300 with x1830881273191040 ext(0->4095) 00002000:00010000:2.0:1746065143.262912:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78a300 00000100:00100000:2.0:1746065143.263154:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13831 00000100:00100000:2.0:1746065143.263161:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273191040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065143.263264:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273191040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 104us (631us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.263273:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13831 00002000:00100000:2.0:1746065143.263278:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78a300 x1830881273191040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.263285:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a300 with x1830881273191040 ext(0->4095) 00002000:00010000:2.0:1746065143.263288:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78a300 00000100:00100000:3.0:1746065143.263463:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267800064:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.263479:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.263509:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881273190784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4209us (4347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.263516:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14751 00000100:00100000:0.0:1746065143.264781:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.265112:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273191168 00000100:00100000:2.0:1746065143.265118:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273191168 00000100:00100000:2.0:1746065143.265156:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30780 00000100:00100000:2.0:1746065143.265161:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1791:x1830881273191168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.265171:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.265184:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68be expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.265204:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.265211:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.265212:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.265215:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.265237:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.265247:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 5 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.265262:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267800192:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.266807:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.268656:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.268996:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273191296 00000100:00100000:1.0:1746065143.269004:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273191296 00000100:00100000:1.0:1746065143.269048:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30781 00000100:00100000:1.0:1746065143.269055:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1795:x1830881273191296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.269070:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.269108:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68c5 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.269130:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.269134:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.269140:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.269143:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 62 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.269170:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.269181:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 62 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.269190:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00000100:00100000:1.0:1746065143.269222:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:1795:x1830881273191296:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 167us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.269228:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30781 00000100:00100000:2.0:1746065143.269346:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267800192:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.269359:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 61 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.269366:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065143.269382:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1791:x1830881273191168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4221us (4605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.269387:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30780 00000100:00100000:0.0:1746065143.269679:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.269931:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273191424 00000100:00100000:2.0:1746065143.269935:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273191424 00010000:00010000:2.0:1746065143.269950:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.269965:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14752 00000100:00100000:2.0:1746065143.269969:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273191424:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.269976:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.269990:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.269999:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.270017:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880946 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68b7 expref: 6 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.270031:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.270032:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.270037:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.270043:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.270060:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.270069:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 60 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.270078:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267800448:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.271291:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.273527:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.273658:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273191680 00000100:00100000:1.0:1746065143.273665:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273191680 00002000:00100000:1.0:1746065143.273699:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858700 x1830881273191680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.273708:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858700 with x1830881273191680 ext(0->4095) 00010000:00010000:1.0:1746065143.273717:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.273731:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.273738:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093858700 00000100:00100000:1.0:1746065143.273765:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3113 00000100:00100000:1.0:1746065143.273771:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2004:x1830881273191680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.273871:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2004:x1830881273191680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (349us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.273876:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3113 00002000:00100000:1.0:1746065143.273881:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858700 x1830881273191680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.273888:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858700 with x1830881273191680 ext(0->4095) 00010000:00010000:1.0:1746065143.273893:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.273915:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.273921:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093858700 00000100:00100000:3.0:1746065143.273996:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267800448:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.274018:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.274048:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273191424:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4078us (4369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.274056:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14752 00000100:00100000:0.0:1746065143.276467:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.276750:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273191808 00000100:00100000:3.0:1746065143.276757:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273191808 00010000:00010000:3.0:1746065143.276780:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.276809:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14753 00000100:00100000:3.0:1746065143.276815:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273191808:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.276824:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.276839:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.276850:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.276868:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f88094d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68be expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.276893:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.276904:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.276910:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.276916:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.276941:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 60 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.276952:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267800576:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.277392:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.280790:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.280869:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267800576:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.280886:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.280930:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273191808:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4114us (4468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.280942:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14753 00000100:00100000:2.0:1746065143.281014:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273192064 00000100:00100000:2.0:1746065143.281020:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273192064 00002000:00100000:2.0:1746065143.281047:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858e00 x1830881273192064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.281057:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858e00 with x1830881273192064 ext(0->4095) 00002000:00010000:2.0:1746065143.281061:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093858e00 00000100:00100000:2.0:1746065143.281206:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13832 00000100:00100000:2.0:1746065143.281213:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881273192064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.281312:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881273192064:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (528us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.281318:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13832 00002000:00100000:2.0:1746065143.281323:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858e00 x1830881273192064/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.281330:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858e00 with x1830881273192064 ext(0->4095) 00002000:00010000:2.0:1746065143.281332:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093858e00 00000100:00100000:0.0:1746065143.283380:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.283465:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273192192 00000100:00100000:3.0:1746065143.283470:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273192192 00000100:00100000:3.0:1746065143.283506:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30782 00000100:00100000:3.0:1746065143.283512:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273192192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.283523:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.283535:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68cc expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.283556:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.283563:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.283565:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.283568:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.283589:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 59 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.283599:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 59 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.283608:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267800704:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.283677:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.285389:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267800704:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.285410:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.285423:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:3.0:1746065143.285449:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273192192:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1936us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.285455:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30782 00000100:00100000:0.0:1746065143.285772:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.286020:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273192320 00000100:00100000:3.0:1746065143.286025:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273192320 00010000:00010000:3.0:1746065143.286043:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.286061:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14754 00000100:00100000:3.0:1746065143.286066:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273192320:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.286077:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.286117:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.286126:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.286141:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f880954 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68c5 expref: 60 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.286164:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.286166:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.286171:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.286178:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.286199:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.286208:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267800832:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.286255:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.288869:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.289041:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267800832:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.289055:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.289125:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:2005:x1830881273192320:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3057us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.289134:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14754 00000100:00100000:1.0:1746065143.289289:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273192576 00000100:00100000:1.0:1746065143.289296:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273192576 00002000:00100000:1.0:1746065143.289326:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859880 x1830881273192576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.289340:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859880 with x1830881273192576 ext(0->4095) 00002000:00010000:1.0:1746065143.289344:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093859880 00000100:00100000:1.0:1746065143.289372:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13833 00000100:00100000:1.0:1746065143.289378:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273192576:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065143.289471:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273192576:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 93us (606us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.289476:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13833 00002000:00100000:1.0:1746065143.289480:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859880 x1830881273192576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.289487:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859880 with x1830881273192576 ext(0->4095) 00002000:00010000:1.0:1746065143.289489:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093859880 00000100:00100000:0.0:1746065143.291687:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.291972:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273192704 00000100:00100000:3.0:1746065143.291980:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273192704 00000100:00100000:3.0:1746065143.292523:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30783 00000100:00100000:3.0:1746065143.292530:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+59:1791:x1830881273192704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.292543:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.292556:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68d3 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.292579:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.292585:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.292587:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.292590:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 60 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.292614:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.292624:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 5 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.292635:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267800960:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.292701:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.294493:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.294613:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273192832 00000100:00100000:2.0:1746065143.294619:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273192832 00000100:00100000:2.0:1746065143.294866:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30784 00000100:00100000:2.0:1746065143.294873:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1795:x1830881273192832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.294883:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.294892:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68da expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.294921:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.294925:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.294930:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.294932:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.294955:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.294969:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.294977:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065143.295004:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:1795:x1830881273192832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 133us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.295010:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30784 00000100:00100000:3.0:1746065143.296134:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267800960:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.296150:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 61 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.296159:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065143.296192:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1791:x1830881273192704:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3663us (4510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.296198:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30783 00000100:00100000:2.0:1746065143.297038:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.297399:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273192960 00000100:00100000:3.0:1746065143.297403:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273192960 00010000:00010000:3.0:1746065143.297422:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.297730:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14755 00000100:00100000:3.0:1746065143.297737:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5947050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273192960:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.297750:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.297766:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.297776:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.297793:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f88095b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68cc expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.297814:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.297816:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.297823:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 60 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.297830:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 60 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.297851:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 60 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.297861:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 60 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.297870:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267801216:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.297939:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d7349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.300346:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267801216:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.300361:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.300530:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5947050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273192960:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2792us (3492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.300539:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14755 00000100:00100000:0.0:1746065143.301816:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.301886:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273193216 00000100:00100000:2.0:1746065143.301893:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273193216 00002000:00100000:2.0:1746065143.301935:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385a300 x1830881273193216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.301944:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385a300 with x1830881273193216 ext(0->4095) 00010000:00010000:2.0:1746065143.301950:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 61 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.301962:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 61 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.301968:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385a300 00000100:00100000:2.0:1746065143.302057:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3114 00000100:00100000:2.0:1746065143.302064:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273193216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.302319:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273193216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 254us (503us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.302328:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3114 00002000:00100000:2.0:1746065143.302333:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385a300 x1830881273193216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.302340:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385a300 with x1830881273193216 ext(0->4095) 00010000:00010000:2.0:1746065143.302345:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 61 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.302354:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 61 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.302359:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385a300 00000100:00100000:0.0:1746065143.304021:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.304274:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273193344 00000100:00100000:3.0:1746065143.304280:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273193344 00010000:00010000:3.0:1746065143.304303:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 61 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.304335:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14756 00000100:00100000:3.0:1746065143.304341:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2005:x1830881273193344:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.304351:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.304365:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 61 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.304375:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 61 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.304391:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880962 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68d3 expref: 61 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.304415:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.304417:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.304427:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.304433:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.304462:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 60 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.304473:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267801344:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.304532:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.308256:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.308350:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267801344:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.308366:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.308399:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2005:x1830881273193344:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4058us (4382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.308408:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14756 00000100:00100000:2.0:1746065143.308475:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273193600 00000100:00100000:2.0:1746065143.308481:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273193600 00002000:00100000:2.0:1746065143.308513:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385aa00 x1830881273193600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.308521:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385aa00 with x1830881273193600 ext(0->4095) 00002000:00010000:2.0:1746065143.308525:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009385aa00 00000100:00100000:2.0:1746065143.308793:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13834 00000100:00100000:2.0:1746065143.308800:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881273193600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.308914:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2004:x1830881273193600:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 114us (664us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.308920:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13834 00002000:00100000:2.0:1746065143.308925:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385aa00 x1830881273193600/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.308937:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385aa00 with x1830881273193600 ext(0->4095) 00002000:00010000:2.0:1746065143.308940:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009385aa00 00000100:00100000:0.0:1746065143.314948:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.315191:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273193728 00000100:00100000:3.0:1746065143.315199:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273193728 00000100:00100000:3.0:1746065143.315249:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30785 00000100:00100000:3.0:1746065143.315256:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273193728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.315271:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.315287:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68e1 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.315311:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 59 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.315318:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.315320:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.315323:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.315352:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 59 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.315364:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 59 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.315375:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267801472:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.315447:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.323151:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267801472:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.323179:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.323195:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065143.323238:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273193728:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7982us (8297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.323246:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30785 00000100:00100000:0.0:1746065143.324674:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.328781:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273193856 00000100:00100000:1.0:1746065143.328791:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273193856 00002000:00100000:1.0:1746065143.328833:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009385b100 x1830881273193856/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.328842:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b100 with x1830881273193856 ext(0->7) 00010000:00010000:1.0:1746065143.328851:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 60 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.328866:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 60 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.328873:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385b100 00000100:00100000:1.0:1746065143.328912:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3115 00000100:00100000:1.0:1746065143.328920:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+60:2003:x1830881273193856:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746065143.330817:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2003:x1830881273193856:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1891us (6140us total) trans 4294972148 rc 0/0 00000100:00100000:1.0:1746065143.330826:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3115 00002000:00100000:1.0:1746065143.330834:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009385b100 x1830881273193856/t4294972148(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.330842:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b100 with x1830881273193856 ext(0->7) 00010000:00010000:1.0:1746065143.330848:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 62 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.330860:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 62 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.330866:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385b100 00000100:00100000:0.0:1746065143.344130:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.344220:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273193984 00000100:00100000:3.0:1746065143.344228:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273193984 00010000:00010000:3.0:1746065143.344259:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 62 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.344282:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14757 00000100:00100000:3.0:1746065143.344288:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2002:x1830881273193984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.344299:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.344316:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 62 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.344326:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 62 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.344344:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880969 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68da expref: 62 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.344373:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.344375:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.344382:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.344389:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.344413:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.344423:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267801600:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.344485:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.354189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.354270:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.354353:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273194240 00000100:00100000:1.0:1746065143.354361:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273194240 00002000:00100000:1.0:1746065143.354396:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385b800 x1830881273194240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.354406:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b800 with x1830881273194240 ext(0->4095) 00002000:00010000:1.0:1746065143.354410:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009385b800 00000100:00100000:1.0:1746065143.354426:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13835 00000100:00100000:1.0:1746065143.354432:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273194240:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065143.354535:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273194240:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 103us (353us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.354543:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13835 00002000:00100000:1.0:1746065143.354548:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009385b800 x1830881273194240/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.354554:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385b800 with x1830881273194240 ext(0->4095) 00002000:00010000:1.0:1746065143.354557:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009385b800 00000100:00100000:2.0:1746065143.354625:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273194368 00000100:00100000:2.0:1746065143.354629:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273194368 00000100:00100000:2.0:1746065143.354649:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30786 00000100:00100000:2.0:1746065143.354653:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:1791:x1830881273194368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.354661:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.354673:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68e8 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.354694:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.354700:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.354701:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.354704:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 63 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.354726:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.354736:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 5 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.354746:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267801728:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.355587:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.356775:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267801600:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.356791:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.356832:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:2002:x1830881273193984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 12542us (12709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.356840:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14757 00000100:00100000:0.0:1746065143.357423:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.357475:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273194496 00000100:00100000:1.0:1746065143.357484:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273194496 00000100:00100000:1.0:1746065143.357521:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30787 00000100:00100000:1.0:1746065143.357527:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:1795:x1830881273194496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.357538:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.357549:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68ef expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.357568:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.357573:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 64 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.357578:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.357580:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 64 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.357604:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 64 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.357613:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 64 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.357625:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfcc00, rc 0) 00000100:00100000:1.0:1746065143.357657:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:1795:x1830881273194496:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 130us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.357663:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30787 00000100:00100000:2.0:1746065143.357762:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267801728:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.357775:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 63 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.358681:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:2.0:1746065143.358708:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:1791:x1830881273194368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4053us (4436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.358714:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30786 00000100:00100000:0.0:1746065143.359651:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.360110:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273194624 00000100:00100000:3.0:1746065143.360118:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273194624 00010000:00010000:3.0:1746065143.360145:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.360169:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14758 00000100:00100000:3.0:1746065143.360175:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273194624:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.360187:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.360203:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.360213:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.360233:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880970 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e1 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.360509:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.360511:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.360517:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.360524:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.360549:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.360588:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 62 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.360599:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267801984:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.360652:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.363962:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267801984:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.363980:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.363981:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.364016:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273194624:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3840us (4366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.364024:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14758 00000100:00100000:1.0:1746065143.364029:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273194880 00000100:00100000:1.0:1746065143.364034:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273194880 00002000:00100000:1.0:1746065143.364065:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859500 x1830881273194880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.364073:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859500 with x1830881273194880 ext(0->4095) 00010000:00010000:1.0:1746065143.364094:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.364106:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.364112:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859500 00000100:00100000:1.0:1746065143.364550:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3116 00000100:00100000:1.0:1746065143.364556:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:2005:x1830881273194880:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065143.364671:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:2005:x1830881273194880:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 115us (690us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.364676:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3116 00002000:00100000:1.0:1746065143.364681:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859500 x1830881273194880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.364694:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859500 with x1830881273194880 ext(0->4095) 00010000:00010000:1.0:1746065143.364699:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.364707:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.364712:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859500 00000100:00100000:0.0:1746065143.366385:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.366456:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273195008 00000100:00100000:3.0:1746065143.366462:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273195008 00010000:00010000:3.0:1746065143.366484:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.366502:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14759 00000100:00100000:3.0:1746065143.366507:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:2004:x1830881273195008:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.366515:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.366527:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.366536:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.366553:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880977 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68e8 expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.366695:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.366699:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.366708:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 62 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.366716:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 62 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.366743:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 62 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.366753:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267802112:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.367281:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.368446:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267802112:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.368459:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.368491:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881273195008:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1984us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.368499:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14759 00000100:00100000:0.0:1746065143.369563:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.369615:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273195264 00000100:00100000:2.0:1746065143.369620:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273195264 00002000:00100000:2.0:1746065143.369649:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98380 x1830881273195264/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.369659:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98380 with x1830881273195264 ext(0->4095) 00002000:00010000:2.0:1746065143.369662:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98380 00000100:00100000:2.0:1746065143.369684:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13836 00000100:00100000:2.0:1746065143.369832:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881273195264:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.369928:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881273195264:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 238us (367us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.369934:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13836 00002000:00100000:2.0:1746065143.369939:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98380 x1830881273195264/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.369947:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98380 with x1830881273195264 ext(0->4095) 00002000:00010000:2.0:1746065143.369949:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98380 00000100:00100000:0.0:1746065143.372817:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.373128:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273195392 00000100:00100000:2.0:1746065143.373136:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273195392 00000100:00100000:2.0:1746065143.373179:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30788 00000100:00100000:2.0:1746065143.373185:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273195392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.373198:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.373211:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68f6 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.373234:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 61 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.373241:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.373242:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.373245:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.373374:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 61 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.373385:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 61 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.373395:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267802240:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.373564:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.375705:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267802240:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.375726:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.375741:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:2.0:1746065143.375771:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273195392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2586us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.375779:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30788 00000100:00100000:0.0:1746065143.376111:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.376375:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273195520 00000100:00100000:3.0:1746065143.376381:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273195520 00010000:00010000:3.0:1746065143.376402:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 62 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.376420:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14760 00000100:00100000:3.0:1746065143.376425:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881273195520:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.376434:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.376448:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 62 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.376462:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 62 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.376479:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f88097e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68ef expref: 62 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.376491:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.376492:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.376498:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.376505:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.376525:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.376534:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267802368:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.376580:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.382018:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267802368:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.382038:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.382114:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:2004:x1830881273195520:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5687us (6030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.382122:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14760 00000100:00100000:0.0:1746065143.382765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.383380:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273195776 00000100:00100000:2.0:1746065143.383387:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273195776 00002000:00100000:2.0:1746065143.383419:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98e00 x1830881273195776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.383428:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98e00 with x1830881273195776 ext(0->4095) 00002000:00010000:2.0:1746065143.383432:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98e00 00000100:00100000:0.0:1746065143.386118:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.386151:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13837 00000100:00100000:2.0:1746065143.386163:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273195776:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.386287:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273195776:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 127us (3522us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.386293:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13837 00002000:00100000:2.0:1746065143.386301:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98e00 x1830881273195776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.386309:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98e00 with x1830881273195776 ext(0->4095) 00002000:00010000:2.0:1746065143.386315:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98e00 00000100:00100000:3.0:1746065143.386986:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273195904 00000100:00100000:3.0:1746065143.386994:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273195904 00000100:00100000:3.0:1746065143.387024:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30789 00000100:00100000:3.0:1746065143.387029:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+61:1791:x1830881273195904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.387039:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.387052:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e68fd expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.387074:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.387100:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.387101:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.387105:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.387129:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.387139:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 5 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.387149:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267802496:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.387195:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.390661:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.390726:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273196032 00000100:00100000:2.0:1746065143.390734:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273196032 00000100:00100000:2.0:1746065143.390783:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30790 00000100:00100000:2.0:1746065143.390790:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:1795:x1830881273196032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.390805:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.390819:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6904 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.390844:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.390848:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 64 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.390854:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.390857:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 64 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.390883:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 64 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.390893:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 64 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.390910:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065143.390945:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:1795:x1830881273196032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 156us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.390950:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30790 00000100:00100000:3.0:1746065143.393993:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267802496:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.394016:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 63 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.394031:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065143.394118:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:1791:x1830881273195904:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7087us (8037us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.394125:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30789 00000100:00100000:0.0:1746065143.395982:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.396102:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273196160 00000100:00100000:3.0:1746065143.396110:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273196160 00010000:00010000:3.0:1746065143.396137:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.396171:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14761 00000100:00100000:3.0:1746065143.396178:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273196160:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.396190:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.396205:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.396216:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.396235:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880985 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68f6 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.396262:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.396264:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.396270:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.396276:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.396307:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 62 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.396317:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 62 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.396328:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267802752:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.396392:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.400619:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267802752:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.400635:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.400672:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273196160:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4494us (4694us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.400681:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14761 00000100:00100000:0.0:1746065143.402449:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.403177:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273196416 00000100:00100000:1.0:1746065143.403185:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273196416 00002000:00100000:1.0:1746065143.403224:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f99c00 x1830881273196416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.403233:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99c00 with x1830881273196416 ext(0->4095) 00010000:00010000:1.0:1746065143.403240:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.403253:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.403259:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f99c00 00000100:00100000:1.0:1746065143.403287:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3117 00000100:00100000:1.0:1746065143.403294:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:2004:x1830881273196416:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.403407:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:2004:x1830881273196416:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 114us (961us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.403412:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3117 00002000:00100000:1.0:1746065143.403418:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f99c00 x1830881273196416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.403424:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99c00 with x1830881273196416 ext(0->4095) 00010000:00010000:1.0:1746065143.403429:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.403437:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.403442:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f99c00 00000100:00100000:0.0:1746065143.413180:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.413915:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273196544 00000100:00100000:2.0:1746065143.413923:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273196544 00010000:00010000:2.0:1746065143.414005:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.414094:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14762 00000100:00100000:2.0:1746065143.414103:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5946c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+63:2003:x1830881273196544:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.414115:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.414131:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.414143:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.414162:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f88098c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e68fd expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.418517:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.418522:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.418539:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.418550:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.418765:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 62 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.418778:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267802880:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.423656:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.426941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.427038:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267802880:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.427054:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.427123:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5946c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2003:x1830881273196544:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 13020us (13949us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.427133:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14762 00000100:00100000:1.0:1746065143.427226:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273196800 00000100:00100000:1.0:1746065143.427232:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273196800 00002000:00100000:1.0:1746065143.427264:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f99f80 x1830881273196800/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.427273:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99f80 with x1830881273196800 ext(0->4095) 00002000:00010000:1.0:1746065143.427276:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f99f80 00000100:00100000:1.0:1746065143.427290:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13838 00000100:00100000:1.0:1746065143.427295:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881273196800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.427376:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2004:x1830881273196800:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 81us (443us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.427381:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13838 00002000:00100000:1.0:1746065143.427396:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f99f80 x1830881273196800/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.427403:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99f80 with x1830881273196800 ext(0->4095) 00002000:00010000:1.0:1746065143.427405:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f99f80 00000100:00100000:0.0:1746065143.431560:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.431754:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273196928 00000100:00100000:3.0:1746065143.431762:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273196928 00000100:00100000:3.0:1746065143.431804:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30791 00000100:00100000:3.0:1746065143.431809:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273196928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.431824:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.431837:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e690b expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.431863:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 61 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.431869:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.431871:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.431873:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.431903:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 61 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.431913:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 61 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.431923:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267803008:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.433718:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.446046:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267803008:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.446074:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.446111:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:2.0:1746065143.446152:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273196928:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 14341us (14598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.446160:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30791 00000100:00100000:0.0:1746065143.454499:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.456675:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273197056 00000100:00100000:2.0:1746065143.456686:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273197056 00002000:00100000:2.0:1746065143.456730:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072f9a300 x1830881273197056/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.456739:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9a300 with x1830881273197056 ext(0->7) 00010000:00010000:2.0:1746065143.456747:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 62 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.456761:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 62 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.456767:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f9a300 00000100:00100000:2.0:1746065143.456799:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3118 00000100:00100000:2.0:1746065143.456806:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+62:2005:x1830881273197056:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065143.460181:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881273197056:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 3366us (5678us total) trans 4294972149 rc 0/0 00000100:00100000:0.0:1746065143.460193:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3118 00002000:00100000:0.0:1746065143.460202:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072f9a300 x1830881273197056/t4294972149(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.460211:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9a300 with x1830881273197056 ext(0->7) 00010000:00010000:0.0:1746065143.460220:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 64 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.460235:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 64 pid: 9558 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.460241:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f9a300 00000100:00100000:0.0:1746065143.483718:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.485749:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.485856:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273197312 00000100:00100000:3.0:1746065143.485863:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273197312 00000100:00100000:3.0:1746065143.485913:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30792 00000100:00100000:3.0:1746065143.485920:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:1791:x1830881273197312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.485934:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.485949:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6912 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.485972:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.485977:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.485983:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065143.485986:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 65 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.486012:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.486022:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 65 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.486030:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065143.486065:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:1791:x1830881273197312:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 147us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.486070:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30792 00000100:00100000:2.0:1746065143.486420:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273197184 00000100:00100000:2.0:1746065143.486424:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273197184 00010000:00010000:2.0:1746065143.486440:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 65 pid: 9558 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.486466:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14763 00000100:00100000:2.0:1746065143.486471:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+65:2002:x1830881273197184:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.486478:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.486491:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 65 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.486499:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 65 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.486513:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880993 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6904 expref: 65 pid: 9558 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.486536:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.486538:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.486544:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.486549:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.486567:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.486577:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 5 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.486591:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267803264:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.486659:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.490263:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267803264:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.490280:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.490323:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2002:x1830881273197184:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3851us (6614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.490332:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14763 00000100:00100000:0.0:1746065143.490763:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.492804:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273197568 00000100:00100000:2.0:1746065143.492813:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273197568 00002000:00100000:2.0:1746065143.492851:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f9ad80 x1830881273197568/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.492860:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9ad80 with x1830881273197568 ext(0->4095) 00010000:00010000:2.0:1746065143.492867:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.492879:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.492884:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f9ad80 00000100:00100000:2.0:1746065143.493747:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3119 00000100:00100000:2.0:1746065143.493756:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273197568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.494833:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273197568:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 1075us (4066us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.494844:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3119 00002000:00100000:2.0:1746065143.494851:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f9ad80 x1830881273197568/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.494859:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9ad80 with x1830881273197568 ext(0->4095) 00010000:00010000:2.0:1746065143.494867:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.494879:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.494885:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f9ad80 00000100:00100000:1.0:1746065143.499495:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.499570:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273197696 00000100:00100000:2.0:1746065143.499578:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273197696 00010000:00010000:2.0:1746065143.499606:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.499639:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14764 00000100:00100000:2.0:1746065143.499646:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273197696:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.499657:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.499673:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.499683:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.499700:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f88099a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e690b expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.499716:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.499718:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.499724:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 63 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.499731:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 63 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.499755:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 63 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.499765:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267803392:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.499828:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.502580:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.502644:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273197952 00000100:00100000:3.0:1746065143.502650:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273197952 00002000:00100000:3.0:1746065143.502683:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f9b100 x1830881273197952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.502693:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b100 with x1830881273197952 ext(0->4095) 00002000:00010000:3.0:1746065143.502697:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f9b100 00000100:00100000:2.0:1746065143.503327:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267803392:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.503342:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.503713:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13839 00000100:00100000:3.0:1746065143.503722:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881273197952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.503934:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273197696:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4287us (4445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.503941:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14764 00000100:00100000:3.0:1746065143.504288:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2004:x1830881273197952:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 567us (1714us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.504294:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13839 00002000:00100000:3.0:1746065143.504300:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f9b100 x1830881273197952/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.504307:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b100 with x1830881273197952 ext(0->4095) 00002000:00010000:3.0:1746065143.504310:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f9b100 00000100:00100000:0.0:1746065143.510404:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.510470:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273198080 00000100:00100000:1.0:1746065143.510477:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273198080 00000100:00100000:1.0:1746065143.510523:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30793 00000100:00100000:1.0:1746065143.510530:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273198080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.510543:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.510556:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6919 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.510578:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 63 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.510583:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.510585:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.510588:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.510609:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 63 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.510619:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 63 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.510629:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267803520:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.511233:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.512531:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267803520:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.512549:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.512561:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc800, rc 0) 00000100:00100000:1.0:1746065143.512588:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273198080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2059us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.512596:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30793 00000100:00100000:0.0:1746065143.528734:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.530117:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273198208 00000100:00100000:3.0:1746065143.530127:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273198208 00002000:00100000:3.0:1746065143.530166:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072f9b800 x1830881273198208/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.530176:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b800 with x1830881273198208 ext(0->7) 00010000:00010000:3.0:1746065143.530183:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 64 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.530197:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 64 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.530203:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f9b800 00000100:00100000:3.0:1746065143.533095:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3120 00000100:00100000:3.0:1746065143.533111:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+64:2005:x1830881273198208:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065143.535795:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2005:x1830881273198208:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 2683us (7060us total) trans 4294972150 rc 0/0 00000100:00100000:0.0:1746065143.535805:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3120 00002000:00100000:0.0:1746065143.535813:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072f9b800 x1830881273198208/t4294972150(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.535822:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b800 with x1830881273198208 ext(0->7) 00010000:00010000:0.0:1746065143.535830:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 66 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.535844:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 66 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.535850:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f9b800 00000100:00100000:0.0:1746065143.547494:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.549210:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273198336 00000100:00100000:1.0:1746065143.549219:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273198336 00000100:00100000:1.0:1746065143.549271:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30794 00000100:00100000:1.0:1746065143.549279:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:1791:x1830881273198336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.549294:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.549308:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6920 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.549331:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.549336:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.549341:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065143.549345:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 67 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.549374:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.549384:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 67 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.549398:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd400, rc 0) 00000100:00100000:1.0:1746065143.549436:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:1791:x1830881273198336:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 158us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.549441:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30794 00000100:00100000:0.0:1746065143.552913:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.553044:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273198464 00000100:00100000:3.0:1746065143.553051:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273198464 00010000:00010000:3.0:1746065143.553106:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 67 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.553131:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14765 00000100:00100000:3.0:1746065143.553138:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+67:2005:x1830881273198464:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.553147:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.553162:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 67 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.553171:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 67 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.553191:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f8809a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6912 expref: 67 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.553206:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.553208:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.553214:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.553221:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.553246:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.553256:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 5 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.553265:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267803776:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.553324:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.561425:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.562430:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273198720 00000100:00100000:1.0:1746065143.562439:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273198720 00002000:00100000:1.0:1746065143.562474:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f99500 x1830881273198720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.562483:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99500 with x1830881273198720 ext(0->4095) 00010000:00010000:1.0:1746065143.562490:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.562504:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.562510:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f99500 00000100:00100000:1.0:1746065143.562526:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3121 00000100:00100000:1.0:1746065143.562531:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273198720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065143.562650:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273198720:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 117us (1233us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.562656:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3121 00002000:00100000:1.0:1746065143.562661:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f99500 x1830881273198720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.562673:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99500 with x1830881273198720 ext(0->4095) 00010000:00010000:1.0:1746065143.562677:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.562685:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.562690:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f99500 00000100:00100000:3.0:1746065143.562773:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267803776:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.562787:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.562808:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2005:x1830881273198464:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 9672us (9903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.562815:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14765 00000100:00100000:0.0:1746065143.568787:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.568866:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273198848 00000100:00100000:3.0:1746065143.568874:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273198848 00010000:00010000:3.0:1746065143.568913:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.568935:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14766 00000100:00100000:3.0:1746065143.568942:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273198848:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.568953:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.568969:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.568979:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.568995:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f8809a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6919 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.572175:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.572180:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.572191:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 65 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.572201:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 65 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.572242:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 65 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.572253:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267803904:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.572344:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.578311:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.578418:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273199104 00000100:00100000:2.0:1746065143.578425:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273199104 00002000:00100000:2.0:1746065143.578461:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98000 x1830881273199104/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.578471:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98000 with x1830881273199104 ext(0->4095) 00002000:00010000:2.0:1746065143.578476:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98000 00000100:00100000:2.0:1746065143.578506:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13840 00000100:00100000:2.0:1746065143.578513:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2005:x1830881273199104:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065143.578618:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2005:x1830881273199104:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 105us (314us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.578623:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13840 00002000:00100000:2.0:1746065143.578628:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98000 x1830881273199104/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.578635:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98000 with x1830881273199104 ext(0->4095) 00002000:00010000:2.0:1746065143.578637:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98000 00000100:00100000:3.0:1746065143.578761:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267803904:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.578774:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.578794:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273198848:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 9853us (10016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.578801:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14766 00000100:00100000:0.0:1746065143.587014:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.587113:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273199232 00000100:00100000:3.0:1746065143.587121:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273199232 00000100:00100000:3.0:1746065143.587171:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30795 00000100:00100000:3.0:1746065143.587179:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273199232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.587194:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.587209:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6927 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.587233:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 65 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.587239:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.587240:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.587244:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.587268:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 65 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.587279:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 65 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.587295:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267804032:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.588585:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.592373:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267804032:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.592398:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.592413:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065143.592448:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273199232:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5269us (5441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.592455:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30795 00000100:00100000:0.0:1746065143.600061:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.601414:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273199360 00000100:00100000:1.0:1746065143.601423:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273199360 00002000:00100000:1.0:1746065143.601458:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072f99880 x1830881273199360/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.601467:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99880 with x1830881273199360 ext(0->7) 00010000:00010000:1.0:1746065143.601475:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 66 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.601487:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 66 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.601493:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f99880 00000100:00100000:1.0:1746065143.601521:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3122 00000100:00100000:1.0:1746065143.601527:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+66:2003:x1830881273199360:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065143.602290:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2003:x1830881273199360:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 761us (2236us total) trans 4294972151 rc 0/0 00000100:00100000:0.0:1746065143.602297:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3122 00002000:00100000:0.0:1746065143.602303:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072f99880 x1830881273199360/t4294972151(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.602310:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99880 with x1830881273199360 ext(0->7) 00010000:00010000:0.0:1746065143.602315:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 68 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.602324:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 68 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.602330:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f99880 00000100:00100000:0.0:1746065143.613686:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.615097:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.615209:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273199616 00000100:00100000:2.0:1746065143.615217:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273199616 00010000:00010000:2.0:1746065143.615246:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 68 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.615269:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14767 00000100:00100000:2.0:1746065143.615275:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2003:x1830881273199616:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.615286:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.615301:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 68 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.615311:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 68 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.615329:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f8809af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6920 expref: 68 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.615354:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.615356:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.615363:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.615370:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.615396:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.615406:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267804160:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.615468:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.615774:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273199488 00000100:00100000:3.0:1746065143.615778:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273199488 00000100:00100000:3.0:1746065143.615807:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30796 00000100:00100000:3.0:1746065143.615811:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:1791:x1830881273199488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.615822:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.615830:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e692e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.615843:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.615848:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.615849:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.615851:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 69 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.615869:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.615877:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 5 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.615884:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267804288:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.615917:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.617861:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.618506:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267804288:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.618524:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 69 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.618535:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065143.618563:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:1791:x1830881273199488:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2751us (4886us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.618570:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30796 00000100:00100000:2.0:1746065143.618812:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267804160:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.618820:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.618836:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2003:x1830881273199616:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3562us (3742us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.618842:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14767 00000100:00100000:1.0:1746065143.619010:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273199872 00000100:00100000:1.0:1746065143.619015:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273199872 00002000:00100000:1.0:1746065143.619040:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4ebb80 x1830881273199872/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.619049:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ebb80 with x1830881273199872 ext(0->4095) 00010000:00010000:1.0:1746065143.619054:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.619063:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.619068:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4ebb80 00000100:00100000:1.0:1746065143.619097:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3123 00000100:00100000:1.0:1746065143.619102:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273199872:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.619188:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273199872:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 86us (1331us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.619193:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3123 00002000:00100000:1.0:1746065143.619197:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f4ebb80 x1830881273199872/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.619203:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ebb80 with x1830881273199872 ext(0->4095) 00010000:00010000:1.0:1746065143.619206:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.619214:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.619219:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4ebb80 00000100:00100000:2.0:1746065143.624078:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.624278:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273200000 00000100:00100000:3.0:1746065143.624285:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273200000 00010000:00010000:3.0:1746065143.624313:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.624340:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14768 00000100:00100000:3.0:1746065143.624346:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273200000:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.624356:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.624370:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.624380:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.624398:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f8809b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6927 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.624417:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.624419:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.624424:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 67 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.624431:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 67 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.624454:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 67 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.624463:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267804416:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.624516:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.628237:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.628385:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267804416:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065143.628401:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.628475:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273200256 00000100:00100000:2.0:1746065143.628481:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273200256 00002000:00100000:2.0:1746065143.628653:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549c00 x1830881273200256/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.628663:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549c00 with x1830881273200256 ext(0->4095) 00002000:00010000:2.0:1746065143.628667:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d549c00 00000100:00100000:2.0:1746065143.628694:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13841 00000100:00100000:2.0:1746065143.628701:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2005:x1830881273200256:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065143.628840:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273200000:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4493us (4768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.628848:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14768 00000100:00100000:2.0:1746065143.630117:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+68:2005:x1830881273200256:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 1413us (1885us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.630124:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13841 00002000:00100000:2.0:1746065143.630130:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d549c00 x1830881273200256/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.630139:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549c00 with x1830881273200256 ext(0->4095) 00002000:00010000:2.0:1746065143.630142:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d549c00 00000100:00100000:0.0:1746065143.637613:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.637677:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273200384 00000100:00100000:3.0:1746065143.637685:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273200384 00000100:00100000:3.0:1746065143.637728:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30797 00000100:00100000:3.0:1746065143.637735:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273200384:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.637748:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.637762:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6935 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.637787:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 67 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.637793:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.637795:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.637798:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.637821:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 67 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.637831:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 67 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.637840:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267804544:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.637910:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.647254:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267804544:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.647280:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.647294:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065143.647340:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273200384:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 9605us (9733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.647347:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30797 00000100:00100000:0.0:1746065143.654182:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.654553:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.654719:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273200512 00000100:00100000:3.0:1746065143.654728:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273200512 00000100:00100000:2.0:1746065143.655026:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273200640 00000100:00100000:2.0:1746065143.655030:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273200640 00002000:00100000:2.0:1746065143.655054:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880093859f80 x1830881273200640/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.655063:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859f80 with x1830881273200640 ext(0->7) 00010000:00010000:2.0:1746065143.655069:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 69 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.655096:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 69 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.655102:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859f80 00000100:00100000:2.0:1746065143.655114:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3124 00000100:00100000:2.0:1746065143.655120:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:2005:x1830881273200640:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746065143.655268:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30798 00000100:00100000:3.0:1746065143.655274:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+69:1791:x1830881273200512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.655280:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.655291:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e693c expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.655306:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.655310:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.655314:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065143.655317:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 70 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.655342:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.655351:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 70 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.655360:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:3.0:1746065143.655392:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:1791:x1830881273200512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 118us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.655397:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30798 00000100:00100000:0.0:1746065143.656974:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:2005:x1830881273200640:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1849us (2416us total) trans 4294972152 rc 0/0 00000100:00100000:0.0:1746065143.656983:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3124 00002000:00100000:0.0:1746065143.656990:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880093859f80 x1830881273200640/t4294972152(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.656999:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859f80 with x1830881273200640 ext(0->7) 00010000:00010000:0.0:1746065143.657005:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 71 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.657017:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 71 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.657023:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859f80 00000100:00100000:0.0:1746065143.658908:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.659005:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273200768 00000100:00100000:2.0:1746065143.659012:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273200768 00010000:00010000:2.0:1746065143.659036:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 71 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.659069:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14769 00000100:00100000:2.0:1746065143.659074:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5946850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:2002:x1830881273200768:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.659103:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.659117:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 71 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.659126:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 71 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.659143:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f8809bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e692e expref: 71 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.659167:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.659169:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.659175:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.659181:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.659205:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.659214:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 5 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.659228:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267804800:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.659291:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.661388:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.661589:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267804800:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.661602:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.661629:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5946850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:2002:x1830881273200768:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2555us (2738us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.661637:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14769 00000100:00100000:1.0:1746065143.662049:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273201024 00000100:00100000:1.0:1746065143.662055:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273201024 00002000:00100000:1.0:1746065143.662113:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859c00 x1830881273201024/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.662122:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859c00 with x1830881273201024 ext(0->4095) 00010000:00010000:1.0:1746065143.662129:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.662140:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.662146:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859c00 00000100:00100000:1.0:1746065143.662161:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3125 00000100:00100000:1.0:1746065143.662167:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273201024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.662254:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273201024:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 87us (871us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.662259:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3125 00002000:00100000:1.0:1746065143.662263:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093859c00 x1830881273201024/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.662270:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093859c00 with x1830881273201024 ext(0->4095) 00010000:00010000:1.0:1746065143.662274:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.662282:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.662288:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093859c00 00000100:00100000:0.0:1746065143.664611:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.664673:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273201152 00000100:00100000:2.0:1746065143.664679:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273201152 00010000:00010000:2.0:1746065143.664700:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.664719:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14770 00000100:00100000:2.0:1746065143.664724:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273201152:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.664734:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.664747:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.664757:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.664773:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f8809c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6935 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.664784:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.664786:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.664792:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 69 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.664799:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 69 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.664820:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 69 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.664830:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267804928:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.664900:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.666785:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.667290:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267804928:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.667305:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.667338:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273201152:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2613us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.667347:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14770 00000100:00100000:1.0:1746065143.667593:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273201408 00000100:00100000:1.0:1746065143.667598:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273201408 00002000:00100000:1.0:1746065143.667623:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858380 x1830881273201408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.667632:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858380 with x1830881273201408 ext(0->4095) 00002000:00010000:1.0:1746065143.667635:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093858380 00000100:00100000:1.0:1746065143.667656:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13842 00000100:00100000:1.0:1746065143.667661:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:2003:x1830881273201408:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065143.667741:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:2003:x1830881273201408:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 81us (961us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.667746:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13842 00002000:00100000:1.0:1746065143.667750:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880093858380 x1830881273201408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.667756:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093858380 with x1830881273201408 ext(0->4095) 00002000:00010000:1.0:1746065143.667758:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093858380 00000100:00100000:0.0:1746065143.681380:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.681472:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273201536 00000100:00100000:1.0:1746065143.681481:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273201536 00000100:00100000:1.0:1746065143.681609:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30799 00000100:00100000:1.0:1746065143.681617:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273201536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.681631:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.681645:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6943 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.681669:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 69 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.681680:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.681681:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.681684:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.681707:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 69 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.681718:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 69 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.681728:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267805056:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.681801:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.683586:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267805056:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.683607:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.683619:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd000, rc 0) 00000100:00100000:1.0:1746065143.683661:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273201536:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2045us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.683670:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30799 00000100:00100000:0.0:1746065143.698947:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.698997:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273201664 00000100:00100000:2.0:1746065143.699004:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273201664 00002000:00100000:2.0:1746065143.699039:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009385a680 x1830881273201664/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.699048:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385a680 with x1830881273201664 ext(0->7) 00010000:00010000:2.0:1746065143.699055:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 70 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.699068:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 70 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.699095:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385a680 00000100:00100000:2.0:1746065143.699123:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3126 00000100:00100000:2.0:1746065143.699130:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+70:2002:x1830881273201664:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065143.699771:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2002:x1830881273201664:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 640us (829us total) trans 4294972153 rc 0/0 00000100:00100000:0.0:1746065143.699778:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3126 00002000:00100000:0.0:1746065143.699783:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009385a680 x1830881273201664/t4294972153(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.699789:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009385a680 with x1830881273201664 ext(0->7) 00010000:00010000:0.0:1746065143.699794:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.699804:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.699809:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009385a680 00000100:00100000:0.0:1746065143.707567:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.707629:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273201792 00000100:00100000:1.0:1746065143.707637:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273201792 00000100:00100000:1.0:1746065143.707675:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30800 00000100:00100000:1.0:1746065143.707681:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1791:x1830881273201792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.707695:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.707707:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e694a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.707729:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.707735:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.707740:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065143.707744:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.707774:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.707785:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.707794:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfda00, rc 0) 00000100:00100000:1.0:1746065143.707843:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1791:x1830881273201792:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 161us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.707848:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30800 00000100:00100000:0.0:1746065143.710113:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.710201:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273201920 00000100:00100000:2.0:1746065143.710208:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273201920 00010000:00010000:2.0:1746065143.710233:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.710252:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14771 00000100:00100000:2.0:1746065143.710258:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2002:x1830881273201920:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.710267:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.710282:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.710291:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.710307:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8809cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e693c expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.710330:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.710331:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.710338:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.710347:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.710371:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.710385:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 5 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.710395:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267805312:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.710453:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.711767:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267805312:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065143.711780:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.711813:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2002:x1830881273201920:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1552us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.711820:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14771 00000100:00100000:0.0:1746065143.712376:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.712438:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273202176 00000100:00100000:2.0:1746065143.712443:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273202176 00002000:00100000:2.0:1746065143.712471:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88b100 x1830881273202176/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.712480:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88b100 with x1830881273202176 ext(0->4095) 00010000:00010000:2.0:1746065143.712487:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.712498:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.712503:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e88b100 00000100:00100000:2.0:1746065143.712804:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3127 00000100:00100000:2.0:1746065143.712811:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273202176:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.712932:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273202176:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 120us (556us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.712937:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3127 00002000:00100000:2.0:1746065143.712942:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009e88b100 x1830881273202176/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.712949:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e88b100 with x1830881273202176 ext(0->4095) 00010000:00010000:2.0:1746065143.712953:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.712960:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.712966:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e88b100 00000100:00100000:0.0:1746065143.714141:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.714238:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273202304 00000100:00100000:2.0:1746065143.714243:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273202304 00010000:00010000:2.0:1746065143.714262:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.714289:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14772 00000100:00100000:2.0:1746065143.714294:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273202304:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.714302:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.714314:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.714327:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.714344:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f8809d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6943 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.714364:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.714366:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.714371:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.714421:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.714446:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.714456:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267805440:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.714518:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.716450:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267805440:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.716464:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.716491:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273202304:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2196us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.716499:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14772 00000100:00100000:0.0:1746065143.717105:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.717246:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273202560 00000100:00100000:3.0:1746065143.717251:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273202560 00002000:00100000:3.0:1746065143.717280:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0000 x1830881273202560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.717295:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0000 with x1830881273202560 ext(0->4095) 00002000:00010000:3.0:1746065143.717298:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b0000 00000100:00100000:3.0:1746065143.717576:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13843 00000100:00100000:3.0:1746065143.717584:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2005:x1830881273202560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065143.717687:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800729b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2005:x1830881273202560:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 104us (582us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.717692:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13843 00002000:00100000:3.0:1746065143.717697:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800729b0000 x1830881273202560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.717703:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800729b0000 with x1830881273202560 ext(0->4095) 00002000:00010000:3.0:1746065143.717706:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800729b0000 00000100:00100000:0.0:1746065143.718890:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.719123:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273202688 00000100:00100000:1.0:1746065143.719128:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273202688 00000100:00100000:1.0:1746065143.719166:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30801 00000100:00100000:1.0:1746065143.719172:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273202688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.719181:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.719194:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6951 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.719214:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.719220:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.719221:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.719225:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.719247:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.719257:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 71 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.719265:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267805568:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.719321:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.720567:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267805568:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.720584:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.720845:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.720884:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273202816 00000100:00100000:2.0:1746065143.720888:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273202816 00010000:00010000:1.0:1746065143.720890:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00010000:00010000:2.0:1746065143.720914:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.720925:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273202688:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1753us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.720930:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30801 00000100:00100000:2.0:1746065143.720935:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14773 00000100:00100000:2.0:1746065143.720939:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273202816:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.720947:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.720960:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.720969:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.720984:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfda00/0x392ae0376f8809d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e694a expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.721217:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.721219:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.721225:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.721232:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.721253:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.721261:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267805696:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.721720:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.723282:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267805696:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.723292:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.723425:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:2004:x1830881273202816:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2483us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.723433:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14773 00000100:00100000:0.0:1746065143.723969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.724036:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273203072 00000100:00100000:3.0:1746065143.724041:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273203072 00002000:00100000:3.0:1746065143.724073:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d653800 x1830881273203072/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.724108:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d653800 with x1830881273203072 ext(0->4095) 00002000:00010000:3.0:1746065143.724112:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d653800 00000100:00100000:3.0:1746065143.724133:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13844 00000100:00100000:3.0:1746065143.724139:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273203072:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065143.724243:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273203072:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 103us (274us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.724248:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13844 00002000:00100000:3.0:1746065143.724254:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d653800 x1830881273203072/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.724261:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d653800 with x1830881273203072 ext(0->4095) 00002000:00010000:3.0:1746065143.724263:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d653800 00000100:00100000:0.0:1746065143.725726:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.725969:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273203200 00000100:00100000:1.0:1746065143.725975:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273203200 00000100:00100000:1.0:1746065143.726018:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30802 00000100:00100000:1.0:1746065143.726024:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:1795:x1830881273203200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.726035:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.726048:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6958 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.726437:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.726444:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.726445:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.726449:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.726474:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.726484:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 5 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.726494:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267805824:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.726545:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.726817:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.726849:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273203328 00000100:00100000:3.0:1746065143.726852:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273203328 00000100:00100000:3.0:1746065143.726866:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30803 00000100:00100000:3.0:1746065143.726869:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1791:x1830881273203328:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.726874:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.726879:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e695f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.726888:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.726904:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 74 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.726910:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.726913:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.726936:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 74 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.726945:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.726953:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065143.726984:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:1791:x1830881273203328:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 113us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.726990:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30803 00000100:00100000:0.0:1746065143.727584:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.727664:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267805824:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.727677:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.727685:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfcc00, rc 0) 00000100:00100000:1.0:1746065143.727718:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1795:x1830881273203200:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1694us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.727723:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30802 00000100:00100000:2.0:1746065143.727739:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273203456 00000100:00100000:2.0:1746065143.727743:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273203456 00010000:00010000:2.0:1746065143.727759:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.727786:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14774 00000100:00100000:2.0:1746065143.727792:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273203456:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.727800:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.727818:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.727826:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.727844:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd600/0x392ae0376f8809e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6951 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.727858:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.727859:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.727864:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.727875:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.727906:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.727915:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.727923:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267806080:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.728160:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.729386:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267806080:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.729396:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.729431:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273203456:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1639us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.729438:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14774 00000100:00100000:0.0:1746065143.729921:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.729964:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273203712 00000100:00100000:1.0:1746065143.729969:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273203712 00002000:00100000:1.0:1746065143.729997:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b480 x1830881273203712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.730006:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b480 with x1830881273203712 ext(0->4095) 00010000:00010000:1.0:1746065143.730011:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 73 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.730022:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 73 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.730027:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f93b480 00000100:00100000:1.0:1746065143.730049:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3128 00000100:00100000:1.0:1746065143.730055:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2005:x1830881273203712:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065143.730244:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2005:x1830881273203712:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 188us (322us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.730249:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3128 00002000:00100000:1.0:1746065143.730254:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f93b480 x1830881273203712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.730262:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b480 with x1830881273203712 ext(0->4095) 00010000:00010000:1.0:1746065143.730266:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 73 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.730279:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 73 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.730284:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f93b480 00000100:00100000:0.0:1746065143.731533:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.731576:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.731648:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273203840 00000100:00100000:1.0:1746065143.731656:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273203840 00000100:00100000:1.0:1746065143.731691:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30804 00000100:00100000:1.0:1746065143.731697:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273203840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:2.0:1746065143.731702:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273203968 00000100:00100000:2.0:1746065143.731705:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273203968 00010000:00010000:1.0:1746065143.731707:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.731718:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 73 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.731719:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6966 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.731736:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.731740:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.731745:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14775 00010000:00010000:1.0:1746065143.731746:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:2.0:1746065143.731749:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2002:x1830881273203968:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.731749:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.731756:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.731767:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 73 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.731775:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 73 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.731775:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.731789:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfcc00/0x392ae0376f8809e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6958 expref: 73 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.731979:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.731988:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.731990:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.731994:0:9635:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.732000:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.732017:0:9635:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.732027:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.732036:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267806336:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065143.732195:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065143.732245:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.732340:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2002:x1830881273203968:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 589us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.732347:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14775 00000100:00100000:1.0:1746065143.733416:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267806336:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065143.733427:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:1.0:1746065143.733448:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273203840:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1752us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.733454:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30804 00000100:00100000:0.0:1746065143.734156:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.734216:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273204224 00000100:00100000:1.0:1746065143.734221:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273204224 00002000:00100000:1.0:1746065143.734244:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3a680 x1830881273204224/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.734250:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3a680 with x1830881273204224 ext(0->4095) 00010000:00010000:1.0:1746065143.734255:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.734267:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.734271:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc3a680 00000100:00100000:1.0:1746065143.734290:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3129 00000100:00100000:1.0:1746065143.734295:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273204224:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.734395:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273204224:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (239us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.734400:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3129 00002000:00100000:1.0:1746065143.734405:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc3a680 x1830881273204224/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.734412:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc3a680 with x1830881273204224 ext(0->4095) 00010000:00010000:1.0:1746065143.734415:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.734423:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.734427:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc3a680 00000100:00100000:2.0:1746065143.735409:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.735656:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273204352 00000100:00100000:1.0:1746065143.735660:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273204352 00000100:00100000:1.0:1746065143.735732:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30805 00000100:00100000:1.0:1746065143.735738:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1791:x1830881273204352:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.735747:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.735758:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e696d expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.735775:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.735780:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.735785:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065143.735788:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.735813:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.735823:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 73 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.735830:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc600, rc 0) 00000100:00100000:1.0:1746065143.735858:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1791:x1830881273204352:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 121us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.735863:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30805 00000100:00100000:0.0:1746065143.736106:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.736148:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273204480 00000100:00100000:3.0:1746065143.736151:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273204480 00010000:00010000:3.0:1746065143.736168:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.736304:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14776 00000100:00100000:3.0:1746065143.736312:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5946450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2003:x1830881273204480:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.736319:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.736331:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.736340:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.736354:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8809ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e695f expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.736377:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.736379:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.736384:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.736390:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.736409:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.736418:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 5 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.736427:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267806592:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.736480:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d734240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.737912:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267806592:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.737928:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.738099:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5946450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2003:x1830881273204480:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1768us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.738106:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14776 00000100:00100000:0.0:1746065143.738614:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.738658:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273204736 00000100:00100000:1.0:1746065143.738664:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273204736 00002000:00100000:1.0:1746065143.738699:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc39880 x1830881273204736/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.738707:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39880 with x1830881273204736 ext(0->4095) 00010000:00010000:1.0:1746065143.738713:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.738730:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.738735:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc39880 00000100:00100000:1.0:1746065143.738757:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3130 00000100:00100000:1.0:1746065143.738763:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273204736:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065143.738847:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273204736:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 84us (234us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.738852:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3130 00002000:00100000:1.0:1746065143.738857:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc39880 x1830881273204736/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.738864:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc39880 with x1830881273204736 ext(0->4095) 00010000:00010000:1.0:1746065143.738868:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.738876:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.738881:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009dc39880 00000100:00100000:0.0:1746065143.740586:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.740657:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273204864 00000100:00100000:3.0:1746065143.740664:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273204864 00010000:00010000:3.0:1746065143.740684:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.740714:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14777 00000100:00100000:3.0:1746065143.740721:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2003:x1830881273204864:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.740731:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.740744:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.740753:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.740770:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc000/0x392ae0376f8809f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6966 expref: 6 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.740785:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.740787:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.740792:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.740799:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.740823:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.740833:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267806720:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.741225:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b63589c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.742671:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267806720:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.742685:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.742707:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.742720:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2003:x1830881273204864:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1999us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.742728:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14777 00000100:00100000:2.0:1746065143.742828:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273205120 00000100:00100000:2.0:1746065143.742833:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273205120 00002000:00100000:2.0:1746065143.742862:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e1180 x1830881273205120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.742870:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1180 with x1830881273205120 ext(0->4095) 00002000:00010000:2.0:1746065143.742874:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1180 00000100:00100000:2.0:1746065143.742917:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13845 00000100:00100000:2.0:1746065143.742923:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273205120:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.743019:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273205120:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 96us (311us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.743032:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13845 00002000:00100000:2.0:1746065143.743037:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d1e1180 x1830881273205120/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.743044:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1180 with x1830881273205120 ext(0->4095) 00002000:00010000:2.0:1746065143.743047:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1180 00000100:00100000:0.0:1746065143.745426:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.745476:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273205248 00000100:00100000:3.0:1746065143.745482:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273205248 00000100:00100000:3.0:1746065143.745519:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30806 00000100:00100000:3.0:1746065143.745525:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273205248:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.745536:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.745549:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6974 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.745577:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.745583:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.745585:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.745588:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.745610:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 71 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.745621:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 71 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.745631:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267806848:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.745708:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b63589c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.746730:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267806848:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.746748:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.746758:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065143.746795:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273205248:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1270us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.746804:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30806 00000100:00100000:0.0:1746065143.747528:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.747667:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273205376 00000100:00100000:3.0:1746065143.747672:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273205376 00010000:00010000:3.0:1746065143.747689:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.747713:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14778 00000100:00100000:3.0:1746065143.747719:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273205376:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.747728:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.747741:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.747751:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.747769:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc600/0x392ae0376f8809fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e696d expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.747785:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.747786:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.747792:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.747799:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.747824:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.747832:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267806976:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.747878:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b63589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.750259:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.750416:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267806976:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.750430:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.750458:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:2004:x1830881273205376:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2739us (2931us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.750467:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14778 00000100:00100000:1.0:1746065143.750624:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273205632 00000100:00100000:1.0:1746065143.750629:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273205632 00002000:00100000:1.0:1746065143.750656:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ca80 x1830881273205632/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.750664:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ca80 with x1830881273205632 ext(0->4095) 00002000:00010000:1.0:1746065143.750668:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ca80 00000100:00100000:1.0:1746065143.750688:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13846 00000100:00100000:1.0:1746065143.750692:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273205632:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065143.750769:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273205632:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 76us (515us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.750773:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13846 00002000:00100000:1.0:1746065143.750777:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ca80 x1830881273205632/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.750783:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ca80 with x1830881273205632 ext(0->4095) 00002000:00010000:1.0:1746065143.750785:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ca80 00000100:00100000:0.0:1746065143.753999:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.754275:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.754340:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273205760 00000100:00100000:1.0:1746065143.754346:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273205760 00000100:00100000:1.0:1746065143.755367:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273205888 00000100:00100000:1.0:1746065143.755372:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273205888 00000100:00100000:3.0:1746065143.757472:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30807 00000100:00100000:3.0:1746065143.757486:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1795:x1830881273205760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.757502:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.757518:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e697b expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065143.757589:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30808 00000100:00100000:1.0:1746065143.757597:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1791:x1830881273205888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.757605:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.757611:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6982 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.757622:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.757629:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.757630:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.757633:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.757687:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.757692:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.757697:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.757700:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 74 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.757744:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.757756:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 74 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.757764:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc800, rc 0) 00010000:00010000:3.0:1746065143.757783:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.757795:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 5 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.757805:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267807232:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.757815:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:1791:x1830881273205888:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 219us (3540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.757821:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30808 00000100:00100000:3.0:1746065143.757909:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b63589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.767411:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.767623:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267807232:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.767647:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.767663:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:3.0:1746065143.767698:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1795:x1830881273205760:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 10218us (13705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.767705:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30807 00000100:00100000:2.0:1746065143.767780:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273206016 00000100:00100000:2.0:1746065143.767786:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273206016 00010000:00010000:2.0:1746065143.767808:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.767835:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14779 00000100:00100000:2.0:1746065143.767841:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273206016:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.767853:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.767868:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.767877:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.767905:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x392ae0376f880a03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6974 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.767924:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.767926:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.767931:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.767938:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.767965:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.768052:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.768061:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267807360:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.768900:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.771183:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267807360:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.771198:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.771265:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273206016:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3422us (3860us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.771274:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14779 00000100:00100000:0.0:1746065143.771972:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.772378:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273206272 00000100:00100000:2.0:1746065143.772384:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273206272 00002000:00100000:2.0:1746065143.772415:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c3b80 x1830881273206272/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.772424:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3b80 with x1830881273206272 ext(0->4095) 00010000:00010000:2.0:1746065143.772431:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.772443:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.772450:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c3b80 00000100:00100000:2.0:1746065143.772621:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3131 00000100:00100000:2.0:1746065143.772627:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2003:x1830881273206272:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746065143.778513:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2003:x1830881273206272:12345-192.168.202.8@tcp:3:ptlrpcd_00_00.0 Request processed in 5875us (6532us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.778526:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3131 00002000:00100000:2.0:1746065143.778538:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c3b80 x1830881273206272/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.778547:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3b80 with x1830881273206272 ext(0->4095) 00010000:00010000:2.0:1746065143.778556:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.778570:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.778577:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7c3b80 00000100:00100000:0.0:1746065143.781922:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.781968:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.782033:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273206528 00000100:00100000:2.0:1746065143.782041:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273206528 00010000:00010000:2.0:1746065143.782073:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.782122:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14780 00000100:00100000:2.0:1746065143.782128:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2002:x1830881273206528:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.782140:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.782158:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.782174:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.782195:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x392ae0376f880a0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e697b expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.782218:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.782220:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.782225:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.782232:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.782259:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.782272:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267807488:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.782344:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.782592:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273206400 00000100:00100000:3.0:1746065143.782598:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273206400 00000100:00100000:3.0:1746065143.782885:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30809 00000100:00100000:3.0:1746065143.782902:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273206400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.782914:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.782923:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6989 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.782937:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.782942:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.782943:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.782945:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.782959:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.782972:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.782980:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267807616:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.784545:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267807488:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.784560:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.784584:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2002:x1830881273206528:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2456us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.784593:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14780 00000100:00100000:3.0:1746065143.784708:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b63589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.788195:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.788471:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273206784 00000100:00100000:2.0:1746065143.788478:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273206784 00002000:00100000:2.0:1746065143.788515:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789880 x1830881273206784/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.788525:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789880 with x1830881273206784 ext(0->4095) 00010000:00010000:2.0:1746065143.788533:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.788544:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.788550:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b789880 00000100:00100000:2.0:1746065143.788576:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3132 00000100:00100000:2.0:1746065143.788582:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273206784:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.788690:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273206784:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 108us (501us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.788696:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3132 00002000:00100000:2.0:1746065143.788702:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b789880 x1830881273206784/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.788708:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789880 with x1830881273206784 ext(0->4095) 00010000:00010000:2.0:1746065143.788712:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.788720:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 72 pid: 9635 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.788725:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b789880 00000100:00100000:3.0:1746065143.788847:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267807616:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.788865:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.788876:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065143.788922:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273206400:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6029us (7010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.788928:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30809 00000100:00100000:0.0:1746065143.791860:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.791932:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273206912 00000100:00100000:3.0:1746065143.791940:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273206912 00000100:00100000:3.0:1746065143.792014:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30810 00000100:00100000:3.0:1746065143.792021:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1791:x1830881273206912:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.792035:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.792048:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6990 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.792069:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.792112:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.792123:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065143.792125:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.792155:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.792165:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.792172:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:0.0:1746065143.792363:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.792414:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273207040 00000100:00100000:2.0:1746065143.792418:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273207040 00010000:00010000:2.0:1746065143.792433:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 74 pid: 9635 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.792810:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14781 00000100:00100000:2.0:1746065143.792816:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2003:x1830881273207040:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.792825:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.792840:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 74 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.792849:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 74 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.792864:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6982 expref: 74 pid: 9635 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.793213:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.793215:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.793221:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.793228:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.793249:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.793262:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 5 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.793272:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267807872:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.794118:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.794810:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1791:x1830881273206912:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 185us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.794820:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30810 00000100:00100000:2.0:1746065143.798799:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267807872:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.798827:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.798916:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2003:x1830881273207040:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6097us (6551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.798927:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14781 00000100:00100000:0.0:1746065143.798943:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.799110:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273207296 00000100:00100000:0.0:1746065143.799116:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273207296 00002000:00100000:0.0:1746065143.799145:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78b480 x1830881273207296/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.799155:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b480 with x1830881273207296 ext(0->4095) 00010000:00010000:0.0:1746065143.799162:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.799173:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.799179:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78b480 00000100:00100000:0.0:1746065143.799192:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3133 00000100:00100000:0.0:1746065143.799197:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273207296:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746065143.799298:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273207296:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 101us (356us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065143.799304:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3133 00002000:00100000:0.0:1746065143.799308:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78b480 x1830881273207296/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.799314:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b480 with x1830881273207296 ext(0->4095) 00010000:00010000:0.0:1746065143.799318:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065143.799326:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065143.799330:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78b480 00000100:00100000:0.0:1746065143.803155:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.803333:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273207424 00000100:00100000:2.0:1746065143.803341:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273207424 00010000:00010000:2.0:1746065143.803370:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.803394:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14782 00000100:00100000:2.0:1746065143.803400:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273207424:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.803414:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.803431:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.803441:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.803459:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a18 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6989 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.803831:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.803834:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.803841:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 71 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.803849:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 71 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.803876:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 71 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.803887:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267808000:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.803973:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.805691:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267808000:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.805707:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.805736:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273207424:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2335us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.805745:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14782 00000100:00100000:0.0:1746065143.806586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.806919:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273207680 00000100:00100000:2.0:1746065143.806925:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273207680 00002000:00100000:2.0:1746065143.806955:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788e00 x1830881273207680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.806964:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788e00 with x1830881273207680 ext(0->4095) 00002000:00010000:2.0:1746065143.806968:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788e00 00000100:00100000:2.0:1746065143.806984:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13847 00000100:00100000:2.0:1746065143.806990:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2005:x1830881273207680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065143.807122:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2005:x1830881273207680:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 132us (537us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.807128:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13847 00002000:00100000:2.0:1746065143.807133:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788e00 x1830881273207680/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.807140:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788e00 with x1830881273207680 ext(0->4095) 00002000:00010000:2.0:1746065143.807142:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788e00 00000100:00100000:0.0:1746065143.809722:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.809805:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273207808 00000100:00100000:3.0:1746065143.809812:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273207808 00000100:00100000:3.0:1746065143.809900:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30811 00000100:00100000:3.0:1746065143.809907:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273207808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.809920:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.809933:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6997 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.809957:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 71 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.809963:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.809965:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.809968:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.809994:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 71 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.810005:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 71 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.810015:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267808128:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.810738:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b63589c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.812469:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267808128:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.812490:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.812504:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746065143.812536:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273207808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2629us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.812543:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30811 00000100:00100000:0.0:1746065143.814172:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.814222:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273207936 00000100:00100000:2.0:1746065143.814229:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273207936 00010000:00010000:2.0:1746065143.814360:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.814392:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14783 00000100:00100000:2.0:1746065143.814398:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5946050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273207936:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.814409:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.814423:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.814433:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.814457:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f880a1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6990 expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.814600:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.814603:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.814610:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.814617:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.814642:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.814653:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267808256:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.814715:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.815825:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267808256:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.815838:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.815861:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5946050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:2004:x1830881273207936:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1463us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.815869:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14783 00000100:00100000:0.0:1746065143.816921:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.817022:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.817170:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273208320 00000100:00100000:2.0:1746065143.817170:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273208192 00000100:00100000:3.0:1746065143.817177:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273208320 00000100:00100000:2.0:1746065143.817177:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273208192 00000100:00100000:3.0:1746065143.817216:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30812 00000100:00100000:3.0:1746065143.817222:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:1791:x1830881273208320:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.817233:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.817248:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e699e expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.817273:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.817279:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.817281:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.817284:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.817306:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.817316:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00100000:2.0:1746065143.817317:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788000 x1830881273208192/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.817325:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788000 with x1830881273208192 ext(0->4095) 00000100:00100000:3.0:1746065143.817326:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267808384:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.817330:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.817338:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.817346:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b788000 00000100:00100000:2.0:1746065143.817359:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3134 00000100:00100000:2.0:1746065143.817364:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273208192:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065143.817380:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b63589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.817549:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273208192:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 184us (631us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.817555:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3134 00002000:00100000:2.0:1746065143.817656:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b788000 x1830881273208192/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.817665:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788000 with x1830881273208192 ext(0->4095) 00010000:00010000:2.0:1746065143.817670:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.817677:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065143.817682:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b788000 00000100:00100000:3.0:1746065143.818713:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267808384:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.818732:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.818744:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065143.818780:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1791:x1830881273208320:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1559us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.818787:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30812 00000100:00100000:0.0:1746065143.819840:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.819962:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.820006:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273208448 00000100:00100000:3.0:1746065143.820013:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273208448 00000100:00100000:2.0:1746065143.820104:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273208576 00000100:00100000:2.0:1746065143.820109:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273208576 00010000:00010000:2.0:1746065143.820129:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.820152:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14784 00000100:00100000:2.0:1746065143.820159:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273208576:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.820168:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065143.820174:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30813 00000100:00100000:3.0:1746065143.820180:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1795:x1830881273208448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.820186:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.820190:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.820200:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69a5 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.820201:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.820218:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x392ae0376f880a26 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6997 expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.820326:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.820333:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.820339:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.820341:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.820349:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.820351:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.820357:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.820363:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.820386:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.820396:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.820405:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.820406:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267808512:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.820413:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.820429:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267808640:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.820501:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b63589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.820509:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.822239:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267808512:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.822262:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.822275:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065143.822307:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1795:x1830881273208448:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2127us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.822314:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30813 00000100:00100000:0.0:1746065143.822494:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.822565:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267808640:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.822574:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.822595:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273208576:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2438us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.822603:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14784 00000100:00100000:3.0:1746065143.822805:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273208832 00000100:00100000:3.0:1746065143.822810:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273208832 00002000:00100000:3.0:1746065143.822837:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78b100 x1830881273208832/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.822845:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b100 with x1830881273208832 ext(0->4095) 00010000:00010000:3.0:1746065143.822850:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.822861:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.822872:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78b100 00000100:00100000:3.0:1746065143.822905:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3135 00000100:00100000:3.0:1746065143.822911:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2005:x1830881273208832:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065143.823065:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2005:x1830881273208832:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 154us (571us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.823070:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3135 00002000:00100000:3.0:1746065143.823075:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008b78b100 x1830881273208832/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.823094:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b100 with x1830881273208832 ext(0->4095) 00010000:00010000:3.0:1746065143.823098:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.823111:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746065143.823116:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b78b100 00000100:00100000:0.0:1746065143.826197:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.826654:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273208960 00000100:00100000:2.0:1746065143.826663:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273208960 00010000:00010000:2.0:1746065143.827075:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.827130:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14785 00000100:00100000:2.0:1746065143.827137:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2005:x1830881273208960:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.827150:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.827165:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.827176:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.827194:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e699e expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065143.827215:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.827217:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.827223:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.827230:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.827502:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.827515:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267808768:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.827603:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.831791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.831851:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267808768:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.831866:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.831928:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2005:x1830881273208960:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4790us (5735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.831936:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14785 00000100:00100000:3.0:1746065143.831955:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273209216 00000100:00100000:3.0:1746065143.831962:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273209216 00002000:00100000:3.0:1746065143.831992:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cbb80 x1830881273209216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.832001:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cbb80 with x1830881273209216 ext(0->4095) 00002000:00010000:3.0:1746065143.832004:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cbb80 00000100:00100000:3.0:1746065143.832033:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13848 00000100:00100000:3.0:1746065143.832040:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273209216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065143.832173:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273209216:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 133us (388us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.832178:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13848 00002000:00100000:3.0:1746065143.832183:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d6cbb80 x1830881273209216/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.832193:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cbb80 with x1830881273209216 ext(0->4095) 00002000:00010000:3.0:1746065143.832196:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d6cbb80 00000100:00100000:0.0:1746065143.835448:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.836070:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273209344 00000100:00100000:3.0:1746065143.836221:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273209344 00000100:00100000:2.0:1746065143.836418:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30814 00000100:00100000:2.0:1746065143.836426:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273209344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.836442:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.836457:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69ac expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.836481:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 71 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.836487:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.836488:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.836490:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.836512:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 71 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.836522:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 71 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.836532:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267808896:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.836872:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.839238:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.839334:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267808896:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.839354:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.839367:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065143.839397:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273209344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2973us (3955us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.839405:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30814 00000100:00100000:3.0:1746065143.839563:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273209472 00000100:00100000:3.0:1746065143.839569:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273209472 00010000:00010000:3.0:1746065143.839592:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.839930:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14786 00000100:00100000:3.0:1746065143.839938:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273209472:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.839950:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.839966:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.839976:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.839993:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69a5 expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.840006:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.840008:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.840014:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.840021:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.840044:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.840054:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267809024:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.840123:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.842303:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.842836:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.842921:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273209856 00000100:00100000:1.0:1746065143.842928:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273209856 00002000:00100000:1.0:1746065143.842960:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a6d80 x1830881273209856/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.842968:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a6d80 with x1830881273209856 ext(0->4095) 00002000:00010000:1.0:1746065143.842972:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a6d80 00000100:00100000:1.0:1746065143.842989:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13849 00000100:00100000:1.0:1746065143.842995:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273209856:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.843121:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273209856:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 125us (284us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.843127:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13849 00002000:00100000:1.0:1746065143.843133:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800979a6d80 x1830881273209856/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.843145:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979a6d80 with x1830881273209856 ext(0->4095) 00002000:00010000:1.0:1746065143.843147:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979a6d80 00000100:00100000:2.0:1746065143.843402:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273209600 00000100:00100000:2.0:1746065143.843406:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273209600 00000100:00100000:2.0:1746065143.843426:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30815 00000100:00100000:2.0:1746065143.843431:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1791:x1830881273209600:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.843439:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.843453:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69b3 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.843471:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.843477:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.843479:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.843481:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.843505:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.843516:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 5 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065143.843526:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267809152:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.843571:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.844234:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267809024:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.844247:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.844280:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2004:x1830881273209472:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4343us (5047us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.844287:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14786 00000100:00100000:2.0:1746065143.846138:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267809152:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.846157:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.846170:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064000, rc 0) 00000100:00100000:2.0:1746065143.846511:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1791:x1830881273209600:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3078us (4211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.846519:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30815 00000100:00100000:0.0:1746065143.846584:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.846873:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273209984 00000100:00100000:2.0:1746065143.846879:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273209984 00000100:00100000:2.0:1746065143.846918:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30816 00000100:00100000:2.0:1746065143.846924:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1795:x1830881273209984:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.846935:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.846946:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69ba expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.846963:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.846967:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.846972:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.846975:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.846997:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.847005:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.847011:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065143.847028:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1795:x1830881273209984:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 105us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.847033:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30816 00000100:00100000:0.0:1746065143.850488:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.850732:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273210112 00000100:00100000:3.0:1746065143.850741:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273210112 00010000:00010000:3.0:1746065143.850771:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.850814:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14787 00000100:00100000:3.0:1746065143.850821:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273210112:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.850833:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.850848:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.850859:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.850886:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880a3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ac expref: 6 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.850926:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.850928:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.850935:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.850943:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.850973:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.850983:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.850993:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267809408:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.851062:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.853624:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.853718:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267809408:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.853733:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.853765:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273210112:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2945us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.853773:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14787 00000100:00100000:1.0:1746065143.853865:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273210368 00000100:00100000:1.0:1746065143.853870:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273210368 00002000:00100000:1.0:1746065143.853912:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091f800 x1830881273210368/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.853921:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f800 with x1830881273210368 ext(0->4095) 00010000:00010000:1.0:1746065143.853927:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.853938:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.853944:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091f800 00000100:00100000:1.0:1746065143.853970:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3136 00000100:00100000:1.0:1746065143.853977:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2004:x1830881273210368:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.854075:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2004:x1830881273210368:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (456us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.854096:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3136 00002000:00100000:1.0:1746065143.854101:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a091f800 x1830881273210368/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.854108:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091f800 with x1830881273210368 ext(0->4095) 00010000:00010000:1.0:1746065143.854113:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065143.854121:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065143.854126:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091f800 00000100:00100000:0.0:1746065143.861066:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.861813:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273210496 00000100:00100000:3.0:1746065143.861821:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273210496 00010000:00010000:3.0:1746065143.861850:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.861885:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14788 00000100:00100000:3.0:1746065143.861900:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2003:x1830881273210496:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.861913:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.861934:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.861946:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.861965:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064000/0x392ae0376f880a42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69b3 expref: 73 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.861979:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.861981:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.861987:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.861994:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.862018:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.862027:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267809536:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.862115:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.867310:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.867495:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273210752 00000100:00100000:1.0:1746065143.867503:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273210752 00002000:00100000:1.0:1746065143.867534:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549d880 x1830881273210752/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.867544:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d880 with x1830881273210752 ext(0->4095) 00002000:00010000:1.0:1746065143.867548:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549d880 00000100:00100000:1.0:1746065143.867574:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13850 00000100:00100000:1.0:1746065143.867580:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2003:x1830881273210752:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065143.867683:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2003:x1830881273210752:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 102us (379us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.867689:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13850 00002000:00100000:1.0:1746065143.867694:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549d880 x1830881273210752/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.867701:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549d880 with x1830881273210752 ext(0->4095) 00002000:00010000:1.0:1746065143.867704:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549d880 00000100:00100000:3.0:1746065143.867780:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267809536:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.867795:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.867814:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2003:x1830881273210496:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5924us (6876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.867821:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14788 00000100:00100000:0.0:1746065143.870911:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.871043:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273210880 00000100:00100000:1.0:1746065143.871050:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273210880 00000100:00100000:1.0:1746065143.871181:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30817 00000100:00100000:1.0:1746065143.871188:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273210880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.871204:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.871217:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69c1 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.871237:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 71 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.871243:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.871245:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.871247:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.871268:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 71 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.871277:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 71 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065143.871286:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267809664:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065143.871342:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.873857:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267809664:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.873879:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.873903:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc800, rc 0) 00000100:00100000:1.0:1746065143.873944:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273210880:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2755us (3039us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.873954:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30817 00000100:00100000:0.0:1746065143.874642:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.875044:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273211008 00000100:00100000:3.0:1746065143.875052:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273211008 00010000:00010000:3.0:1746065143.875073:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065143.875326:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14789 00000100:00100000:3.0:1746065143.875334:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273211008:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.875344:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.875359:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.875368:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.875385:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69ba expref: 72 pid: 9560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746065143.875404:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.875406:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.875412:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.875418:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.875443:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.875453:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267809792:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.875743:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.876779:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267809792:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.876791:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.876814:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+71:2004:x1830881273211008:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1481us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.876821:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14789 00000100:00100000:0.0:1746065143.877546:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.877728:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273211264 00000100:00100000:2.0:1746065143.877734:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273211264 00002000:00100000:2.0:1746065143.877761:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549c000 x1830881273211264/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.877769:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549c000 with x1830881273211264 ext(0->4095) 00002000:00010000:2.0:1746065143.877772:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549c000 00000100:00100000:2.0:1746065143.877853:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13851 00000100:00100000:2.0:1746065143.877859:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273211264:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.877968:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273211264:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 108us (422us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.877979:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13851 00002000:00100000:2.0:1746065143.877984:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009549c000 x1830881273211264/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.877990:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009549c000 with x1830881273211264 ext(0->4095) 00002000:00010000:2.0:1746065143.877993:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009549c000 00000100:00100000:0.0:1746065143.879621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.879662:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.880269:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273211392 00000100:00100000:1.0:1746065143.880277:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273211392 00000100:00100000:1.0:1746065143.880431:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273211520 00000100:00100000:1.0:1746065143.880435:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273211520 00000100:00100000:2.0:1746065143.880500:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30818 00000100:00100000:2.0:1746065143.880508:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:1795:x1830881273211392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.880521:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.880535:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69c8 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.880558:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.880564:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.880566:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.880569:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.880591:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.880601:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 5 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065143.880609:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267809920:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.880677:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.881001:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30819 00000100:00100000:1.0:1746065143.881007:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1791:x1830881273211520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065143.881013:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.881020:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69cf expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.881031:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.881035:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.881039:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.881042:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 74 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.881059:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.881068:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 74 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.881076:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd400, rc 0) 00000100:00100000:1.0:1746065143.881124:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:1791:x1830881273211520:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 116us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.881133:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30819 00000100:00100000:2.0:1746065143.883978:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267809920:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065143.883987:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065143.883997:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.884013:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064400, rc 0) 00000100:00100000:3.0:1746065143.884047:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273211648 00000100:00100000:3.0:1746065143.884054:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273211648 00000100:00100000:2.0:1746065143.884056:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1795:x1830881273211392:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3549us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.884062:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30818 00010000:00010000:3.0:1746065143.884075:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.884125:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14790 00000100:00100000:3.0:1746065143.884132:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5945c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273211648:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.884144:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.884159:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.884168:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.884185:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfc800/0x392ae0376f880a50 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c1 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.884197:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.884198:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.884203:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.884210:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.884234:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 72 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.884243:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 72 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.884252:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267810176:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.884311:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.885393:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267810176:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.885402:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.885423:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5945c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273211648:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1292us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.885430:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14790 00000100:00100000:0.0:1746065143.885978:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.886018:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273211904 00000100:00100000:2.0:1746065143.886146:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273211904 00002000:00100000:2.0:1746065143.886172:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f980000 x1830881273211904/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.886180:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980000 with x1830881273211904 ext(0->4095) 00010000:00010000:2.0:1746065143.886186:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 73 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.886197:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 73 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065143.886203:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f980000 00000100:00100000:2.0:1746065143.886228:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3137 00000100:00100000:2.0:1746065143.886235:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2004:x1830881273211904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.886329:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2004:x1830881273211904:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 94us (351us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.886337:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3137 00002000:00100000:2.0:1746065143.886343:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f980000 x1830881273211904/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.886349:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f980000 with x1830881273211904 ext(0->4095) 00010000:00010000:2.0:1746065143.886354:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 73 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.886362:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 73 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065143.886367:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f980000 00000100:00100000:0.0:1746065143.888423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.888493:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.888645:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273212160 00000100:00100000:3.0:1746065143.888652:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273212160 00010000:00010000:3.0:1746065143.888678:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 73 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.888714:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14791 00000100:00100000:3.0:1746065143.888720:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2003:x1830881273212160:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.888731:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.888745:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 73 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.888755:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 73 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.888773:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064400/0x392ae0376f880a57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69c8 expref: 73 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.888784:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.888786:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.888792:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.888804:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.888832:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.888844:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267810304:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.888873:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273212032 00000100:00100000:2.0:1746065143.888876:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273212032 00000100:00100000:2.0:1746065143.888912:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30820 00000100:00100000:3.0:1746065143.888917:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.888918:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273212032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.888926:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.888935:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69d6 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.888950:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.888955:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.888956:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.888959:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.888978:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.888986:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065143.888994:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267810432:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.889014:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.891676:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a09fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267810432:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.891700:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.891714:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065143.891746:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273212032:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2828us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.891753:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30820 00000100:00100000:3.0:1746065143.892025:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267810304:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.892034:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.892226:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2003:x1830881273212160:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3505us (3731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.892233:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14791 00000100:00100000:0.0:1746065143.892296:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.892483:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273212416 00000100:00100000:2.0:1746065143.892489:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273212416 00002000:00100000:2.0:1746065143.892515:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dfffb80 x1830881273212416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.892523:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfffb80 with x1830881273212416 ext(0->4095) 00010000:00010000:2.0:1746065143.892528:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.892543:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065143.892549:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dfffb80 00000100:00100000:2.0:1746065143.892574:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3138 00000100:00100000:2.0:1746065143.892580:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2005:x1830881273212416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065143.892684:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2005:x1830881273212416:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 103us (387us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.892691:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3138 00002000:00100000:2.0:1746065143.892695:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dfffb80 x1830881273212416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.892701:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dfffb80 with x1830881273212416 ext(0->4095) 00010000:00010000:2.0:1746065143.892706:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.892714:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065143.892719:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dfffb80 00000100:00100000:0.0:1746065143.895277:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.895511:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.895588:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273212544 00000100:00100000:3.0:1746065143.895596:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273212544 00010000:00010000:3.0:1746065143.895623:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 72 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065143.895792:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273212672 00000100:00100000:2.0:1746065143.895796:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273212672 00000100:00100000:2.0:1746065143.895820:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30821 00000100:00100000:2.0:1746065143.895826:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1791:x1830881273212672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.895839:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.895850:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69dd expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.895868:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.895873:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.895877:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065143.895880:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 74 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.895916:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.895925:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 74 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.895933:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065000, rc 0) 00000100:00100000:2.0:1746065143.895964:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:1791:x1830881273212672:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 139us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.895969:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30821 00000100:00100000:3.0:1746065143.896008:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14792 00000100:00100000:3.0:1746065143.896013:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2002:x1830881273212544:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.896021:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.896034:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 73 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.896044:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 73 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.896062:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880a5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69cf expref: 73 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.896093:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.896094:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.896100:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.896106:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.896125:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.896134:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 5 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.896149:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267810688:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.896203:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.898449:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267810688:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.898466:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.898507:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2002:x1830881273212544:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2492us (3235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.898516:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14792 00000100:00100000:0.0:1746065143.898705:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.898871:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273212928 00000100:00100000:1.0:1746065143.898877:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273212928 00002000:00100000:1.0:1746065143.898921:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91f80 x1830881273212928/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.898930:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91f80 with x1830881273212928 ext(0->4095) 00010000:00010000:1.0:1746065143.898936:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065143.898947:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065143.898953:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91f80 00000100:00100000:1.0:1746065143.898966:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3139 00000100:00100000:1.0:1746065143.898971:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273212928:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065143.899055:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273212928:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 84us (351us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.899060:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3139 00002000:00100000:1.0:1746065143.899064:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880094c91f80 x1830881273212928/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.899071:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c91f80 with x1830881273212928 ext(0->4095) 00010000:00010000:1.0:1746065143.899074:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065143.899110:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065143.899115:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c91f80 00000100:00100000:0.0:1746065143.900997:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.901279:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273213056 00000100:00100000:3.0:1746065143.901284:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273213056 00010000:00010000:3.0:1746065143.901306:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.901325:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14793 00000100:00100000:3.0:1746065143.901330:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273213056:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.901340:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.901353:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.901362:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.901379:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880a65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69d6 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.901389:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.901392:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.901397:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 71 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.901405:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 71 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.901429:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 71 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.901439:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267810816:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.901502:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.903703:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.903799:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267810816:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.903812:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.903848:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273213056:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2517us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.903856:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14793 00000100:00100000:2.0:1746065143.903986:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273213312 00000100:00100000:2.0:1746065143.903991:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273213312 00002000:00100000:2.0:1746065143.904020:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130779500 x1830881273213312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.904028:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779500 with x1830881273213312 ext(0->4095) 00002000:00010000:2.0:1746065143.904031:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130779500 00000100:00100000:2.0:1746065143.904112:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13852 00000100:00100000:2.0:1746065143.904119:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273213312:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065143.904411:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2004:x1830881273213312:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 292us (711us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.904416:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13852 00002000:00100000:2.0:1746065143.904421:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130779500 x1830881273213312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.904427:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779500 with x1830881273213312 ext(0->4095) 00002000:00010000:2.0:1746065143.904430:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130779500 00000100:00100000:0.0:1746065143.908000:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.908266:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273213440 00000100:00100000:3.0:1746065143.908274:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273213440 00000100:00100000:3.0:1746065143.908323:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30822 00000100:00100000:3.0:1746065143.908331:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273213440:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.908345:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.908360:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69e4 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.908383:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 71 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.908394:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.908396:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.908398:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.908422:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 71 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.908433:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 71 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.908444:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267810944:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.908517:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.914335:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.914435:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267810944:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.914458:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.914472:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10600, rc 0) 00000100:00100000:3.0:1746065143.914508:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273213440:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6178us (6515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.914515:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30822 00000100:00100000:2.0:1746065143.914962:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273213568 00000100:00100000:2.0:1746065143.914968:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273213568 00002000:00100000:2.0:1746065143.914999:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880130779f80 x1830881273213568/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.915008:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779f80 with x1830881273213568 ext(0->7) 00010000:00010000:2.0:1746065143.915014:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 72 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.915024:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 72 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065143.915030:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130779f80 00000100:00100000:2.0:1746065143.915592:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3140 00000100:00100000:2.0:1746065143.915600:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+72:2005:x1830881273213568:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065143.917281:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2005:x1830881273213568:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1677us (2947us total) trans 4294972154 rc 0/0 00000100:00100000:0.0:1746065143.917289:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3140 00002000:00100000:0.0:1746065143.917296:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880130779f80 x1830881273213568/t4294972154(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065143.917603:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779f80 with x1830881273213568 ext(0->7) 00010000:00010000:0.0:1746065143.917610:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 74 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065143.917682:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 74 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746065143.917689:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130779f80 00000100:00100000:0.0:1746065143.921997:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.922041:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273213696 00000100:00100000:3.0:1746065143.922049:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273213696 00010000:00010000:3.0:1746065143.922092:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 74 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.922123:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14794 00000100:00100000:3.0:1746065143.922130:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2005:x1830881273213696:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.922141:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065143.922153:0:8359:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1746065142 -> 1746065143 00002000:00010000:3.0:1746065143.922156:0:8359:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1746065142 -> 1746065143 00010000:00010000:3.0:1746065143.922161:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 74 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.922171:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 74 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.922191:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065000/0x392ae0376f880a6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69dd expref: 74 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.922207:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.922209:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.922215:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.922223:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.922249:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.922259:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267811072:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.924986:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.929199:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267811072:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065143.929216:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.929264:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:2005:x1830881273213696:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 7134us (7274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.929273:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14794 00000100:00100000:0.0:1746065143.929673:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.929918:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273213952 00000100:00100000:2.0:1746065143.929926:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273213952 00002000:00100000:2.0:1746065143.929956:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130779880 x1830881273213952/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.929964:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779880 with x1830881273213952 ext(0->4095) 00002000:00010000:2.0:1746065143.929968:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130779880 00000100:00100000:2.0:1746065143.930188:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13853 00000100:00100000:2.0:1746065143.930197:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273213952:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065143.930982:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273213952:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 785us (1309us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.930989:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13853 00002000:00100000:2.0:1746065143.930995:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880130779880 x1830881273213952/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.931002:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779880 with x1830881273213952 ext(0->4095) 00002000:00010000:2.0:1746065143.931005:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130779880 00000100:00100000:0.0:1746065143.931338:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.937377:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273214080 00000100:00100000:3.0:1746065143.937387:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273214080 00000100:00100000:3.0:1746065143.937439:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30823 00000100:00100000:3.0:1746065143.937447:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+73:1791:x1830881273214080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.937460:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.937474:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69eb expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.937497:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.937503:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.937504:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.937507:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.937530:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.937540:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 5 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.937557:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267811200:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.939284:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.939370:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.939390:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273214336 00000100:00100000:3.0:1746065143.939395:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273214336 00010000:00010000:3.0:1746065143.939417:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.939446:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14795 00000100:00100000:3.0:1746065143.939452:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273214336:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.939462:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.939478:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.939487:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.939504:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.939505:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.939510:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.939517:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.939537:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 74 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.939546:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267811328:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065143.940101:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273214208 00000100:00100000:0.0:1746065143.940105:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273214208 00000100:00100000:0.0:1746065143.940135:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30824 00000100:00100000:0.0:1746065143.940140:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:1795:x1830881273214208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065143.940150:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065143.940159:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69f2 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.940173:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.940178:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065143.940179:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065143.940182:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 76 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.940202:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.940210:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 7/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 76 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065143.940217:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267811456:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065143.945535:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.945602:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18319c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.945627:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267811456:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065143.945650:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 76 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.945664:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe71c00, rc 0) 00000100:00100000:1.0:1746065143.945708:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1795:x1830881273214208:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5567us (6428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.945716:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30824 00000100:00100000:0.0:1746065143.948199:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267811328:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065143.948217:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.948269:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273214336:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 8816us (8897us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.948278:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14795 00000100:00100000:3.0:1746065143.948777:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00010000:00010000:3.0:1746065143.948796:0:9560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10600/0x392ae0376f880a73 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69e4 expref: 5 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.948824:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267811200:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.948841:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 75 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.948847:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 75 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.948855:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746065143.950053:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:1791:x1830881273214080:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 12603us (18711us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.950061:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30823 00000100:00100000:0.0:1746065143.953484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.953588:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273214592 00000100:00100000:2.0:1746065143.953596:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273214592 00002000:00100000:2.0:1746065143.953635:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b100 x1830881273214592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.953645:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b100 with x1830881273214592 ext(0->4095) 00010000:00010000:2.0:1746065143.953653:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 75 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.953666:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 75 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065143.953672:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077b100 00000100:00100000:2.0:1746065143.953870:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3141 00000100:00100000:2.0:1746065143.953878:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2003:x1830881273214592:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746065143.954147:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2003:x1830881273214592:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 268us (667us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.954153:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3141 00002000:00100000:2.0:1746065143.954159:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b100 x1830881273214592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065143.954165:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b100 with x1830881273214592 ext(0->4095) 00010000:00010000:2.0:1746065143.954169:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 75 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.954177:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 75 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065143.954181:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077b100 00000100:00100000:2.0:1746065143.957267:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.957349:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273214720 00000100:00100000:0.0:1746065143.957356:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273214720 00010000:00010000:0.0:1746065143.957384:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 75 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065143.957615:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14796 00000100:00100000:0.0:1746065143.957622:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2003:x1830881273214720:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.957632:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.957646:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 75 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065143.957660:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 75 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065143.957676:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x392ae0376f880a7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69eb expref: 75 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065143.957698:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.957700:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.957705:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 74 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.957712:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 74 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.957737:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 74 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.957747:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267811584:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065143.957867:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1831300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.961703:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065143.962108:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273214976 00000100:00100000:3.0:1746065143.962116:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273214976 00002000:00100000:3.0:1746065143.962150:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8b480 x1830881273214976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.962160:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8b480 with x1830881273214976 ext(0->4095) 00002000:00010000:3.0:1746065143.962164:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8b480 00000100:00100000:3.0:1746065143.962632:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13854 00000100:00100000:3.0:1746065143.962640:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2005:x1830881273214976:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065143.962937:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267811584:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.962954:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.963108:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2005:x1830881273214976:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 467us (1409us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.963114:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13854 00002000:00100000:3.0:1746065143.963121:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880124b8b480 x1830881273214976/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.963129:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880124b8b480 with x1830881273214976 ext(0->4095) 00002000:00010000:3.0:1746065143.963132:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880124b8b480 00000100:00100000:2.0:1746065143.963885:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2003:x1830881273214720:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 6261us (6623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.963901:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14796 00000100:00100000:0.0:1746065143.967041:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.967184:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746065143.967198:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267811712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746065143.967240:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065143.967399:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273215104 00000100:00100000:3.0:1746065143.967405:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273215104 00000100:00100000:3.0:1746065143.967439:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30825 00000100:00100000:3.0:1746065143.967445:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273215104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.967459:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.967473:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e69f9 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.967494:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 73 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.967501:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.967502:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.967506:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.967524:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 73 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.967539:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 73 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.967547:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267811840:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065143.967592:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.969120:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267811712 00000100:00100000:2.0:1746065143.969128:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267811712 00000100:00100000:2.0:1746065143.969175:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1746065143.969181:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3766:x1830881267811712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746065143.969206:0:7216:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446187008 avail 1316724736 00000100:00100000:2.0:1746065143.969257:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3766:x1830881267811712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.969262:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1746065143.969338:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267811712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746065143.970417:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267811840:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065143.970435:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.970448:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:3.0:1746065143.970487:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273215104:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3042us (3454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.970493:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30825 00000100:00100000:0.0:1746065143.971487:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.972488:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.972657:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273215232 00000100:00100000:2.0:1746065143.972664:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273215232 00010000:00010000:2.0:1746065143.972689:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 74 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.973155:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273215360 00000100:00100000:3.0:1746065143.973159:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273215360 00000100:00100000:3.0:1746065143.973190:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30826 00000100:00100000:3.0:1746065143.973197:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:1791:x1830881273215360:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065143.973209:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.973220:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a00 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.973239:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.973244:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.973254:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065143.973256:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.973282:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.973293:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 76 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.973301:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065143.973329:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1791:x1830881273215360:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 133us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.973334:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30826 00000100:00100000:2.0:1746065143.973529:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14797 00000100:00100000:2.0:1746065143.973535:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5945850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+75:2004:x1830881273215232:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.973544:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.973559:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 75 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.973569:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 75 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.973583:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe71c00/0x392ae0376f880a81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f2 expref: 75 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.973808:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.973810:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.973815:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.973822:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.973848:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.973858:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 5 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065143.973868:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267812096:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.973985:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.976723:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.976797:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267812096:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.976812:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.977119:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273215616 00000100:00100000:3.0:1746065143.977124:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273215616 00002000:00100000:3.0:1746065143.977157:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918e00 x1830881273215616/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.977167:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918e00 with x1830881273215616 ext(0->4095) 00010000:00010000:3.0:1746065143.977173:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.977184:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746065143.977190:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918e00 00000100:00100000:2.0:1746065143.977708:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5945850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2004:x1830881273215232:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4171us (6219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.977718:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14797 00000100:00100000:3.0:1746065143.978067:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3142 00000100:00100000:3.0:1746065143.978075:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273215616:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746065143.978190:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273215616:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 116us (1473us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.978195:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3142 00002000:00100000:3.0:1746065143.978200:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918e00 x1830881273215616/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065143.978206:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918e00 with x1830881273215616 ext(0->4095) 00010000:00010000:3.0:1746065143.978211:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.978219:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746065143.978224:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918e00 00000100:00100000:0.0:1746065143.980369:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.980454:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273215744 00000100:00100000:2.0:1746065143.980459:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273215744 00010000:00010000:2.0:1746065143.980479:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065143.980508:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14798 00000100:00100000:2.0:1746065143.980514:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273215744:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.980524:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.980539:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.980548:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.980569:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10a00/0x392ae0376f880a88 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e69f9 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065143.980582:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.980584:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.980590:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.980597:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.980629:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.980640:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267812224:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065143.980700:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.982594:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.982706:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267812224:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065143.982719:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.982749:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273215744:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2235us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.982757:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14798 00000100:00100000:1.0:1746065143.982830:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273216000 00000100:00100000:1.0:1746065143.982836:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273216000 00002000:00100000:1.0:1746065143.982862:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918380 x1830881273216000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.982961:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918380 with x1830881273216000 ext(0->4095) 00002000:00010000:1.0:1746065143.982965:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918380 00000100:00100000:1.0:1746065143.982992:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13855 00000100:00100000:1.0:1746065143.983000:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2005:x1830881273216000:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065143.983345:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2005:x1830881273216000:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 345us (754us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.983351:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13855 00002000:00100000:1.0:1746065143.983356:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a0918380 x1830881273216000/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.983363:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918380 with x1830881273216000 ext(0->4095) 00002000:00010000:1.0:1746065143.983366:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918380 00000100:00100000:0.0:1746065143.990037:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.990109:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273216128 00000100:00100000:2.0:1746065143.990116:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273216128 00000100:00100000:2.0:1746065143.990165:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30827 00000100:00100000:2.0:1746065143.990171:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273216128:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.990188:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.990202:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a07 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.990226:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.990232:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.990234:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.990236:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.990257:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 73 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.990267:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 73 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065143.990276:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267812352:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065143.990345:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.992799:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267812352:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065143.992821:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.992835:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065143.992865:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273216128:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2693us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.992875:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30827 00000100:00100000:0.0:1746065143.993292:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065143.993394:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273216256 00000100:00100000:1.0:1746065143.993399:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273216256 00002000:00100000:1.0:1746065143.993427:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a0919500 x1830881273216256/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.993435:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919500 with x1830881273216256 ext(0->7) 00010000:00010000:1.0:1746065143.993441:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 74 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065143.993452:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 74 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065143.993458:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0919500 00000100:00100000:1.0:1746065143.994262:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3143 00000100:00100000:1.0:1746065143.994270:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+74:2004:x1830881273216256:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746065143.995363:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2004:x1830881273216256:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1093us (2069us total) trans 4294972155 rc 0/0 00000100:00100000:1.0:1746065143.995370:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3143 00002000:00100000:1.0:1746065143.995377:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff8800a0919500 x1830881273216256/t4294972155(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:59/0 lens 496/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065143.995384:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919500 with x1830881273216256 ext(0->7) 00010000:00010000:1.0:1746065143.995390:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 76 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065143.995400:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 76 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065143.995405:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0919500 00000100:00100000:0.0:1746065143.998542:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065143.998622:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065143.998704:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273216512 00000100:00100000:2.0:1746065143.998711:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273216512 00000100:00100000:2.0:1746065143.998743:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30828 00000100:00100000:2.0:1746065143.998750:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1791:x1830881273216512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065143.998762:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.998775:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a0e expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.998797:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.998802:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.998808:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065143.998811:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.998839:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.998849:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.998858:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065143.998899:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1791:x1830881273216512:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.998905:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30828 00000100:00100000:3.0:1746065143.998958:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273216384 00000100:00100000:3.0:1746065143.998961:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273216384 00010000:00010000:3.0:1746065143.998976:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 77 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.999032:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14799 00000100:00100000:3.0:1746065143.999038:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2005:x1830881273216384:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.999046:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.999059:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 77 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.999074:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 77 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.999432:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x392ae0376f880a8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a00 expref: 77 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065143.999453:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.999455:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.999460:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.999467:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.999487:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.999557:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 5 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065143.999567:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267812608:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065143.999623:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.002020:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267812608:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.002037:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.002103:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2005:x1830881273216384:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3043us (3458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.002115:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14799 00000100:00100000:0.0:1746065144.002605:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.002685:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273216768 00000100:00100000:1.0:1746065144.002690:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273216768 00002000:00100000:1.0:1746065144.002737:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb65c00 x1830881273216768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.002746:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb65c00 with x1830881273216768 ext(0->4095) 00010000:00010000:1.0:1746065144.002752:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.002762:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.002768:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb65c00 00000100:00100000:1.0:1746065144.002793:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3144 00000100:00100000:1.0:1746065144.002799:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273216768:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00080000:0.0:1746065144.002900:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065144.002968:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273216768:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 168us (363us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.002977:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3144 00002000:00100000:1.0:1746065144.002988:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb65c00 x1830881273216768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.002995:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb65c00 with x1830881273216768 ext(0->4095) 00010000:00010000:1.0:1746065144.002999:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.003007:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.003013:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb65c00 00000100:00100000:0.0:1746065144.004865:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.004954:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273216896 00000100:00100000:3.0:1746065144.004959:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273216896 00010000:00010000:3.0:1746065144.004979:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.005009:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14800 00000100:00100000:3.0:1746065144.005014:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2002:x1830881273216896:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.005024:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.005037:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.005046:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.005063:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065800/0x392ae0376f880a96 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a07 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.005077:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.005098:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.005104:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 75 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.005111:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 75 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.005135:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 75 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.005145:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267812736:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.005202:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.007420:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.007487:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267812736:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.007501:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.007511:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273217152 00000100:00100000:1.0:1746065144.007516:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273217152 00000100:00100000:3.0:1746065144.007529:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2002:x1830881273216896:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2515us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.007537:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14800 00002000:00100000:1.0:1746065144.007549:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64e00 x1830881273217152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.007556:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64e00 with x1830881273217152 ext(0->4095) 00002000:00010000:1.0:1746065144.007559:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb64e00 00000100:00080000:3.0:1746065144.007565:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065144.007648:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13856 00000100:00100000:1.0:1746065144.007654:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2003:x1830881273217152:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746065144.007805:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:2003:x1830881273217152:12345-192.168.202.8@tcp:3:ptlrpcd_00_01.0 Request processed in 150us (388us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.007810:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13856 00002000:00100000:1.0:1746065144.007816:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009fb64e00 x1830881273217152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.007828:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb64e00 with x1830881273217152 ext(0->4095) 00002000:00010000:1.0:1746065144.007830:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb64e00 00000100:00100000:0.0:1746065144.015997:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.016079:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273217280 00000100:00100000:2.0:1746065144.016109:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273217280 00000100:00100000:2.0:1746065144.016139:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30829 00000100:00100000:2.0:1746065144.016145:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273217280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065144.016160:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.016175:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a15 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.016199:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 75 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.016205:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.016206:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.016208:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.016232:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 75 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.016242:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 75 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065144.016252:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267812864:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065144.016362:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.020980:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267812864:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065144.021005:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.021025:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:2.0:1746065144.021060:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273217280:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4915us (5071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.021067:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30829 00000100:00100000:0.0:1746065144.036327:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.036419:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273217408 00000100:00100000:2.0:1746065144.036427:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273217408 00000100:00100000:2.0:1746065144.036464:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30830 00000100:00100000:2.0:1746065144.036471:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+76:1791:x1830881273217408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065144.036486:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.036499:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a1c expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.036519:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.036524:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.036530:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065144.036532:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.036559:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.036569:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.036582:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065144.036629:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:1791:x1830881273217408:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 159us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.036635:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30830 00000100:00100000:0.0:1746065144.038610:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.038688:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273217536 00000100:00100000:1.0:1746065144.038695:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273217536 00002000:00100000:1.0:1746065144.038726:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d510000 x1830881273217536/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 496/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.038735:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d510000 with x1830881273217536 ext(0->7) 00010000:00010000:1.0:1746065144.038742:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 77 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.038754:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 77 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.038759:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d510000 00000100:00100000:1.0:1746065144.038784:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3145 00000100:00100000:1.0:1746065144.038790:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2004:x1830881273217536:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065144.039571:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2004:x1830881273217536:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 779us (963us total) trans 4294972156 rc 0/0 00000100:00100000:0.0:1746065144.039578:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3145 00002000:00100000:0.0:1746065144.039583:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff88009d510000 x1830881273217536/t4294972156(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 496/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065144.039590:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d510000 with x1830881273217536 ext(0->7) 00010000:00010000:0.0:1746065144.039595:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065144.039604:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746065144.039610:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d510000 00000100:00100000:2.0:1746065144.045044:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.045946:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273217664 00000100:00100000:3.0:1746065144.045954:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273217664 00010000:00010000:3.0:1746065144.045984:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.046032:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14801 00000100:00100000:3.0:1746065144.046040:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2002:x1830881273217664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.046053:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.046069:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.046096:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.046116:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880a9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a0e expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.046700:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.046703:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.046710:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.046718:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.046749:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.046759:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 5 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.046769:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267813120:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.046910:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.047663:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065144.047673:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267813248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065144.047709:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065144.048101:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267813248 00000100:00100000:3.0:1746065144.048106:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267813248 00000100:00100000:3.0:1746065144.048139:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1746065144.048146:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830881267813248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1746065144.048166:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 980040512 pending 0 free 3921227776 avail 3689705472 00000100:00100000:3.0:1746065144.048195:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830881267813248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.048200:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00080000:0.0:1746065144.048620:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065144.048647:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267813248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065144.056710:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.056789:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273217920 00000100:00100000:1.0:1746065144.056795:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273217920 00002000:00100000:1.0:1746065144.056830:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d510380 x1830881273217920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.056840:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d510380 with x1830881273217920 ext(0->4095) 00010000:00010000:1.0:1746065144.056848:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.056861:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.056868:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d510380 00000100:00100000:3.0:1746065144.061953:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267813120:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.061983:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.068798:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3146 00000100:00100000:2.0:1746065144.068838:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273217920:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065144.068992:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273217920:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 182us (12288us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065144.068998:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3146 00002000:00100000:2.0:1746065144.069006:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d510380 x1830881273217920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.069016:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d510380 with x1830881273217920 ext(0->4095) 00010000:00010000:2.0:1746065144.069023:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.069939:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065144.069948:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d510380 00000100:00100000:2.0:1746065144.070001:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2002:x1830881273217664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 23961us (25123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.070009:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14801 00000100:00100000:0.0:1746065144.072880:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.073215:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273218048 00000100:00100000:2.0:1746065144.073222:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273218048 00010000:00010000:2.0:1746065144.073250:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065144.073730:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14802 00000100:00100000:2.0:1746065144.073737:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d510a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273218048:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065144.073749:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065144.073765:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.073775:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.073791:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064e00/0x392ae0376f880aa4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a15 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.074111:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.074113:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.074120:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.074128:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.074865:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065144.074880:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267813376:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065144.075897:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065144.075924:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273218176 00000100:00100000:0.0:1746065144.075929:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273218176 00000100:00100000:0.0:1746065144.075965:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30831 00000100:00100000:0.0:1746065144.075971:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273218176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065144.075983:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.075996:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a23 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.076015:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.076021:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065144.076022:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065144.076025:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.076042:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.076052:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 77 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065144.076065:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d511180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267813504:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065144.080348:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.082417:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.082447:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d511180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267813504:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065144.082471:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.082485:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072824a00, rc 0) 00000100:00100000:0.0:1746065144.082522:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1795:x1830881273218176:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6549us (6633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.082529:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30831 00000100:00100000:3.0:1746065144.082774:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267813376:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.082784:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.082807:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d510a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273218048:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 9071us (9933us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.082814:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14802 00000100:00100000:0.0:1746065144.083743:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.084823:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273218432 00000100:00100000:1.0:1746065144.084829:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273218432 00002000:00100000:1.0:1746065144.084859:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d511180 x1830881273218432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.084868:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d511180 with x1830881273218432 ext(0->4095) 00010000:00010000:1.0:1746065144.084875:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 78 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.084887:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 78 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.084902:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d511180 00000100:00100000:1.0:1746065144.084918:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3147 00000100:00100000:1.0:1746065144.084925:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881273218432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065144.085026:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881273218432:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 102us (1285us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.085031:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3147 00002000:00100000:1.0:1746065144.085036:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d511180 x1830881273218432/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.085043:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d511180 with x1830881273218432 ext(0->4095) 00010000:00010000:1.0:1746065144.085047:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 78 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.085059:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 78 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.085064:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d511180 00000100:00100000:3.0:1746065144.089613:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.089943:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.089965:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273218688 00000100:00100000:3.0:1746065144.089971:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273218688 00010000:00010000:3.0:1746065144.089997:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 78 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065144.090554:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273218560 00000100:00100000:0.0:1746065144.090559:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273218560 00000100:00100000:0.0:1746065144.090586:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30832 00000100:00100000:0.0:1746065144.090592:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1791:x1830881273218560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065144.090604:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.090616:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a2a expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.090637:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065144.090642:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.090647:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065144.090649:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.090679:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.090690:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.090697:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072825600, rc 0) 00000100:00100000:0.0:1746065144.090731:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881273218560:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 139us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.090736:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30832 00000100:00100000:3.0:1746065144.090908:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14803 00000100:00100000:3.0:1746065144.090914:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2002:x1830881273218688:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.090923:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.090938:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.090948:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.090962:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880aab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a1c expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.090973:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.090975:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.090980:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.090987:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.091005:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.091014:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 5 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.091024:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267813760:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.091096:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.094688:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065144.095264:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267813760:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065144.095281:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065144.095313:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2002:x1830881273218688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4399us (5371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.095323:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14803 00000100:00100000:1.0:1746065144.096273:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273218944 00000100:00100000:1.0:1746065144.096280:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273218944 00002000:00100000:1.0:1746065144.096313:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b800 x1830881273218944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.096322:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b800 with x1830881273218944 ext(0->4095) 00010000:00010000:1.0:1746065144.096329:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.096341:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.096347:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54b800 00000100:00100000:1.0:1746065144.096375:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3148 00000100:00100000:1.0:1746065144.096382:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273218944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065144.097038:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273218944:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 655us (2354us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.097045:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3148 00002000:00100000:1.0:1746065144.097051:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b800 x1830881273218944/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.097058:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b800 with x1830881273218944 ext(0->4095) 00010000:00010000:1.0:1746065144.097063:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.097072:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.097260:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54b800 00000100:00100000:0.0:1746065144.099280:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.099495:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273219072 00000100:00100000:2.0:1746065144.099502:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273219072 00010000:00010000:2.0:1746065144.099528:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065144.099564:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14804 00000100:00100000:2.0:1746065144.099571:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5945450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273219072:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065144.099584:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065144.099599:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.099609:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.099627:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f880ab2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a23 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.099651:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.099653:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.099658:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.099664:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.099696:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065144.099705:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267813888:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065144.099776:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.102650:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267813888:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065144.102667:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.102703:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5945450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273219072:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3132us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.102712:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14804 00000100:00100000:0.0:1746065144.103206:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.103313:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273219328 00000100:00100000:1.0:1746065144.103319:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273219328 00002000:00100000:1.0:1746065144.103348:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d511500 x1830881273219328/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.103357:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d511500 with x1830881273219328 ext(0->4095) 00002000:00010000:1.0:1746065144.103360:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d511500 00000100:00100000:1.0:1746065144.103381:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13857 00000100:00100000:1.0:1746065144.103387:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2004:x1830881273219328:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065144.103489:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2004:x1830881273219328:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 101us (283us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.103494:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13857 00002000:00100000:1.0:1746065144.103499:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d511500 x1830881273219328/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.103506:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d511500 with x1830881273219328 ext(0->4095) 00002000:00010000:1.0:1746065144.103508:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d511500 00000100:00100000:0.0:1746065144.105626:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.105726:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273219456 00000100:00100000:2.0:1746065144.105732:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273219456 00000100:00100000:2.0:1746065144.105771:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30833 00000100:00100000:2.0:1746065144.105777:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273219456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065144.105788:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.105802:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a31 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.105824:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.105830:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.105831:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.105834:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.105862:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 77 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.105872:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 77 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065144.105900:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267814016:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065144.106605:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e5433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.107484:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267814016:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065144.107503:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 6 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.107514:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc 0) 00000100:00100000:2.0:1746065144.107661:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273219456:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1882us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.107666:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30833 00000100:00100000:0.0:1746065144.107822:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.107979:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273219584 00000100:00100000:3.0:1746065144.107983:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273219584 00010000:00010000:3.0:1746065144.108004:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 78 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.108174:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14805 00000100:00100000:3.0:1746065144.108180:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881273219584:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.108190:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.108272:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 78 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.108284:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 78 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.108301:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072825600/0x392ae0376f880ab9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a2a expref: 78 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.108339:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.108341:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.108346:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.108354:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.108375:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.108384:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267814144:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.108569:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.109937:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267814144:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.109951:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.109991:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+77:2005:x1830881273219584:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1811us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.110000:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14805 00000100:00100000:0.0:1746065144.110393:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.110445:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273219840 00000100:00100000:2.0:1746065144.110451:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273219840 00002000:00100000:2.0:1746065144.110485:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d511f80 x1830881273219840/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.110493:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d511f80 with x1830881273219840 ext(0->4095) 00002000:00010000:2.0:1746065144.110496:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d511f80 00000100:00100000:2.0:1746065144.110701:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13858 00000100:00100000:2.0:1746065144.110708:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273219840:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065144.110801:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273219840:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 93us (408us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065144.110809:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13858 00002000:00100000:2.0:1746065144.110814:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d511f80 x1830881273219840/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.110820:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d511f80 with x1830881273219840 ext(0->4095) 00002000:00010000:2.0:1746065144.110823:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d511f80 00000100:00100000:0.0:1746065144.111167:0:3768:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065144.111177:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267814272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065144.111207:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065144.111374:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267814272 00000100:00100000:1.0:1746065144.111379:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267814272 00000100:00100000:1.0:1746065144.111406:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1746065144.111411:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3768:x1830881267814272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746065144.111423:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 980040512 pending 0 free 3921227776 avail 3689705472 00000100:00100000:1.0:1746065144.111451:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3768:x1830881267814272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.111455:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00080000:0.0:1746065144.111532:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065144.111554:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267814272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065144.113265:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065144.113309:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.113356:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273219968 00000100:00100000:2.0:1746065144.113361:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273219968 00000100:00100000:1.0:1746065144.113364:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273220096 00000100:00100000:1.0:1746065144.113366:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273220096 00000100:00100000:1.0:1746065144.113495:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30834 00000100:00100000:1.0:1746065144.113501:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:1795:x1830881273219968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065144.113513:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.113526:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a38 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.113547:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.113552:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.113554:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.113556:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.113579:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 5 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065144.113583:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30835 00000100:00100000:2.0:1746065144.113589:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1791:x1830881273220096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065144.113589:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 5 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.113595:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065144.113598:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267814400:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065144.113600:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a3f expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.113610:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.113613:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.113617:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.113619:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.113635:0:9560:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 80 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.113648:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 80 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065144.113650:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff770c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065144.113657:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:2.0:1746065144.113675:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1791:x1830881273220096:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 86us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.113679:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30835 00000100:00100000:1.0:1746065144.115132:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267814400:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065144.115148:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 79 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.115158:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd800, rc 0) 00000100:00100000:1.0:1746065144.115187:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1795:x1830881273219968:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1686us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.115193:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30834 00000100:00100000:0.0:1746065144.115324:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.115542:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273220224 00000100:00100000:3.0:1746065144.115547:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273220224 00010000:00010000:3.0:1746065144.115567:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.115662:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14806 00000100:00100000:3.0:1746065144.115668:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273220224:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.115678:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.115693:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.115702:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.115718:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064200/0x392ae0376f880ac0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a31 expref: 6 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.115740:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.115742:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.115747:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 78 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.115754:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 78 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.115774:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 78 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.115784:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 78 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.115801:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267814656:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.115848:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.117109:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267814656:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.117120:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.117139:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273220224:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1471us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.117145:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14806 00000100:00100000:0.0:1746065144.117749:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.117901:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273220480 00000100:00100000:2.0:1746065144.117906:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273220480 00002000:00100000:2.0:1746065144.117932:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d513100 x1830881273220480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.117941:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d513100 with x1830881273220480 ext(0->4095) 00010000:00010000:2.0:1746065144.117947:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.117958:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065144.117963:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d513100 00000100:00100000:1.0:1746065144.118158:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3149 00000100:00100000:1.0:1746065144.118165:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881273220480:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065144.118257:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2005:x1830881273220480:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 93us (508us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.118262:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3149 00002000:00100000:1.0:1746065144.118267:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d513100 x1830881273220480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.118273:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d513100 with x1830881273220480 ext(0->4095) 00010000:00010000:1.0:1746065144.118278:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.118286:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.118291:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d513100 00000100:00100000:0.0:1746065144.120922:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.121246:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273220608 00000100:00100000:1.0:1746065144.121253:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273220608 00000100:00100000:1.0:1746065144.121294:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30836 00000100:00100000:1.0:1746065144.121300:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273220608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065144.121313:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.121328:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a46 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.121348:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065144.121354:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.121360:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065144.121363:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.121480:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.121492:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.121501:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd400, rc 0) 00000100:00100000:1.0:1746065144.122219:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273220608:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 246us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.122228:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30836 00000100:00100000:0.0:1746065144.122615:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.122747:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273220736 00000100:00100000:3.0:1746065144.122751:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273220736 00010000:00010000:3.0:1746065144.122769:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.122795:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14807 00000100:00100000:3.0:1746065144.122800:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2004:x1830881273220736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.122807:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.122820:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.122830:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.122843:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ac7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a38 expref: 79 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.122864:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.122866:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.122872:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.122879:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.122909:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.122919:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.122929:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267814912:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.122990:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.126742:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.126841:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267814912:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065144.126845:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273220992 00010000:00010000:3.0:1746065144.126856:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.126864:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273220992 00000100:00100000:3.0:1746065144.126902:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2004:x1830881273220736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4087us (4273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.126910:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14807 00002000:00100000:1.0:1746065144.126923:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d513b80 x1830881273220992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.126939:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d513b80 with x1830881273220992 ext(0->4095) 00010000:00010000:1.0:1746065144.126947:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.126983:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.126992:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d513b80 00000100:00100000:1.0:1746065144.127016:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3150 00000100:00100000:1.0:1746065144.127021:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881273220992:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065144.127135:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881273220992:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 113us (411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.127161:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3150 00002000:00100000:1.0:1746065144.127167:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d513b80 x1830881273220992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.127173:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d513b80 with x1830881273220992 ext(0->4095) 00010000:00010000:1.0:1746065144.127234:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.127268:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.127274:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d513b80 00000100:00100000:0.0:1746065144.128898:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.129043:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273221120 00000100:00100000:3.0:1746065144.129051:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273221120 00010000:00010000:3.0:1746065144.129074:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.129341:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14808 00000100:00100000:3.0:1746065144.129349:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d510a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2002:x1830881273221120:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.129362:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.129377:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.129389:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.129407:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880ace lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a3f expref: 78 pid: 9560 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.129431:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.129433:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.129440:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.129448:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.129479:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.129490:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267815040:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065144.129838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.130078:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.130169:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273221248 00000100:00100000:0.0:1746065144.130174:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273221248 00000100:00100000:0.0:1746065144.130629:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30837 00000100:00100000:0.0:1746065144.130636:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:1791:x1830881273221248:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746065144.130647:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.130656:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a4d expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.130673:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.130678:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065144.130679:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065144.130682:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 79 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.130698:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.130712:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 5 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065144.130720:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267815168:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065144.130761:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b18310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.132319:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dffdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267815168:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065144.132337:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 79 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.132348:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072825a00, rc 0) 00000100:00100000:2.0:1746065144.132378:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1791:x1830881273221248:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1742us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.132385:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30837 00000100:00100000:0.0:1746065144.132525:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.132596:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267815040:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.132606:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.132627:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d510a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2002:x1830881273221120:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3279us (3742us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.132636:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14808 00000100:00100000:2.0:1746065144.133072:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273221504 00000100:00100000:2.0:1746065144.133077:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273221504 00002000:00100000:2.0:1746065144.133216:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffdc00 x1830881273221504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.133224:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffdc00 with x1830881273221504 ext(0->4095) 00010000:00010000:2.0:1746065144.133229:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.133239:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065144.133244:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffdc00 00000100:00100000:2.0:1746065144.133320:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3151 00000100:00100000:2.0:1746065144.133327:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273221504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065144.133422:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273221504:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 94us (895us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065144.133427:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3151 00002000:00100000:2.0:1746065144.133432:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88012dffdc00 x1830881273221504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.133439:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dffdc00 with x1830881273221504 ext(0->4095) 00010000:00010000:2.0:1746065144.133443:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.133456:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065144.133461:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dffdc00 00000100:00100000:0.0:1746065144.138401:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.138869:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273221632 00000100:00100000:3.0:1746065144.138877:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273221632 00010000:00010000:3.0:1746065144.138916:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.138955:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14809 00000100:00100000:3.0:1746065144.138962:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273221632:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.138975:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.138990:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.139000:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.139017:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880ad5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a46 expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.139032:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.139034:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.139039:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 77 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.139047:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 77 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.139075:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 77 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.139111:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267815296:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.139190:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.143608:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267815296:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.143626:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065144.143697:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.144028:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273221632:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5064us (5633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.144037:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14809 00000100:00100000:2.0:1746065144.144071:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273221888 00000100:00100000:2.0:1746065144.144077:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273221888 00002000:00100000:2.0:1746065144.144333:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98700 x1830881273221888/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.144342:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98700 with x1830881273221888 ext(0->4095) 00002000:00010000:2.0:1746065144.144345:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98700 00000100:00100000:2.0:1746065144.144369:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13859 00000100:00100000:2.0:1746065144.144374:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881273221888:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065144.144875:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881273221888:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 500us (1179us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065144.144881:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13859 00002000:00100000:2.0:1746065144.144886:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98700 x1830881273221888/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.144904:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98700 with x1830881273221888 ext(0->4095) 00002000:00010000:2.0:1746065144.144907:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98700 00000100:00100000:0.0:1746065144.147840:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.147961:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273222016 00000100:00100000:2.0:1746065144.147969:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273222016 00000100:00100000:2.0:1746065144.148013:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30838 00000100:00100000:2.0:1746065144.148020:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273222016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065144.148040:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.148054:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a54 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.148077:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 77 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.148116:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.148117:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.148121:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.148147:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 77 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.148158:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 77 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065144.148169:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267815424:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065144.148247:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e543d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.150324:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267815424:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065144.150346:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.150359:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065144.150402:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273222016:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2381us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.150412:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30838 00000100:00100000:0.0:1746065144.151566:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.151912:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273222144 00000100:00100000:2.0:1746065144.151919:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273222144 00002000:00100000:2.0:1746065144.151952:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072f99180 x1830881273222144/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 496/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.151961:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99180 with x1830881273222144 ext(0->7) 00010000:00010000:2.0:1746065144.151968:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 78 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.151979:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 78 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065144.151984:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f99180 00000100:00100000:2.0:1746065144.152854:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3152 00000100:00100000:2.0:1746065144.152862:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+78:2005:x1830881273222144:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065144.154011:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881273222144:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 1147us (2445us total) trans 4294972157 rc 0/0 00000100:00100000:0.0:1746065144.154019:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3152 00002000:00100000:0.0:1746065144.154026:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072f99180 x1830881273222144/t4294972157(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 496/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065144.154034:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99180 with x1830881273222144 ext(0->7) 00010000:00010000:0.0:1746065144.154040:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 80 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065144.154051:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 80 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746065144.154056:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f99180 00000100:00100000:0.0:1746065144.157607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.157699:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273222272 00000100:00100000:3.0:1746065144.157707:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273222272 00010000:00010000:3.0:1746065144.157739:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 80 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.157974:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14810 00000100:00100000:3.0:1746065144.157982:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2004:x1830881273222272:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.157994:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.158010:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 80 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.158021:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 80 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.158040:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072825a00/0x392ae0376f880adc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a4d expref: 80 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.158064:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.158107:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.158115:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.158123:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.158205:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.158217:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267815552:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.158291:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.160204:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.160298:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267815552:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.160313:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.160344:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:2004:x1830881273222272:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2363us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.160353:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14810 00000100:00100000:1.0:1746065144.160424:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273222528 00000100:00100000:1.0:1746065144.160430:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273222528 00002000:00100000:1.0:1746065144.160458:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f9b480 x1830881273222528/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.160467:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b480 with x1830881273222528 ext(0->4095) 00002000:00010000:1.0:1746065144.160471:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f9b480 00000100:00100000:1.0:1746065144.160496:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13860 00000100:00100000:1.0:1746065144.160503:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273222528:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065144.160746:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273222528:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 243us (545us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.160753:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13860 00002000:00100000:1.0:1746065144.160758:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f9b480 x1830881273222528/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.160766:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9b480 with x1830881273222528 ext(0->4095) 00002000:00010000:1.0:1746065144.160768:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f9b480 00000100:00100000:0.0:1746065144.163213:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.163310:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273222656 00000100:00100000:2.0:1746065144.163318:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273222656 00000100:00100000:2.0:1746065144.163482:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30839 00000100:00100000:2.0:1746065144.163491:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+79:1795:x1830881273222656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065144.163505:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.163520:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a5b expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.163542:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.163552:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.163554:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.163557:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 80 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.163581:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.163591:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 5 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065144.163600:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267815680:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065144.163679:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e543d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.167458:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267815680:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065144.167482:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 80 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.167497:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064800, rc 0) 00000100:00100000:2.0:1746065144.167621:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:1795:x1830881273222656:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4130us (4414us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.167629:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30839 00000100:00100000:1.0:1746065144.167752:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.167903:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273222784 00000100:00100000:3.0:1746065144.167909:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273222784 00010000:00010000:3.0:1746065144.167931:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.167949:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14811 00000100:00100000:3.0:1746065144.167954:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5945050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273222784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.167964:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.167977:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.167992:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.168010:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064a00/0x392ae0376f880ae3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a54 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.168021:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.168022:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.168028:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 79 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.168035:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 79 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.168058:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 79 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.168068:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267815808:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.168507:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.170666:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267815808:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.170684:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.170727:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5945050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273222784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2771us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.170736:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14811 00000100:00100000:0.0:1746065144.183489:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.183591:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273223040 00000100:00100000:1.0:1746065144.183601:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273223040 00002000:00100000:1.0:1746065144.183641:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98a80 x1830881273223040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.183652:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98a80 with x1830881273223040 ext(0->4095) 00002000:00010000:1.0:1746065144.183658:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98a80 00000100:00100000:1.0:1746065144.183693:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13861 00000100:00100000:1.0:1746065144.183701:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881273223040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065144.183840:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2005:x1830881273223040:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 139us (358us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.183846:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13861 00002000:00100000:1.0:1746065144.183851:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff880072f98a80 x1830881273223040/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.183858:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98a80 with x1830881273223040 ext(0->4095) 00002000:00010000:1.0:1746065144.183861:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98a80 00000100:00100000:0.0:1746065144.192233:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.193232:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273223168 00000100:00100000:2.0:1746065144.193240:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273223168 00000100:00100000:2.0:1746065144.193294:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30840 00000100:00100000:2.0:1746065144.193301:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273223168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065144.193319:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.193333:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a62 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.193358:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 79 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.193365:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.193367:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.193370:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.193394:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 79 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.193405:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 79 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065144.193415:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267815936:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065144.193497:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e543d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.211535:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267815936:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065144.211563:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.211579:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:2.0:1746065144.211619:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273223168:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 18317us (19393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.211630:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30840 00000100:00100000:0.0:1746065144.212201:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.212267:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273223296 00000100:00100000:2.0:1746065144.212273:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273223296 00002000:00100000:2.0:1746065144.212304:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072f9aa00 x1830881273223296/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 496/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.212311:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9aa00 with x1830881273223296 ext(0->7) 00010000:00010000:2.0:1746065144.212316:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 80 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.212326:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 80 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065144.212332:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f9aa00 00000100:00100000:2.0:1746065144.212357:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3153 00000100:00100000:2.0:1746065144.212362:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+80:2003:x1830881273223296:12345-192.168.202.8@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746065144.213123:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2003:x1830881273223296:12345-192.168.202.8@tcp:4:ldlm_bl.0 Request processed in 759us (921us total) trans 4294972158 rc 0/0 00000100:00100000:0.0:1746065144.213129:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3153 00002000:00100000:0.0:1746065144.213134:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->7) req@ffff880072f9aa00 x1830881273223296/t4294972158(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 496/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065144.213142:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9aa00 with x1830881273223296 ext(0->7) 00010000:00010000:0.0:1746065144.213146:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065144.213154:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746065144.213160:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880072f9aa00 00000100:00100000:0.0:1746065144.217969:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.218065:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273223424 00000100:00100000:3.0:1746065144.218074:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273223424 00010000:00010000:3.0:1746065144.218133:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.218166:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14812 00000100:00100000:3.0:1746065144.218173:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881273223424:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.218186:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.218201:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.218212:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.218231:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091064800/0x392ae0376f880aea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a5b expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.218254:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.218256:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.218264:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.218272:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.218299:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.218309:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267816064:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.218383:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.220661:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267816064:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.220680:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.220730:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:2004:x1830881273223424:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2556us (2767us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.220739:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14812 00000100:00100000:0.0:1746065144.221697:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.221754:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273223680 00000100:00100000:2.0:1746065144.221760:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273223680 00002000:00100000:2.0:1746065144.221788:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c1500 x1830881273223680/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.221797:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1500 with x1830881273223680 ext(0->4095) 00002000:00010000:2.0:1746065144.221800:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c1500 00000100:00100000:1.0:1746065144.222948:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13862 00000100:00100000:1.0:1746065144.222958:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273223680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065144.223070:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273223680:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 114us (1374us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.223076:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13862 00002000:00100000:1.0:1746065144.223098:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009f7c1500 x1830881273223680/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.223105:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c1500 with x1830881273223680 ext(0->4095) 00002000:00010000:1.0:1746065144.223108:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c1500 00000100:00100000:0.0:1746065144.226277:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.226824:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273223808 00000100:00100000:2.0:1746065144.226832:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273223808 00000100:00100000:0.0:1746065144.226834:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.226900:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273223936 00000100:00100000:1.0:1746065144.226906:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273223936 00000100:00100000:2.0:1746065144.226941:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30841 00000100:00100000:1.0:1746065144.226945:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30842 00000100:00100000:2.0:1746065144.226947:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881273223808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:1.0:1746065144.226949:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881273223936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065144.226986:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.227000:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a69 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.227023:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.227029:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.227031:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.227033:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 83 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.227062:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.227070:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.227073:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 5 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065144.227076:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a70 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065144.227102:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267816192:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065144.227111:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065144.227115:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 84 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.227122:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065144.227125:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.227142:0:9558:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 84 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.227153:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.227161:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:2.0:1746065144.227167:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e543d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.227180:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1795:x1830881273223936:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 230us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.227185:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30842 00000100:00100000:2.0:1746065144.228505:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267816192:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065144.228522:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 83 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.228532:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065144.228554:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1791:x1830881273223808:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1608us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.228563:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30841 00000100:00100000:0.0:1746065144.229547:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.229619:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273224064 00000100:00100000:3.0:1746065144.229625:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273224064 00010000:00010000:3.0:1746065144.229647:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.229670:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14813 00000100:00100000:3.0:1746065144.229674:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273224064:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.229682:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.229693:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.229700:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.229716:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880af1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a62 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.229738:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.229740:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.229745:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.229752:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.229775:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.229784:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.229794:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267816448:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.229846:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.231610:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267816448:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.231625:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.231652:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273224064:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1976us (2107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.231661:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14813 00000100:00100000:3.0:1746065144.232925:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.232996:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273224320 00000100:00100000:2.0:1746065144.233002:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273224320 00002000:00100000:2.0:1746065144.233034:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b100 x1830881273224320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.233042:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b100 with x1830881273224320 ext(0->4095) 00010000:00010000:2.0:1746065144.233049:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.233061:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065144.233066:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54b100 00000100:00100000:2.0:1746065144.233118:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3154 00000100:00100000:2.0:1746065144.233124:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273224320:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746065144.233409:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273224320:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 284us (485us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065144.233414:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3154 00002000:00100000:2.0:1746065144.233419:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d54b100 x1830881273224320/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.233426:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b100 with x1830881273224320 ext(0->4095) 00010000:00010000:2.0:1746065144.233431:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065144.233450:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065144.233455:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d54b100 00000100:00100000:0.0:1746065144.236590:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.237378:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273224448 00000100:00100000:3.0:1746065144.237387:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273224448 00010000:00010000:3.0:1746065144.237417:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.238031:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14814 00000100:00100000:3.0:1746065144.238042:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273224448:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.238054:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.238070:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.238516:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.238536:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065600/0x392ae0376f880af8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a69 expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.238560:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.238562:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.238568:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.238575:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.238601:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.238611:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267816576:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.238685:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.242951:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.243012:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273224704 00000100:00100000:1.0:1746065144.243019:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273224704 00002000:00100000:1.0:1746065144.243053:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fd880 x1830881273224704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.243062:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fd880 with x1830881273224704 ext(0->4095) 00002000:00010000:1.0:1746065144.243067:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fd880 00000100:00100000:1.0:1746065144.243118:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13863 00000100:00100000:1.0:1746065144.243125:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273224704:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00010000:00010000:0.0:1746065144.243199:0:8891:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065144.243226:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273224704:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 101us (282us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.243231:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13863 00002000:00100000:1.0:1746065144.243236:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fd880 x1830881273224704/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.243243:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fd880 with x1830881273224704 ext(0->4095) 00002000:00010000:1.0:1746065144.243246:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a09fd880 00000100:00100000:3.0:1746065144.243349:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267816576:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.243363:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.243398:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881273224448:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5359us (6815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.243405:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14814 00000100:00100000:0.0:1746065144.246524:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.246644:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273224832 00000100:00100000:2.0:1746065144.246651:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273224832 00000100:00100000:2.0:1746065144.246687:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30843 00000100:00100000:2.0:1746065144.246694:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273224832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065144.246708:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.246722:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a77 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.246744:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.246751:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.246752:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.246755:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.246780:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 81 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.246919:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 81 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065144.246930:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267816704:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065144.247197:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e543d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.249122:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267816704:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065144.249146:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.249160:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065e00, rc 0) 00000100:00100000:2.0:1746065144.249193:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273224832:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2499us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.249200:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30843 00000100:00100000:0.0:1746065144.250744:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.250831:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273224960 00000100:00100000:3.0:1746065144.250838:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273224960 00010000:00010000:3.0:1746065144.250862:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 82 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.250903:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14815 00000100:00100000:3.0:1746065144.250910:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881273224960:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.250920:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.250936:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 82 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.250946:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 82 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.250963:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800726f0600/0x392ae0376f880aff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a70 expref: 82 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.250989:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.250991:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.250996:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.251003:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.251027:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.251038:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267816832:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.251125:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.255124:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.255164:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.255184:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273225344 00000100:00100000:2.0:1746065144.255190:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273225344 00000100:00100000:0.0:1746065144.255271:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273225216 00000100:00100000:0.0:1746065144.255275:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273225216 00002000:00100000:0.0:1746065144.255302:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b480 x1830881273225216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065144.255311:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b480 with x1830881273225216 ext(0->4095) 00002000:00010000:0.0:1746065144.255315:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077b480 00000100:00100000:3.0:1746065144.255408:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267816832:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.255423:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.255456:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881273224960:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4546us (4715us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.255464:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14815 00000100:00100000:2.0:1746065144.255589:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30844 00000100:00100000:2.0:1746065144.255596:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+81:1791:x1830881273225344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065144.255606:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.255618:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a7e expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.255640:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.255647:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.255648:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.255652:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.255681:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.255691:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065144.255700:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267816960:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065144.255740:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e543d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.256399:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3155 00000100:00100000:0.0:1746065144.256411:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273225216:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065144.256928:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273225216:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 520us (1809us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.256935:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3155 00002000:00100000:1.0:1746065144.256942:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88013077b480 x1830881273225216/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.256949:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b480 with x1830881273225216 ext(0->4095) 00010000:00010000:1.0:1746065144.256955:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.256965:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.256971:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013077b480 00000100:00100000:2.0:1746065144.258195:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267816960:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065144.258213:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.258224:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065400, rc 0) 00000100:00100000:2.0:1746065144.258246:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881273225344:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2651us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.258251:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30844 00000100:00100000:0.0:1746065144.260338:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.260670:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273225472 00000100:00100000:2.0:1746065144.260678:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273225472 00000100:00100000:2.0:1746065144.260904:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30845 00000100:00100000:2.0:1746065144.260911:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1795:x1830881273225472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746065144.260926:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.260940:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a85 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.260960:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.260965:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 83 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.260971:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.260974:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 83 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.261001:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 83 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.261011:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 83 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.261020:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065200, rc 0) 00000100:00100000:2.0:1746065144.261054:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1795:x1830881273225472:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 143us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.261059:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30845 00000100:00100000:0.0:1746065144.261351:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.261434:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273225600 00000100:00100000:3.0:1746065144.261438:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273225600 00010000:00010000:3.0:1746065144.261453:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.261467:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14816 00000100:00100000:3.0:1746065144.261471:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273225600:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.261478:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.261491:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.261500:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.261512:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065e00/0x392ae0376f880b06 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a77 expref: 6 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.261524:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.261525:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.261530:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.261535:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.261563:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.261572:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.261581:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267817216:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.261627:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.266032:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.266620:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267817216:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.266636:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.266684:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273225600:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5211us (5333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.266693:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14816 00000100:00100000:1.0:1746065144.267048:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273225856 00000100:00100000:1.0:1746065144.267054:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273225856 00002000:00100000:1.0:1746065144.267101:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb96680 x1830881273225856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.267111:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb96680 with x1830881273225856 ext(0->4095) 00010000:00010000:1.0:1746065144.267117:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.267129:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.267135:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb96680 00000100:00100000:1.0:1746065144.267161:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3156 00000100:00100000:1.0:1746065144.267168:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273225856:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746065144.267263:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273225856:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 96us (1237us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.267268:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3156 00002000:00100000:1.0:1746065144.267273:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88008fb96680 x1830881273225856/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.267279:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb96680 with x1830881273225856 ext(0->4095) 00010000:00010000:1.0:1746065144.267283:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.267291:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.267296:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb96680 00000100:00100000:0.0:1746065144.270184:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.270789:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273225984 00000100:00100000:3.0:1746065144.270799:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273225984 00010000:00010000:3.0:1746065144.270828:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.270918:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14817 00000100:00100000:3.0:1746065144.270926:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881273225984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.270939:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.270955:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.270966:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.270984:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065400/0x392ae0376f880b0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a7e expref: 83 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.271283:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.271285:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.271292:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.271300:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.271328:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.271338:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267817344:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.271728:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.274038:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.274243:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273226240 00000100:00100000:2.0:1746065144.274249:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273226240 00002000:00100000:2.0:1746065144.274278:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc13800 x1830881273226240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.274287:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc13800 with x1830881273226240 ext(0->4095) 00002000:00010000:2.0:1746065144.274291:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc13800 00000100:00100000:2.0:1746065144.274310:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13865 00000100:00100000:2.0:1746065144.274316:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881273226240:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746065144.274416:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881273226240:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (383us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065144.274425:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13865 00002000:00100000:2.0:1746065144.274431:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009dc13800 x1830881273226240/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746065144.274437:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc13800 with x1830881273226240 ext(0->4095) 00002000:00010000:2.0:1746065144.274440:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc13800 00000100:00100000:3.0:1746065144.274773:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267817344:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.274788:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.274811:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881273225984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3886us (4634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.274817:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14817 00000100:00100000:0.0:1746065144.276782:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.276916:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273226368 00000100:00100000:1.0:1746065144.276923:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273226368 00000100:00100000:1.0:1746065144.277439:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30846 00000100:00100000:1.0:1746065144.277446:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:1795:x1830881273226368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065144.277459:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.277472:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a8c expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.277495:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.277502:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065144.277504:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065144.277506:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.277531:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 81 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.277541:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 81 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065144.277551:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267817472:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065144.277621:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065144.280308:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267817472:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065144.280331:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 6 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.280348:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd400, rc 0) 00000100:00100000:1.0:1746065144.280381:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:1795:x1830881273226368:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2935us (3604us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.280388:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30846 00000100:00100000:0.0:1746065144.282323:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.282385:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273226496 00000100:00100000:3.0:1746065144.282393:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273226496 00010000:00010000:3.0:1746065144.282419:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.282458:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14818 00000100:00100000:3.0:1746065144.282464:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5944c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2004:x1830881273226496:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.282474:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.282489:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.282499:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.282515:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091065200/0x392ae0376f880b14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a85 expref: 82 pid: 9635 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.282539:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.282541:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.282547:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.282553:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.282579:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.282589:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267817600:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.282661:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.284979:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.285512:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273226624 00000100:00100000:1.0:1746065144.285520:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273226624 00000100:00100000:1.0:1746065144.285564:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30847 00000100:00100000:1.0:1746065144.285570:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:1791:x1830881273226624:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746065144.285584:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.285597:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a93 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.285618:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.285624:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.285626:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.285629:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.285653:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 5 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.285663:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 5 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065144.285678:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267817728:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065144.285993:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.286335:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.286434:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267817600:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.286445:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.286470:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5944c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2004:x1830881273226496:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4006us (4152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.286478:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14818 00000100:00100000:1.0:1746065144.286658:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273226880 00000100:00100000:1.0:1746065144.286662:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273226880 00002000:00100000:1.0:1746065144.286686:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a3b80 x1830881273226880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.286694:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3b80 with x1830881273226880 ext(0->4095) 00010000:00010000:1.0:1746065144.286700:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.286710:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.286715:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a3b80 00000100:00100000:1.0:1746065144.287104:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3157 00000100:00100000:1.0:1746065144.287112:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273226880:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746065144.287211:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273226880:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 99us (875us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.287217:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3157 00002000:00100000:1.0:1746065144.287221:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009d5a3b80 x1830881273226880/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.287228:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d5a3b80 with x1830881273226880 ext(0->4095) 00010000:00010000:1.0:1746065144.287233:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065144.287242:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065144.287247:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d5a3b80 00000100:00100000:0.0:1746065144.289965:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.290121:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273227008 00000100:00100000:3.0:1746065144.290128:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273227008 00000100:00100000:3.0:1746065144.290173:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30848 00000100:00100000:3.0:1746065144.290179:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1795:x1830881273227008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746065144.290192:0:9635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.290205:0:9635:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6a9a expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.290224:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.290229:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.290234:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065144.290237:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 84 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.290263:0:9635:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 84 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.290272:0:9635:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 84 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.290280:0:9635:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:3.0:1746065144.290311:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+84:1795:x1830881273227008:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 132us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.290316:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30848 00000100:00100000:1.0:1746065144.290856:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801306f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267817728:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065144.290872:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 83 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.290881:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd000, rc 0) 00000100:00100000:1.0:1746065144.290914:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:1791:x1830881273226624:12345-192.168.202.8@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5344us (5941us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.290919:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30847 00000100:00100000:0.0:1746065144.292214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.292282:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273227136 00000100:00100000:3.0:1746065144.292287:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273227136 00010000:00010000:3.0:1746065144.292309:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.292340:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14819 00000100:00100000:3.0:1746065144.292346:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273227136:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.292356:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.292371:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.292381:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.292399:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd400/0x392ae0376f880b1b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a8c expref: 6 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.292422:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.292424:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.292430:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.292436:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.292465:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 82 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.292475:0:8359:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 82 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.292486:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267817984:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.293230:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6358c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.295224:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267817984:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.295247:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.295282:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2005:x1830881273227136:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2936us (3070us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.295291:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14819 00000100:00100000:0.0:1746065144.295865:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.296346:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273227392 00000100:00100000:3.0:1746065144.296352:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273227392 00002000:00100000:3.0:1746065144.296384:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fdf80 x1830881273227392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065144.296394:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fdf80 with x1830881273227392 ext(0->4095) 00010000:00010000:3.0:1746065144.296401:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 83 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.296413:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 83 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746065144.296419:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09fdf80 00000100:00100000:3.0:1746065144.296452:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3158 00000100:00100000:3.0:1746065144.296459:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273227392:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065144.296557:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273227392:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 99us (693us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065144.296563:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3158 00002000:00100000:3.0:1746065144.296568:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff8800a09fdf80 x1830881273227392/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065144.296574:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a09fdf80 with x1830881273227392 ext(0->4095) 00010000:00010000:3.0:1746065144.296578:0:27164:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 83 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.296587:0:27164:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 83 pid: 9558 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746065144.296592:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a09fdf80 00000100:00100000:0.0:1746065144.299527:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.299609:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273227520 00000100:00100000:3.0:1746065144.299616:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273227520 00010000:00010000:3.0:1746065144.299644:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 83 pid: 9558 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065144.299680:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14820 00000100:00100000:3.0:1746065144.299687:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273227520:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.299698:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.299712:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 83 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.299726:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 83 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.299744:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ddfd000/0x392ae0376f880b22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a93 expref: 83 pid: 9558 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065144.299759:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.299761:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.299766:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.299774:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.299801:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 82 pid: 9635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.299812:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267818112:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065144.300383:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b63589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.304754:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.304845:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267818112:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065144.304862:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.305004:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273227776 00000100:00100000:1.0:1746065144.305010:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273227776 00002000:00100000:1.0:1746065144.305046:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ea00 x1830881273227776/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.305056:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ea00 with x1830881273227776 ext(0->4095) 00002000:00010000:1.0:1746065144.305060:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ea00 00000100:00100000:1.0:1746065144.305118:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13866 00000100:00100000:1.0:1746065144.305125:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273227776:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065144.305388:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+83:2005:x1830881273227520:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5700us (5864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.305396:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14820 00000100:00100000:1.0:1746065144.305984:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+82:2005:x1830881273227776:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 858us (1237us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.305990:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13866 00002000:00100000:1.0:1746065144.305997:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x19:0x0] (0->4095) req@ffff88009eb1ea00 x1830881273227776/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746065144.306004:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb1ea00 with x1830881273227776 ext(0->4095) 00002000:00010000:1.0:1746065144.306007:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb1ea00 00000100:00100000:0.0:1746065144.318295:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065144.318374:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273228032 00000100:00100000:1.0:1746065144.318385:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273228032 00000100:00100000:1.0:1746065144.318470:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 190 00000100:00100000:1.0:1746065144.318478:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:1791:x1830881273228032:12345-192.168.202.8@tcp:35:rw_seq_cst_vs_d.0 00000001:00080000:1.0:1746065144.318679:0:20704:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294983589 00000100:00100000:1.0:1746065144.318776:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:1791:x1830881273228032:12345-192.168.202.8@tcp:35:rw_seq_cst_vs_d.0 Request processed in 298us (492us total) trans 4294983590 rc 0/0 00000100:00100000:1.0:1746065144.318782:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 190 00000020:00080000:1.0:1746065144.318787:0:20704:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1746065144.318998:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065144.323402:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.323568:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273228288 00000100:00100000:2.0:1746065144.323576:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273228288 00000100:00100000:2.0:1746065144.323631:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 191 00000100:00100000:2.0:1746065144.323638:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:1791:x1830881273228288:12345-192.168.202.8@tcp:35:rw_seq_cst_vs_d.0 00000100:00080000:0.0:1746065144.324446:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065144.324895:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007253d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:1791:x1830881273228288:12345-192.168.202.8@tcp:35:rw_seq_cst_vs_d.0 Request processed in 161us (406us total) trans 4294983591 rc 0/0 00000100:00100000:2.0:1746065144.324903:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 191 00000100:00100000:0.0:1746065144.358039:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065144.358324:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273228416 00000100:00100000:2.0:1746065144.358332:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273228416 00000100:00100000:2.0:1746065144.358383:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36515 00000100:00100000:2.0:1746065144.358390:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:1812:x1830881273228416:12345-192.168.202.8@tcp:101:rm.0 00010000:00010000:2.0:1746065144.358411:0:8367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.358426:0:8367:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065800/0x392ae0376f880b30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6aa1 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.358473:0:8367:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880b37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8367 initiator: MDT0 00010000:00010000:2.0:1746065144.358482:0:8367:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880b37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8367 initiator: MDT0 00010000:00010000:2.0:1746065144.358495:0:8367:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880b37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8367 initiator: MDT0 00000004:00200000:2.0:1746065144.358527:0:8367:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1746065144.358530:0:8367:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065144.358542:0:8367:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880b37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8367 initiator: MDT0 00010000:00010000:2.0:1746065144.358558:0:8367:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065800/0x392ae0376f880b30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aa1 expref: 10 pid: 8367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.358575:0:8367:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880b37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aa1 expref: 9 pid: 8367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.358582:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065144.358584:0:8367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065144.358586:0:8367:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064a00, rc 0) 00000100:00100000:2.0:1746065144.358637:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1812:x1830881273228416:12345-192.168.202.8@tcp:101:rm.0 Request processed in 247us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.358643:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36515 00000100:00100000:1.0:1746065144.363276:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.363368:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273228544 00000100:00100000:3.0:1746065144.363376:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273228544 00000100:00100000:3.0:1746065144.363423:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36516 00000100:00100000:3.0:1746065144.363431:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1812:x1830881273228544:12345-192.168.202.8@tcp:101:rm.0 00010000:00010000:3.0:1746065144.363447:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.363461:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x392ae0376f880b3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6aa8 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.363508:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363518:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363527:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363538:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363543:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363548:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363602:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x392ae0376f880b53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363609:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x392ae0376f880b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363615:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x392ae0376f880b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:3.0:1746065144.363647:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x43:0x0]: returning size 8 00000004:00200000:3.0:1746065144.363651:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065144.363662:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x392ae0376f880b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363671:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x392ae0376f880b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363677:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363682:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363687:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363692:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363697:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065144.363699:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363705:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363714:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065144.363717:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065144.363720:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.363724:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x392ae0376f880b45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.364368:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.364375:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.364379:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.364383:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10a00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065144.364385:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.364390:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.364397:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf0ce3da1 (ffff880131263f00) 00010000:00010000:3.0:1746065144.364399:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065144.364401:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.364406:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.364428:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x392ae0376f880b3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aa8 expref: 11 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.364438:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x392ae0376f880b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aa8 expref: 10 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.364444:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x43:0x0].0x0 (ffff88009fe2fc00) 00010000:00010000:3.0:1746065144.364445:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065144.364447:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065144.364772:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:1812:x1830881273228544:12345-192.168.202.8@tcp:101:rm.0 Request processed in 1341us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.364779:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36516 00000100:00100000:0.0:1746065144.367716:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065144.367808:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273228800 00000100:00100000:3.0:1746065144.367815:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273228800 00000100:00100000:3.0:1746065144.367862:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36517 00000100:00100000:3.0:1746065144.367870:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:1812:x1830881273228800:12345-192.168.202.8@tcp:36:rm.0 00010000:00010000:3.0:1746065144.367922:0:7211:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746065144.367941:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x392ae0376f880b53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aa8 expref: 10 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.368256:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11400/0x392ae0376f87d7cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x43:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e3747 expref: 9 pid: 11924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.368265:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x43:0x0].0x0 (ffff88009fe2fc00) 00010000:00010000:3.0:1746065144.368273:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880b37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aa1 expref: 8 pid: 8367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.368279:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065144.368281:0:7211:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065144.368299:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368308:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368316:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368326:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368335:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368340:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368399:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x392ae0376f880b68 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368405:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x392ae0376f880b68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368410:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x392ae0376f880b68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000040:00080000:3.0:1746065144.368564:0:7211:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 64 off9024 00000004:00080000:3.0:1746065144.368570:0:7211:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743488488772ns, next at 744488487760ns, rc = 0 00010000:00010000:3.0:1746065144.368601:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368608:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368614:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368619:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368623:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368628:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368653:0:7211:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065144.368665:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x392ae0376f880b68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368670:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x392ae0376f880b68 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368675:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x392ae0376f880b68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368680:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10e00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065144.368683:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x392ae0376f880b68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065144.368686:0:7202:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065144.368688:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x392ae0376f880b68 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065144.368692:0:7202:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368694:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x43:0x0].0x0 (ffff88009fe2fc00) 00010000:00010000:3.0:1746065144.368696:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065144.368698:0:7202:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10a00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065144.368699:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x392ae0376f880b68 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065144.368701:0:7202:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368703:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x392ae0376f880b68 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x43:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065144.368706:0:7202:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065144.368719:0:7202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x43:0x0].0x0 (ffff88009fe2fc00) 00010000:00010000:2.0:1746065144.368721:0:7202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065144.368723:0:7202:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065144.368728:0:7202:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880b6f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065144.368740:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065144.368742:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065144.368743:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065144.368774:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368779:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368783:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368790:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368793:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065144.368795:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368799:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368806:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065144.368807:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065144.368810:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368814:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b5a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00000004:00010000:3.0:1746065144.368820:0:7211:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008fb97480 reply state ffff88012df51000 transno 4294983592 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368827:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065144.368832:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf0ce3da1 (ffff880131263600) 00010000:00010000:3.0:1746065144.368833:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065144.369231:0:7211:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065144.369290:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:1812:x1830881273228800:12345-192.168.202.8@tcp:36:rm.0 Request processed in 1420us (1579us total) trans 4294983592 rc 0/0 00000100:00100000:3.0:1746065144.369297:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36517 00000100:00100000:0.0:1746065144.377623:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065144.377663:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065144.377692:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065144.377722:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065144.377746:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065144.377778:0:7208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273228928 00000100:00100000:0.0:1746065144.377785:0:7208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273228928 00000100:00100000:0.0:1746065144.377818:0:7208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 563 00000100:00100000:0.0:1746065144.377824:0:7208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70506d4b-f74d-460b-a2d0-0f9fd3b6e38b+12:2004:x1830881273228928:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065144.377871:0:7208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70506d4b-f74d-460b-a2d0-0f9fd3b6e38b+12:2004:x1830881273228928:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.377876:0:7208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 563 00000100:00100000:3.0:1746065144.378253:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273229056 00000100:00100000:3.0:1746065144.378257:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273229056 00000100:00100000:3.0:1746065144.378296:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273229312 00000100:00100000:3.0:1746065144.378299:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273229312 00000100:00100000:3.0:1746065144.378322:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1193 00000100:00100000:3.0:1746065144.378326:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2004:x1830881273229056:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065144.378359:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2004:x1830881273229056:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 33us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.378370:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1193 00000100:00100000:3.0:1746065144.378382:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1194 00000100:00100000:3.0:1746065144.378386:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273229312:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065144.378410:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273229312:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 23us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.378414:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1194 00000100:00080000:0.0:1746065144.378685:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065144.378701:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273229440 00000100:00100000:0.0:1746065144.378703:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273229440 00000100:00100000:0.0:1746065144.378725:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273229184 00000100:00100000:0.0:1746065144.378733:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273229184 00000100:00100000:2.0:1746065144.378759:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30849 00000100:00100000:2.0:1746065144.378766:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2001:x1830881273229440:12345-192.168.202.8@tcp:9:kworker.0 00000020:00000080:2.0:1746065144.378784:0:9635:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x392ae0376f788035 00000100:00080000:2.0:1746065144.378789:0:9635:0:(import.c:66:import_set_state_nolock()) ffff880072973800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065144.378819:0:9635:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294970735 00010000:00010000:3.0:1746065144.378883:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065144.378908:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+2:2001:x1830881273229440:12345-192.168.202.8@tcp:9:kworker.0 Request processed in 142us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.378913:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30849 00000100:00080000:1.0:1746065144.379001:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065144.381155:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 825 00000100:00100000:1.0:1746065144.381165:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2004:x1830881273229184:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1746065144.381700:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2004:x1830881273229184:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 536us (3951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.381707:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 825 00010000:00010000:2.0:1746065145.246581:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1746065145.607952:0:10896:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294972158 is committed 00010000:00010000:1.0:1746065146.247215:0:8891:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065147.263776:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065147.615332:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267818496:0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615383:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.615426:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3766:1830881267819008:0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615443:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.615453:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3766:1830881267819520:0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615464:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.615479:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1746065147.615483:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3766:1830881267818368:0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615493:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.615501:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3766:1830881267818880:0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615510:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.615517:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3766:1830881267819392:0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615526:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.615545:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267819008 00000100:00100000:2.0:1746065147.615550:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267819008 00000100:00100000:2.0:1746065147.615579:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267819520 00000100:00100000:2.0:1746065147.615580:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267819520 00000100:00100000:2.0:1746065147.615589:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267818368 00000100:00100000:2.0:1746065147.615590:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267818368 00000100:00100000:2.0:1746065147.615596:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267818880 00000100:00100000:2.0:1746065147.615597:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267818880 00000100:00100000:2.0:1746065147.615603:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267819392 00000100:00100000:2.0:1746065147.615604:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267819392 00000100:00100000:2.0:1746065147.615612:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1746065147.615617:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3766:x1830881267819008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615646:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3766:x1830881267819008:12345-0@lo:400:kworker.0 Request processed in 29us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.615651:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1746065147.615660:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1746065147.615663:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3766:x1830881267819520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615675:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3766:x1830881267819520:12345-0@lo:400:kworker.0 Request processed in 12us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.615679:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1746065147.615684:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1746065147.615688:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3766:x1830881267818368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615701:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3766:x1830881267818368:12345-0@lo:400:kworker.0 Request processed in 13us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.615705:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1746065147.615710:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1746065147.615713:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3766:x1830881267818880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615724:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3766:x1830881267818880:12345-0@lo:400:kworker.0 Request processed in 11us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.615728:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1746065147.615732:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1746065147.615735:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3766:x1830881267819392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615746:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3766:x1830881267819392:12345-0@lo:400:kworker.0 Request processed in 11us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.615749:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1746065147.615772:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3766:1830881267818368:0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615778:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3766:1830881267818880:0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615783:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3766:1830881267819392:0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615788:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3766:1830881267819008:0@lo:400:kworker.0 00000100:00100000:2.0:1746065147.615793:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3766:1830881267819520:0@lo:400:kworker.0 00000100:00100000:1.0:1746065147.616023:0:8658:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267818496 00000100:00100000:1.0:1746065147.616027:0:8658:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267818496 00000100:00100000:1.0:1746065147.616048:0:8658:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1746065147.616052:0:8658:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3766:x1830881267818496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065147.616102:0:8658:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3766:x1830881267818496:12345-0@lo:400:kworker.0 Request processed in 49us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.616108:0:8658:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00080000:1.0:1746065147.616122:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746065147.616124:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746065147.616189:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830881267818624:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616212:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.616234:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267819136:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616252:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.616264:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267819648:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616276:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.616287:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746065147.616291:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c4d7531-7474-4559-997c-c1b3824c301a:3767:1830881267818240:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616309:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.616331:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267818752:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616347:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.616358:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267819264:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616372:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.616382:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267819776:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616396:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.616416:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267818240 00000100:00100000:3.0:1746065147.616419:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267818240 00000100:00100000:3.0:1746065147.616438:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1746065147.616442:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3767:x1830881267818240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616465:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3767:x1830881267818240:12345-0@lo:400:kworker.0 Request processed in 23us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.616470:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1746065147.616489:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267819136 00000100:00100000:3.0:1746065147.616492:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267819136 00000100:00100000:3.0:1746065147.616510:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267819648 00000100:00100000:3.0:1746065147.616512:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267819648 00000100:00100000:3.0:1746065147.616522:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267819264 00000100:00100000:3.0:1746065147.616524:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267819264 00000100:00100000:3.0:1746065147.616531:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267819776 00000100:00100000:3.0:1746065147.616532:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267819776 00000100:00100000:3.0:1746065147.616541:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1746065147.616545:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267819136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616566:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267819136:12345-0@lo:400:kworker.0 Request processed in 21us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.616571:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1746065147.616579:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1746065147.616583:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267819648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616610:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267819648:12345-0@lo:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.616617:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1746065147.616624:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1746065147.616628:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267819264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616648:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267819264:12345-0@lo:400:kworker.0 Request processed in 19us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.616652:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1746065147.616660:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:3.0:1746065147.616664:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267819776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616680:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267819776:12345-0@lo:400:kworker.0 Request processed in 16us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.616684:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00080000:3.0:1746065147.616696:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746065147.616698:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065147.616709:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c4d7531-7474-4559-997c-c1b3824c301a:3767:1830881267818240:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616718:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267819264:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616724:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267819776:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616731:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267819136:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.616737:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267819648:0@lo:400:kworker.0 00000100:00100000:0.0:1746065147.616847:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267818752 00000100:00100000:0.0:1746065147.616851:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267818752 00000100:00100000:0.0:1746065147.616895:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1746065147.616900:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267818752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065147.616928:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267818752:12345-0@lo:400:kworker.0 Request processed in 29us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.616932:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:1.0:1746065147.617566:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267818624 00000100:00100000:1.0:1746065147.617570:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267818624 00000100:00100000:1.0:1746065147.617587:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1746065147.617591:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3767:x1830881267818624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065147.617619:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3767:x1830881267818624:12345-0@lo:400:kworker.0 Request processed in 27us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.617623:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1746065147.617771:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267818496:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.617800:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267818752:0@lo:400:kworker.0 00000100:00100000:3.0:1746065147.617810:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830881267818624:0@lo:400:kworker.0 00000100:00100000:0.0:1746065147.680170:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267819904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065147.680219:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065147.680648:0:11427:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 746800565880ns, next at 747800563830ns, rc = 0 00000100:00100000:3.0:1746065147.680699:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267819904 00000100:00100000:3.0:1746065147.680705:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267819904 00000100:00100000:3.0:1746065147.680736:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1746065147.680742:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267819904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746065147.680764:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 502102848 pending 0 free 3920867328 avail 3689345024 00000100:00100000:3.0:1746065147.680807:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267819904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.680812:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1746065147.680923:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267819904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065147.776184:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065147.776200:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267820032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065147.776255:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065147.776421:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267820032 00000100:00100000:0.0:1746065147.776427:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267820032 00000100:00100000:0.0:1746065147.776504:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1746065147.776512:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830881267820032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746065147.776531:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 502102848 pending 0 free 3920867328 avail 3689345024 00000100:00100000:0.0:1746065147.776562:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830881267820032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.776567:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1746065147.776599:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267820032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746065147.855285:0:3768:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065147.855301:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267820160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746065147.855353:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065147.855445:0:8658:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267820160 00000100:00100000:0.0:1746065147.855452:0:8658:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267820160 00000100:00100000:0.0:1746065147.855484:0:8658:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1746065147.855490:0:8658:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3768:x1830881267820160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746065147.855517:0:8658:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1445990400 avail 1316528128 00000100:00100000:0.0:1746065147.855547:0:8658:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3768:x1830881267820160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.855552:0:8658:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1746065147.856023:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267820160:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1746065148.255262:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1746065148.881742:0:28232:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 16h: mmap read after truncate file ======= 22:05:47 (1746065147) 00000100:00100000:0.0:1746065148.945195:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065148.945243:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273229568 00000100:00100000:2.0:1746065148.945251:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273229568 00000100:00100000:2.0:1746065148.945293:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36518 00000100:00100000:2.0:1746065148.945300:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2472:x1830881273229568:12345-192.168.202.8@tcp:41:stat.0 00000004:00000024:2.0:1746065148.945340:0:21520:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7842095104 avail 7379050496 00000100:00100000:2.0:1746065148.945380:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2472:x1830881273229568:12345-192.168.202.8@tcp:41:stat.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.945385:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36518 00000100:00080000:0.0:1746065148.945453:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065148.975691:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267820288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746065148.975742:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065148.975833:0:8658:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267820288 00000100:00100000:0.0:1746065148.975840:0:8658:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267820288 00000100:00100000:0.0:1746065148.980242:0:8658:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1746065148.980257:0:8658:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3768:x1830881267820288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065148.980290:0:8658:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446187008 avail 1316724736 00000100:00100000:0.0:1746065148.980351:0:8658:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3768:x1830881267820288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (4609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065148.980357:0:8658:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1746065148.981116:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267820288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065149.031742:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065149.031885:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273229696 00000100:00100000:1.0:1746065149.031893:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273229696 00000100:00100000:1.0:1746065149.032232:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36519 00000100:00100000:1.0:1746065149.032239:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2476:x1830881273229696:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:1.0:1746065149.032256:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.032271:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f880b76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6aaf expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.032316:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6d800/0x392ae0376f880b7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065149.032326:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6d800/0x392ae0376f880b7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065149.032335:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6d800/0x392ae0376f880b7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:1.0:1746065149.032369:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1746065149.032372:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065149.032385:0:7212:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6d800/0x392ae0376f880b7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065149.032402:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f880b76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aaf expref: 11 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.032425:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6d800/0x392ae0376f880b7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aaf expref: 10 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.032432:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065149.032434:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065149.032436:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6d800, rc 0) 00000100:00100000:1.0:1746065149.032472:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2476:x1830881273229696:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 233us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.032478:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36519 00000100:00100000:0.0:1746065149.033896:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065149.033925:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273229824 00000100:00100000:0.0:1746065149.033931:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273229824 00000100:00100000:0.0:1746065149.033972:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36520 00000100:00100000:0.0:1746065149.033978:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2476:x1830881273229824:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:0.0:1746065149.033988:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.033998:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880b84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ab6 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.034029:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880b8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034037:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880b8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034044:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880b8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034055:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880b92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034060:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880b92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034065:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880b92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034119:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880b8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034126:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880b8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034131:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880b8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034136:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f524400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065149.034139:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880b8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034145:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880b8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034153:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065149.034156:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065149.034159:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880b8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034163:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880b8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034506:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880b92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034512:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880b92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034516:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880b92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034519:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f525200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065149.034521:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880b92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034524:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880b92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034530:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9ce3d8f (ffff88012b66c200) 00010000:00010000:0.0:1746065149.034533:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065149.034535:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880b92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034538:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880b92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065149.034560:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880b84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ab6 expref: 11 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.034565:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880b84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ab6 expref: 11 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.034571:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f525800, rc 0) 00000100:00100000:0.0:1746065149.034600:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2476:x1830881273229824:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 622us (707us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065149.034606:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36520 00000100:00100000:0.0:1746065149.041853:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.042447:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273230080 00000100:00100000:3.0:1746065149.042456:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273230080 00000100:00100000:3.0:1746065149.042492:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36521 00000100:00100000:3.0:1746065149.042498:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2476:x1830881273230080:12345-192.168.202.8@tcp:36:lfs.0 00010000:00010000:3.0:1746065149.042539:0:7211:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.042561:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6d800/0x392ae0376f880b7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aaf expref: 10 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.043228:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065149.043233:0:7211:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065149.043281:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.043291:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.043298:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.043308:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.043329:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.043334:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000040:00080000:3.0:1746065149.043997:0:7211:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].8, 2152 off47600 00000040:00080000:3.0:1746065149.044072:0:7211:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].8, 2352 off49096 00000004:00080000:3.0:1746065149.044077:0:7211:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009ea58c00 with version 18 00000004:00080000:2.0:1746065149.044982:0:8655:0:(osp_trans.c:1327:osp_get_next_request()) ou ffff880081c7d240 version 18 rpc_version 18 00000020:00100000:2.0:1746065149.045013:0:8655:0:(genops.c:2421:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1746065149.045021:0:8655:0:(client.c:764:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009d513480 x1830881267820544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746065149.045040:0:8655:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d513480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8655:1830881267820544:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1746065149.045121:0:8655:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.045161:0:8655:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0b67e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.045220:0:8658:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267820544 00000100:00100000:0.0:1746065149.045226:0:8658:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267820544 00000100:00100000:0.0:1746065149.045257:0:8658:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1746065149.045263:0:8658:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:8655:x1830881267820544:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1746065149.045601:0:8658:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:8655:x1830881267820544:12345-0@lo:1000:osp_up1-0.0 Request processed in 338us (480us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1746065149.045607:0:8658:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:2.0:1746065149.045942:0:8655:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d513480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8655:1830881267820544:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1746065149.046000:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046009:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046016:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046026:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 3/0,1 mode: --/PW res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046030:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046032:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046048:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046051:0:7211:0:(ldlm_request.c:1021:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046056:0:7211:0:(ldlm_request.c:1108:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7211 initiator: MDT0 00000100:00100000:3.0:1746065149.046064:0:7211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbfa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:7211:1830881267820672:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1746065149.046113:0:7211:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065149.046148:0:7211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065149.046363:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267820672 00000100:00100000:1.0:1746065149.046368:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267820672 00000100:00100000:1.0:1746065149.046397:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1746065149.046402:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7211:x1830881267820672:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1746065149.046413:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.046446:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880bbc lrc: 2/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x392ae0376f880bb5 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.046462:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880bbc lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x392ae0376f880bb5 expref: 7 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.046473:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880bbc lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x392ae0376f880bb5 expref: 7 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.046480:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9:0x0].0x0 (ffff88012f07be00) 00010000:00010000:1.0:1746065149.046482:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065149.046484:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6c000, rc 0) 00000100:00100000:1.0:1746065149.046518:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7211:x1830881267820672:12345-0@lo:101:mdt00_000.0 Request processed in 116us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.046523:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1746065149.046536:0:7211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbfa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:7211:1830881267820672:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1746065149.046543:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.046549:0:7211:0:(ldlm_request.c:783:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1746065149.046559:0:7211:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009549c700 reply state ffff88009f887000 transno 4294983593 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046564:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046567:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff88009fd0d500) 00010000:00010000:3.0:1746065149.046569:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065149.046571:0:7211:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065149.046575:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.046579:0:7211:0:(ldlm_lock.c:914:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746065149.046584:0:7211:0:(osp_object.c:1377:osp_invalidate()) Invalidate osp_object [0x240000401:0x9:0x0] 00000004:00010000:3.0:1746065149.046586:0:7211:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009549c700 reply state ffff88009f887000 transno 4294983593 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046589:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046592:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x44:0x0].0x0 (ffff88009fd0d200) 00010000:00010000:3.0:1746065149.046593:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065149.046594:0:7211:0:(service.c:173:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1746065149.046596:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x44:0x0]: returning size 4096 00010000:00010000:3.0:1746065149.046602:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046604:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046607:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046610:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046613:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065149.046615:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046620:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046626:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065149.046627:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065149.046629:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046632:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880b99 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00000004:00010000:3.0:1746065149.046638:0:7211:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009549c700 reply state ffff88009f887000 transno 4294983593 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046644:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.046647:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9ce3d8f (ffff88009fd0d100) 00010000:00010000:3.0:1746065149.046648:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065149.046649:0:7211:0:(service.c:173:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1746065149.046700:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2476:x1830881273230080:12345-192.168.202.8@tcp:36:lfs.0 Request processed in 4202us (4862us total) trans 4294983593 rc 0/0 00000100:00100000:3.0:1746065149.046704:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36521 00000100:00100000:2.0:1746065149.055599:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009549e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267820800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746065149.055654:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065149.055708:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267820800 00000100:00100000:0.0:1746065149.055716:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267820800 00000100:00100000:0.0:1746065149.055755:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1746065149.055763:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830881267820800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746065149.055788:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490158912 pending 0 free 3921227776 avail 3689705472 00000100:00100000:0.0:1746065149.056477:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830881267820800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 714us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.056484:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00080000:1.0:1746065149.056541:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065149.056596:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009549e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3765:1830881267820800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065149.069828:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.070118:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273230208 00000100:00100000:3.0:1746065149.070126:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273230208 00000100:00100000:3.0:1746065149.070167:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36522 00000100:00100000:3.0:1746065149.070174:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2477:x1830881273230208:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:3.0:1746065149.070195:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.070210:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880bc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6abd expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.070265:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10200/0x392ae0376f880bca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.070280:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10200/0x392ae0376f880bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.070293:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10200/0x392ae0376f880bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:3.0:1746065149.070329:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1746065149.070332:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065149.070350:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10200/0x392ae0376f880bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.070371:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880bc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6abd expref: 13 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.070485:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10200/0x392ae0376f880bca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6abd expref: 12 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.070492:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065149.070494:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065149.070496:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10200, rc 0) 00000100:00100000:3.0:1746065149.071185:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009549e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2477:x1830881273230208:12345-192.168.202.8@tcp:101:cp.0 Request processed in 1010us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.071191:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36522 00000100:00100000:0.0:1746065149.074150:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.074231:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273230336 00000100:00100000:3.0:1746065149.074238:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273230336 00000100:00100000:3.0:1746065149.074271:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36523 00000100:00100000:3.0:1746065149.074277:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2477:x1830881273230336:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:3.0:1746065149.074293:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.074305:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880bd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ac4 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.074351:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074360:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074369:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074381:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e400/0x392ae0376f880bdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074386:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e400/0x392ae0376f880bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074390:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e400/0x392ae0376f880bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074452:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ee00/0x392ae0376f880be6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074457:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ee00/0x392ae0376f880be6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074463:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ee00/0x392ae0376f880be6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:3.0:1746065149.074512:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x44:0x0]: returning size 4096 00000004:00200000:3.0:1746065149.074516:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1746065149.074532:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ee00/0x392ae0376f880be6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074541:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074546:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074550:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074556:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074564:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065149.074567:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074573:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074582:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065149.074584:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065149.074587:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074591:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880bd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074703:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e400/0x392ae0376f880bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074708:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e400/0x392ae0376f880bdf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074712:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e400/0x392ae0376f880bdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074715:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa0e400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065149.074717:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e400/0x392ae0376f880bdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074720:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e400/0x392ae0376f880bdf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074727:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9ce3d8f (ffff88009fd0d100) 00010000:00010000:3.0:1746065149.074729:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065149.074731:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e400/0x392ae0376f880bdf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074735:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e400/0x392ae0376f880bdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.074754:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880bd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ac4 expref: 14 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.074763:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ee00/0x392ae0376f880be6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ac4 expref: 13 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.074769:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x44:0x0].0x0 (ffff88009fd0d200) 00010000:00010000:3.0:1746065149.074771:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746065149.074773:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ee00, rc 0) 00000100:00100000:3.0:1746065149.076095:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2477:x1830881273230336:12345-192.168.202.8@tcp:101:cp.0 Request processed in 1801us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.076107:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36523 00000100:00100000:0.0:1746065149.077751:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.077807:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273230464 00000100:00100000:3.0:1746065149.077815:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273230464 00000100:00100000:3.0:1746065149.077863:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36524 00000100:00100000:3.0:1746065149.077870:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2477:x1830881273230464:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:3.0:1746065149.077885:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.077897:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e800/0x392ae0376f880bed lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6acb expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.077936:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880bf4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.077945:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.077959:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:3.0:1746065149.077991:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000400:0x9:0x0]: returning size 4096 00000004:00200000:3.0:1746065149.077994:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065149.078018:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e800/0x392ae0376f880bed lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6acb expref: 15 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.078044:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6acb expref: 14 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.078050:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff88009fd0d500) 00010000:00010000:3.0:1746065149.078052:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065149.078054:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:3.0:1746065149.078114:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2477:x1830881273230464:12345-192.168.202.8@tcp:101:cp.0 Request processed in 243us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.078119:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36524 00000100:00100000:0.0:1746065149.082463:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.082697:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273230592 00000100:00100000:2.0:1746065149.082705:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273230592 00000100:00100000:2.0:1746065149.082778:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36525 00000100:00100000:2.0:1746065149.082785:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2477:x1830881273230592:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065149.082802:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.082818:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091065c00/0x392ae0376f880bfb lrc: 2/0,0 mode: --/CR res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ad2 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.082880:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091065600/0x392ae0376f880c02 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.082891:0:7212:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880bbc lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x392ae0376f880bb5 expref: 6 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.082898:0:7212:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091065600/0x392ae0376f880c02 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065149.082926:0:7212:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880bbc lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x392ae0376f880bb5 expref: 6 pid: 7216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.082940:0:7212:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7212:1830881267820928:0@lo:104: 00000100:00100000:2.0:1746065149.082980:0:7212:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065149.083061:0:8358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267820928 00000100:00100000:3.0:1746065149.083065:0:8358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267820928 00000100:00100000:3.0:1746065149.083123:0:8358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1746065149.083128:0:8358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:7212:x1830881267820928:12345-0@lo:104: 00010000:00010000:3.0:1746065149.083137:0:8358:0:(ldlm_lockd.c:2491:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.083168:0:8358:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1746065149.083172:0:8358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:7212:x1830881267820928:12345-0@lo:104: Request processed in 44us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.083176:0:8358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:3.0:1746065149.083190:0:7201:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065149.083194:0:7201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.083199:0:7201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10800 already unused, calling callback (ffffffffa0f34e30) 00010000:00010000:3.0:1746065149.083202:0:7201:0:(ldlm_request.c:1284:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1746065149.083210:0:7201:0:(mdt_handler.c:3930:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.083230:0:7201:0:(ldlm_request.c:1331:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.083235:0:7201:0:(ldlm_request.c:1377:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1746065149.083248:0:7201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.083253:0:7201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009fb10800/0x392ae0376f880bb5 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x392ae0376f880bbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.083279:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065149.083280:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065149.083282:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065149.083291:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267821056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1746065149.083313:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065149.083359:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267821056 00000100:00100000:3.0:1746065149.083363:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267821056 00010000:00010000:3.0:1746065149.083376:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880bbc lrc: 5/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x392ae0376f880bb5 expref: 7 pid: 7216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.083396:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14821 00000100:00100000:3.0:1746065149.083400:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3766:x1830881267821056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.083406:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1746065149.083737:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746065149.084486:0:7212:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0b67e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.084510:0:7212:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7212:1830881267820928:0@lo:104: 00010000:00010000:2.0:1746065149.084529:0:7212:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091065600/0x392ae0376f880c02 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00000001:00080000:1.0:1746065149.087062:0:8350:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967390 is committed 00010000:00010000:3.0:1746065149.087188:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880bbc lrc: 0/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x392ae0376f880bb5 expref: 6 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.087202:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9:0x0].0x0 (ffff88012f07be00) 00010000:00010000:3.0:1746065149.087205:0:8359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880091065600/0x392ae0376f880c02 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:3.0:1746065149.087212:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091065600/0x392ae0376f880c02 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7212 initiator: MDT1 00010000:00010000:3.0:1746065149.087217:0:8359:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091065600/0x392ae0376f880c02 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7212 initiator: MDT1 00010000:00010000:3.0:1746065149.087817:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.087897:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3766:x1830881267821056:12345-0@lo:103:ldlm_bl.0 Request processed in 4495us (4581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.087906:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14821 00000100:00100000:0.0:1746065149.087934:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267821056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.088074:0:7212:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091065600/0x392ae0376f880c02 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065149.088094:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091065600/0x392ae0376f880c02 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00000004:00200000:2.0:1746065149.088137:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000401:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1746065149.088140:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065149.088174:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091065c00/0x392ae0376f880bfb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ad2 expref: 7 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.088205:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091065600/0x392ae0376f880c02 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ad2 expref: 6 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.088212:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9:0x0].0x0 (ffff88012f07be00) 00010000:00010000:2.0:1746065149.088214:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065149.088216:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065600, rc 0) 00000100:00100000:2.0:1746065149.088478:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2477:x1830881273230592:12345-192.168.202.8@tcp:101:cp.0 Request processed in 5691us (6021us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.088484:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36525 00000100:00100000:3.0:1746065149.090046:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.090143:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273230720 00000100:00100000:2.0:1746065149.090150:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273230720 00000100:00100000:2.0:1746065149.090178:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36526 00000100:00100000:2.0:1746065149.090341:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2477:x1830881273230720:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065149.090356:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.090368:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091064600/0x392ae0376f880c09 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ad9 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.090405:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c10 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090414:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c10 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090422:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c10 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090434:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065000/0x392ae0376f880c17 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090442:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065000/0x392ae0376f880c17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090446:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065000/0x392ae0376f880c17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090490:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c10 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090494:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c10 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090499:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c10 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090503:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091065a00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.090506:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c10 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090511:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c10 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090519:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff88009fd0d500) 00010000:00010000:2.0:1746065149.090521:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.090524:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c10 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090528:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c10 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090535:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065000/0x392ae0376f880c17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090539:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091065000/0x392ae0376f880c17 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090543:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091065000/0x392ae0376f880c17 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090546:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091065000 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.090548:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065000/0x392ae0376f880c17 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090552:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065000/0x392ae0376f880c17 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090558:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0xf9ce3da1 (ffff880129d79200) 00010000:00010000:2.0:1746065149.090559:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.090561:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091065000/0x392ae0376f880c17 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090565:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065000/0x392ae0376f880c17 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.090586:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064600/0x392ae0376f880c09 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ad9 expref: 15 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.090592:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064600/0x392ae0376f880c09 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ad9 expref: 15 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.090598:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064600, rc 0) 00000100:00100000:2.0:1746065149.090636:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2477:x1830881273230720:12345-192.168.202.8@tcp:101:cp.0 Request processed in 453us (594us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065149.090642:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36526 00000100:00100000:0.0:1746065149.093281:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.094123:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273230976 00000100:00100000:2.0:1746065149.094130:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273230976 00000100:00100000:2.0:1746065149.094236:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36527 00000100:00100000:2.0:1746065149.094243:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2477:x1830881273230976:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065149.094258:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.094261:0:7212:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065149.094504:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880bf4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6acb expref: 14 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.094518:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff88009fd0d500) 00010000:00010000:2.0:1746065149.094521:0:7212:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065149.094530:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091064e00/0x392ae0376f880c1e lrc: 2/0,0 mode: --/CW res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ae0 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.095379:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065e00/0x392ae0376f880c25 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.095390:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065e00/0x392ae0376f880c25 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.095396:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065e00/0x392ae0376f880c25 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.095409:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 3/0,1 mode: --/PW res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.095414:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.095418:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00080000:2.0:1746065149.095666:0:7212:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x18:0x0], index 0: 0 00010000:00010000:2.0:1746065149.095756:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065800/0x392ae0376f880c33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.095763:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065800/0x392ae0376f880c33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.095769:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065800/0x392ae0376f880c33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.095790:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065e00/0x392ae0376f880c25 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.096550:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091065e00/0x392ae0376f880c25 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.096556:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091065e00/0x392ae0376f880c25 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.096561:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091065e00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.096564:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065e00/0x392ae0376f880c25 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.096570:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065e00/0x392ae0376f880c25 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.096578:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff88009fd0d500) 00010000:00010000:2.0:1746065149.096581:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.096583:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091065e00/0x392ae0376f880c25 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.096588:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065e00/0x392ae0376f880c25 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00000004:00010000:2.0:1746065149.096595:0:7212:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093859180 reply state ffff88009d2c2000 transno 4294983594 ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.096601:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.096606:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0xf9ce3da1 (ffff880129d79c00) 00010000:00010000:2.0:1746065149.096608:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065149.096610:0:7212:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065149.096631:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064e00/0x392ae0376f880c1e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae0 expref: 16 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.096640:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065800/0x392ae0376f880c33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae0 expref: 15 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.096645:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:2.0:1746065149.096647:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065149.096648:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065800, rc 0) 00000100:00100000:2.0:1746065149.096699:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2477:x1830881273230976:12345-192.168.202.8@tcp:101:cp.0 Request processed in 2456us (3425us total) trans 4294983594 rc 0/0 00000100:00100000:2.0:1746065149.096705:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36527 00000100:00100000:0.0:1746065149.099057:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.099149:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273231104 00000100:00100000:3.0:1746065149.099157:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273231104 00000100:00100000:3.0:1746065149.099217:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30850 00000100:00100000:3.0:1746065149.099223:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2005:x1830881273231104:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:3.0:1746065149.099237:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.099253:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f880c41 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ae7 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065149.099277:0:21550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065149.099292:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.099294:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.099300:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f880c41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae7 expref: 6 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.099313:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f880c41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae7 expref: 6 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.099322:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746065149.099357:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273231104:12345-192.168.202.8@tcp:101:cp.0 Request processed in 134us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.099362:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30850 00000100:00080000:1.0:1746065149.099423:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065149.101360:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.101436:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273231232 00000100:00100000:2.0:1746065149.101442:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273231232 00000100:00100000:2.0:1746065149.101517:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30851 00000100:00100000:2.0:1746065149.101524:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2477:x1830881273231232:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065149.101535:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.101547:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6aee expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.101570:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f880c41 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae7 expref: 7 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.101576:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.101578:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.101581:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.101604:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f880c41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae7 expref: 7 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.101614:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f880c41 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae7 expref: 7 pid: 21550 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746065149.101622:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267821184:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065149.102201:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0b67300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.108713:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.108888:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273231360 00000100:00100000:3.0:1746065149.108895:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273231360 00010000:00010000:3.0:1746065149.108926:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f880c41 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae7 expref: 8 pid: 21550 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746065149.108952:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14822 00000100:00100000:3.0:1746065149.108958:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273231360:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.108970:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.108987:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f880c41 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae7 expref: 8 pid: 21550 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065149.108996:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f880c41 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae7 expref: 8 pid: 21550 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065149.109018:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.109020:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.109026:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.109033:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.109057:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.109067:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d651180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267821312:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065149.109153:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065149.109448:0:9559:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x392ae0376f880c41 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae7 expref: 8 pid: 21550 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746065149.109473:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267821184:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065149.109490:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.109499:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064600, rc 0) 00000100:00100000:2.0:1746065149.109534:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2477:x1830881273231232:12345-192.168.202.8@tcp:101:cp.0 Request processed in 8010us (8178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.109540:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30851 00000100:00100000:3.0:1746065149.112242:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d651180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267821312:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065149.112259:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.112302:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273231360:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3344us (3595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.112312:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14822 00000100:00100000:0.0:1746065149.112784:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.113563:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273231616 00000100:00100000:2.0:1746065149.113571:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273231616 00000100:00100000:2.0:1746065149.113615:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 192 00000100:00100000:2.0:1746065149.113621:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2477:x1830881273231616:12345-192.168.202.8@tcp:35:cp.0 00000100:00100000:2.0:1746065149.113827:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2477:x1830881273231616:12345-192.168.202.8@tcp:35:cp.0 Request processed in 206us (1042us total) trans 4294983595 rc 0/0 00000100:00100000:2.0:1746065149.113832:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 192 00000100:00100000:3.0:1746065149.119663:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fbfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267821440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746065149.119719:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065149.119821:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267821440 00000100:00100000:0.0:1746065149.119827:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267821440 00000100:00100000:0.0:1746065149.119879:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1746065149.119896:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267821440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065149.119914:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490158912 pending 0 free 3921227776 avail 3689705472 00000100:00100000:0.0:1746065149.119946:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267821440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.119952:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00080000:2.0:1746065149.120028:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065149.125146:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fbfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267821440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065149.146919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.147125:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273231872 00000100:00100000:2.0:1746065149.147133:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273231872 00000100:00100000:2.0:1746065149.148242:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36528 00000100:00100000:2.0:1746065149.148252:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2480:x1830881273231872:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746065149.148276:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.148293:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6af5 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.148372:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065c00/0x392ae0376f880c56 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.148383:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065c00/0x392ae0376f880c56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x45:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.148391:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065c00/0x392ae0376f880c56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x45:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:2.0:1746065149.148399:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 1716 00010000:00010000:2.0:1746065149.148477:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065a00/0x392ae0376f880c4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x45:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6af5 expref: 20 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.149151:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065c00/0x392ae0376f880c56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x45:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6af5 expref: 19 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.149159:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:2.0:1746065149.149162:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065149.149165:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091065c00, rc 0) 00000100:00100000:2.0:1746065149.149822:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2480:x1830881273231872:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 1570us (2907us total) trans 4294983596 rc 0/0 00000100:00100000:2.0:1746065149.149828:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36528 00000100:00100000:0.0:1746065149.166187:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.166293:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273232000 00000100:00100000:2.0:1746065149.166301:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273232000 00000100:00080000:0.0:1746065149.166919:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065149.166971:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36529 00000100:00100000:2.0:1746065149.166979:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:2484:x1830881273232000:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746065149.166998:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.167013:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880c64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6afc expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.167058:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.167068:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.167076:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:2.0:1746065149.167143:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1746065149.167146:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065149.167159:0:7212:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.167178:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880c64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6afc expref: 10 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.167194:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6afc expref: 9 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.167201:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065149.167203:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065149.167206:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc400, rc 0) 00000100:00100000:2.0:1746065149.168509:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2484:x1830881273232000:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 1527us (2326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.168516:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36529 00000100:00100000:0.0:1746065149.169989:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.170156:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273232128 00000100:00100000:2.0:1746065149.170163:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273232128 00000100:00100000:2.0:1746065149.170247:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36530 00000100:00100000:2.0:1746065149.170254:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2484:x1830881273232128:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746065149.170268:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.170281:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfca00/0x392ae0376f880c72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b03 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.170322:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880c79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170331:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170339:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170347:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880c80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170352:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170357:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170421:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd600/0x392ae0376f880c87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170427:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd600/0x392ae0376f880c87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170432:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd600/0x392ae0376f880c87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:2.0:1746065149.170484:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x44:0x0]: returning size 4096 00000004:00200000:2.0:1746065149.170487:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1746065149.170500:0:7212:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd600/0x392ae0376f880c87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170508:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170513:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880c79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170518:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880c79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170522:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ddfd200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.170524:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880c79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170529:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880c79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170537:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065149.170540:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.170543:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880c79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170548:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880c79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170557:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170561:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880c80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170565:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880c80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170569:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ddfde00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.170571:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880c80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170575:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880c80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170580:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9ce3d8f (ffff88009fd0d100) 00010000:00010000:2.0:1746065149.170582:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.170585:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880c80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170589:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880c80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.170607:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfca00/0x392ae0376f880c72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b03 expref: 11 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.170617:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd600/0x392ae0376f880c87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x44:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b03 expref: 10 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.170627:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x44:0x0].0x0 (ffff88009fd0d200) 00010000:00010000:2.0:1746065149.170629:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746065149.170631:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd600, rc 0) 00000100:00100000:2.0:1746065149.171455:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+10:2484:x1830881273232128:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 1197us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.171461:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36530 00000100:00100000:0.0:1746065149.173769:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.173864:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273232256 00000100:00100000:2.0:1746065149.173871:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273232256 00000100:00100000:2.0:1746065149.174889:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36531 00000100:00100000:2.0:1746065149.174896:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+10:2484:x1830881273232256:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746065149.174912:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.174926:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfda00/0x392ae0376f880c8e lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b0a expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.174968:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfce00/0x392ae0376f880c95 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.174978:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfce00/0x392ae0376f880c95 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.174987:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfce00/0x392ae0376f880c95 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:2.0:1746065149.175017:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000400:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1746065149.175021:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065149.175044:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfda00/0x392ae0376f880c8e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b0a expref: 12 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.175058:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfce00/0x392ae0376f880c95 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b0a expref: 11 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.175065:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff88009fd0d500) 00010000:00010000:2.0:1746065149.175068:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065149.175070:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfce00, rc 0) 00000100:00100000:2.0:1746065149.175135:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2484:x1830881273232256:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 239us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.175140:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36531 00000100:00100000:0.0:1746065149.176516:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.176602:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273232384 00000100:00100000:2.0:1746065149.176609:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273232384 00000100:00100000:2.0:1746065149.176661:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36532 00000100:00100000:2.0:1746065149.176667:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2484:x1830881273232384:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746065149.176678:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.176689:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfc000/0x392ae0376f880c9c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b11 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.176724:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ca3 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.176732:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ca3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065149.176740:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ca3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00000004:00200000:2.0:1746065149.176765:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000401:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1746065149.176767:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065149.176799:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfc000/0x392ae0376f880c9c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b11 expref: 7 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.176811:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfd800/0x392ae0376f880ca3 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b11 expref: 6 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.176817:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9:0x0].0x0 (ffff88012f07be00) 00010000:00010000:2.0:1746065149.176819:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065149.176821:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd800, rc 0) 00000100:00100000:2.0:1746065149.176870:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2484:x1830881273232384:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 202us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.176875:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36532 00000100:00080000:0.0:1746065149.177372:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065149.178794:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.178884:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273232512 00000100:00100000:2.0:1746065149.178890:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273232512 00000100:00100000:2.0:1746065149.179254:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36533 00000100:00100000:2.0:1746065149.179260:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2484:x1830881273232512:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746065149.179272:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.179283:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880caa lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b18 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.179323:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cb1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179331:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179338:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179346:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880cb8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179351:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179356:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179408:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179414:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179419:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:2.0:1746065149.179442:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 1716 00000004:00200000:2.0:1746065149.179445:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065149.179456:0:7212:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179463:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179469:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179474:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cb1 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179480:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179484:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ddfd200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.179487:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179493:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cb1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179502:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff88009fd0d500) 00010000:00010000:2.0:1746065149.179505:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.179507:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cb1 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179511:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cb1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179519:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179523:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880cb8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179527:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179531:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ddfc200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.179533:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179537:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179542:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0xf9ce3da1 (ffff880129d79c00) 00010000:00010000:2.0:1746065149.179543:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.179545:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880cb8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179548:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880cb8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.179565:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f880caa lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b18 expref: 13 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.179577:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b18 expref: 12 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.179582:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:2.0:1746065149.179584:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065149.179586:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfdc00, rc 0) 00000100:00100000:2.0:1746065149.179623:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2484:x1830881273232512:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 362us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.179628:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36533 00000100:00100000:1.0:1746065149.183243:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.183328:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273232640 00000100:00100000:2.0:1746065149.183337:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273232640 00000100:00100000:2.0:1746065149.183428:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30852 00000100:00100000:2.0:1746065149.183434:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2001:x1830881273232640:12345-192.168.202.8@tcp:8:mmap_cat.0 00010000:00080000:2.0:1746065149.183462:0:9559:0:(ldlm_lib.c:1362:target_handle_connect()) lustre-OST0000: connection from eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp t0 exp (null) cur 748 last 0 00000020:00000080:2.0:1746065149.183487:0:9559:0:(genops.c:1402:class_connect()) connect: client eb9e1243-8634-4680-83fd-4b7a1b6b07ce, cookie 0x392ae0376f880cc6 00002000:00100000:2.0:1746065149.183496:0:9559:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli eb9e1243-8634-4680-83fd-4b7a1b6b07ce/ffff88009fab1000 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 2103639 ocd_grant: 489881600 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1746065149.183505:0:9559:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:01000000:2.0:1746065149.183560:0:9559:0:(lprocfs_status_server.c:585:lprocfs_exp_setup()) using hash ffff88012a3d8480 00002000:00080000:2.0:1746065149.183567:0:9559:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1746065149.183586:0:9559:0:(import.c:66:import_set_state_nolock()) ffff88009fab2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1746065149.184031:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2001:x1830881273232640:12345-192.168.202.8@tcp:8:mmap_cat.0 Request processed in 595us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.184038:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30852 00000100:00100000:0.0:1746065149.185825:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.185999:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273232768 00000100:00100000:2.0:1746065149.186004:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273232768 00000100:00100000:2.0:1746065149.186044:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30853 00000100:00100000:2.0:1746065149.186049:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:0:x1830881273232768:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746065149.186058:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.186070:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072825600/0x392ae0376f880ccd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b1f expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.186122:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267821568:192.168.202.8@tcp:106: 00000100:00100000:2.0:1746065149.186189:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0b67780 going to sleep for 11 seconds 00000100:00080000:0.0:1746065149.186257:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1746065149.188569:0:9559:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb size: 0 -> 1716 00002000:00010000:2.0:1746065149.188575:0:9559:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb mtime: 0 -> 1746065148 00002000:00010000:2.0:1746065149.188576:0:9559:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb atime: 0 -> 1746065148 00002000:00010000:2.0:1746065149.188578:0:9559:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb ctime: 0 -> 1746065148 00002000:00010000:2.0:1746065149.188580:0:9559:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1746065149.188596:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267821568:192.168.202.8@tcp:106: 00010000:00010000:2.0:1746065149.188621:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880072825600/0x392ae0376f880ccd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b1f expref: 7 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.188632:0:9559:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072825600/0x392ae0376f880ccd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b1f expref: 7 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.188679:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072825600, rc 0) 00000100:00100000:2.0:1746065149.188726:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:0:x1830881273232768:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 2675us (2904us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065149.188733:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30853 00000100:00100000:0.0:1746065149.190340:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.190627:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273233024 00000100:00100000:3.0:1746065149.190635:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273233024 00000100:00100000:3.0:1746065149.190679:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36534 00000100:00100000:3.0:1746065149.190686:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2484:x1830881273233024:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:3.0:1746065149.190700:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.190713:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880cd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b26 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.190785:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880cdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.190795:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065149.190803:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:3.0:1746065149.190811:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 1716 00010000:00010000:3.0:1746065149.190893:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880cd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x45:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b26 expref: 15 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.190918:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b26 expref: 14 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.190925:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:3.0:1746065149.190927:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065149.190930:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065149.190966:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2484:x1830881273233024:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 280us (630us total) trans 4294983597 rc 0/0 00000100:00100000:3.0:1746065149.190971:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36534 00000100:00100000:0.0:1746065149.193657:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065149.194165:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.194316:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273233152 00000100:00100000:2.0:1746065149.194323:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273233152 00000100:00100000:2.0:1746065149.194354:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30854 00000100:00100000:2.0:1746065149.194359:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273233152:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746065149.194373:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.194385:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc200/0x392ae0376f880ce9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b2d expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.194423:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267821696:192.168.202.8@tcp:106: 00000100:00100000:2.0:1746065149.194482:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0b67780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.194586:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273233280 00000100:00100000:3.0:1746065149.194590:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273233280 00000100:00100000:3.0:1746065149.194615:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 510 00000100:00100000:3.0:1746065149.194619:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2004:x1830881273233280:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.194627:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.194642:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x392ae0376f880cdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b26 expref: 14 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.194653:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:3.0:1746065149.194656:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.194676:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2004:x1830881273233280:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 55us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.194681:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 510 00000100:00100000:2.0:1746065149.196868:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267821696:192.168.202.8@tcp:106: 00010000:00010000:2.0:1746065149.196899:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc200/0x392ae0376f880ce9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b2d expref: 7 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.196911:0:9559:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc200/0x392ae0376f880ce9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b2d expref: 7 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.196922:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc200, rc 0) 00000100:00100000:2.0:1746065149.196965:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273233152:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 2604us (3313us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065149.196972:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30854 00000100:00100000:0.0:1746065149.198634:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.198722:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273233408 00000100:00100000:2.0:1746065149.198728:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273233408 00000100:00100000:2.0:1746065149.198768:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30855 00000100:00100000:2.0:1746065149.198775:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2484:x1830881273233408:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746065149.198786:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.198798:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b34 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.198823:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.198829:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065149.198831:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065149.198834:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.198870:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.198881:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 5 pid: 9559 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065149.198891:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267821824:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065149.198962:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a0b67780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.201451:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267821824:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065149.201479:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.201491:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd200, rc 0) 00000100:00100000:3.0:1746065149.201521:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2484:x1830881273233408:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 2747us (2891us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.201529:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30855 00000100:00100000:0.0:1746065149.202511:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065149.202716:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273233536 00000100:00100000:1.0:1746065149.202724:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273233536 00002000:00100000:1.0:1746065149.202756:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x18:0x0] (0->1715) req@ffff88009fac9f80 x1830881273233536/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:65/0 lens 2208/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.202763:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac9f80 with x1830881273233536 ext(0->1715) 00010000:00010000:1.0:1746065149.202770:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 6 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065149.202785:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 6 pid: 9559 timeout: 848 lvb_type: 0 00002000:00010000:1.0:1746065149.202791:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac9f80 00000100:00100000:1.0:1746065149.202816:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3159 00000100:00100000:1.0:1746065149.202822:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273233536:12345-192.168.202.8@tcp:4:cp.0 00000100:00100000:0.0:1746065149.203439:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273233536:12345-192.168.202.8@tcp:4:cp.0 Request processed in 615us (928us total) trans 4294970736 rc 0/0 00000100:00100000:0.0:1746065149.203446:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3159 00002000:00100000:0.0:1746065149.203452:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x18:0x0] (0->1715) req@ffff88009fac9f80 x1830881273233536/t4294970736(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:65/0 lens 2208/448 e 0 to 0 dl 1746065160 ref 1 fl Complete:H/200/0 rc 0/0 job:'cp.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.203458:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac9f80 with x1830881273233536 ext(0->1715) 00010000:00010000:0.0:1746065149.203462:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 8 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065149.203471:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 8 pid: 9559 timeout: 848 lvb_type: 0 00002000:00010000:0.0:1746065149.203476:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac9f80 00000100:00100000:0.0:1746065149.204660:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.204743:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273233664 00000100:00100000:3.0:1746065149.204749:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273233664 00010000:00010000:3.0:1746065149.204769:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 8 pid: 9559 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065149.204800:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14823 00000100:00100000:3.0:1746065149.204806:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2003:x1830881273233664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.204815:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065149.204824:0:7198:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1746065149.204828:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 8 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065149.204835:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 8 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065149.204862:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091064600/0x392ae0376f880c48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6aee expref: 8 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065149.204873:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.204875:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.204881:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.204888:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.204913:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.204923:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267821952:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065149.204994:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.207874:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267821952:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065149.207893:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065149.207990:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065149.208012:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273233920 00000100:00100000:0.0:1746065149.208017:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273233920 00002000:00100000:0.0:1746065149.208045:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x18:0x0] (0->4095) req@ffff88009faca680 x1830881273233920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065149.208059:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faca680 with x1830881273233920 ext(0->4095) 00002000:00010000:0.0:1746065149.208062:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faca680 00000100:00100000:0.0:1746065149.208930:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13867 00000100:00100000:0.0:1746065149.208938:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273233920:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746065149.209051:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273233920:12345-192.168.202.8@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (1061us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065149.209058:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13867 00002000:00100000:0.0:1746065149.209064:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x18:0x0] (0->4095) req@ffff88009faca680 x1830881273233920/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746065149.209072:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faca680 with x1830881273233920 ext(0->4095) 00002000:00010000:0.0:1746065149.209074:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faca680 00000100:00100000:3.0:1746065149.210143:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273233664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5332us (5481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.210153:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14823 00000100:00100000:0.0:1746065149.214907:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.215005:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273234176 00000100:00100000:2.0:1746065149.215012:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273234176 00000100:00100000:2.0:1746065149.215049:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 193 00000100:00100000:2.0:1746065149.215054:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009facaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2484:x1830881273234176:12345-192.168.202.8@tcp:35:mmap_cat.0 00000100:00100000:2.0:1746065149.215265:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009facaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2484:x1830881273234176:12345-192.168.202.8@tcp:35:mmap_cat.0 Request processed in 210us (364us total) trans 4294983598 rc 0/0 00000100:00100000:2.0:1746065149.215270:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 193 00000100:00100000:0.0:1746065149.223765:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.223878:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273234304 00000100:00100000:2.0:1746065149.223886:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273234304 00000100:00100000:2.0:1746065149.223999:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36535 00000100:00100000:2.0:1746065149.224008:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009facad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2487:x1830881273234304:12345-192.168.202.8@tcp:101:truncate.0 00010000:00010000:2.0:1746065149.224029:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.224046:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091064600/0x392ae0376f880cf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b3b expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.224072:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f9c00/0x392ae0376f880cfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.224221:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f9c00/0x392ae0376f880cfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.224231:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f9c00/0x392ae0376f880cfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.224311:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064600/0x392ae0376f880cf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b3b expref: 21 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.224469:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f9c00/0x392ae0376f880cfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b3b expref: 20 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.224477:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:2.0:1746065149.224479:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065149.224482:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8f9c00, rc 0) 00000100:00100000:2.0:1746065149.225285:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009facad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2487:x1830881273234304:12345-192.168.202.8@tcp:101:truncate.0 Request processed in 1276us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.225291:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36535 00000100:00100000:0.0:1746065149.230107:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.230517:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273234560 00000100:00100000:2.0:1746065149.230524:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273234560 00000100:00100000:2.0:1746065149.230738:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36536 00000100:00100000:2.0:1746065149.230745:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009facb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2487:x1830881273234560:12345-192.168.202.8@tcp:36:truncate.0 00010000:00010000:2.0:1746065149.230783:0:7212:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.230803:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065800/0x392ae0376f880c33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ae0 expref: 20 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.230826:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:2.0:1746065149.230830:0:7212:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065149.230953:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.230965:0:7212:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b18 expref: 13 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.230971:0:7212:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.230996:0:7212:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b18 expref: 13 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.231005:0:7212:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b18 expref: 13 pid: 7212 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065149.231016:0:7212:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7212:1830881267822080:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065149.232373:0:7212:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.234631:0:7212:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7212:1830881267822080:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065149.234652:0:7212:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000100:00100000:0.0:1746065149.234870:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.234961:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273234688 00000100:00100000:3.0:1746065149.234967:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273234688 00010000:00010000:3.0:1746065149.234992:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b18 expref: 14 pid: 7212 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065149.235023:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14824 00000100:00100000:3.0:1746065149.235028:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5944850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2005:x1830881273234688:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.235039:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.235043:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b18 expref: 14 pid: 7212 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065149.235052:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b18 expref: 14 pid: 7212 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065149.235069:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfdc00/0x392ae0376f880cbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b18 expref: 14 pid: 7212 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065149.235117:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:3.0:1746065149.235122:0:7198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.235129:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.235134:0:7198:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.235148:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.235188:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5944850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273234688:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 159us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.235194:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14824 00010000:00010000:3.0:1746065149.235246:0:7212:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.235252:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000001:00080000:3.0:1746065149.235315:0:7212:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294983599 00000004:00010000:3.0:1746065149.235347:0:7212:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009facb100 reply state ffff88009d1de000 transno 4294983600 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.235355:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.235360:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:3.0:1746065149.235362:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065149.235364:0:7212:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065149.235412:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009facb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2487:x1830881273234560:12345-192.168.202.8@tcp:36:truncate.0 Request processed in 4667us (5312us total) trans 4294983600 rc 0/0 00000100:00100000:3.0:1746065149.235419:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36536 00000020:00080000:3.0:1746065149.235422:0:7212:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065149.236642:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.236679:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273234816 00000100:00100000:3.0:1746065149.236683:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273234816 00000100:00100000:3.0:1746065149.236719:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30856 00000100:00100000:3.0:1746065149.236724:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009facb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2487:x1830881273234816:12345-192.168.202.8@tcp:101:truncate.0 00010000:00010000:3.0:1746065149.236736:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.236747:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b42 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.236765:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.236775:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.236776:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.236779:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.236800:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.236810:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 6 pid: 9559 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065149.236820:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267822208:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065149.236888:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.241072:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.241269:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267822208:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065149.241293:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.241308:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:3.0:1746065149.241340:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009facb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2487:x1830881273234816:12345-192.168.202.8@tcp:101:truncate.0 Request processed in 4615us (4700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.241348:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30856 00000100:00100000:1.0:1746065149.241434:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273234944 00000100:00100000:1.0:1746065149.241439:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273234944 00010000:00010000:1.0:1746065149.241461:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 7 pid: 9559 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065149.241481:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14825 00000100:00100000:1.0:1746065149.241486:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009facb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273234944:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.241496:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.241511:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 7 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065149.241521:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 7 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065149.241538:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ddfd200/0x392ae0376f880cf0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b34 expref: 7 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065149.241550:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.241552:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.241557:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.241565:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.241590:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065149.241600:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880079c37100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267822336:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065149.241651:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.243578:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065149.243642:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880079c37100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267822336:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065149.243654:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065149.243676:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009facb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273234944:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2190us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.243683:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14825 00000100:00100000:2.0:1746065149.244053:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273235072 00000100:00100000:2.0:1746065149.244060:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273235072 00002000:00010000:2.0:1746065149.244117:0:27164:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/24 (858->18446744073709551615) 00002000:00100000:2.0:1746065149.244120:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009facbb80 with x1830881273235072 ext(858->18446744073709551615) 00002000:00010000:2.0:1746065149.244128:0:27164:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009facbb80. 00000100:00100000:2.0:1746065149.244148:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13868 00000100:00100000:2.0:1746065149.244153:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009facbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2002:x1830881273235072:12345-192.168.202.8@tcp:10:truncate.0 00002000:00010000:2.0:1746065149.244341:0:27164:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb size from disk: 1716 -> 858 00002000:00010000:2.0:1746065149.244344:0:27164:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb mtime from disk: 1746065148 -> 1746065148 00002000:00010000:2.0:1746065149.244346:0:27164:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb atime from disk: 1746065148 -> 0 00002000:00010000:2.0:1746065149.244347:0:27164:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb ctime from disk: 1746065148 -> 1746065148 00002000:00010000:2.0:1746065149.244349:0:27164:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1746065149.244368:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009facbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2002:x1830881273235072:12345-192.168.202.8@tcp:10:truncate.0 Request processed in 214us (795us total) trans 4294970737 rc 0/0 00000100:00100000:2.0:1746065149.244372:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13868 00002000:00010000:2.0:1746065149.244375:0:27164:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/24 (858->18446744073709551615) 00002000:00100000:2.0:1746065149.244377:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009facbb80 with x1830881273235072 ext(858->18446744073709551615) 00002000:00010000:2.0:1746065149.244379:0:27164:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009facbb80. 00010000:00010000:1.0:1746065149.258182:0:8891:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065149.259516:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.259603:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273235200 00000100:00100000:3.0:1746065149.259611:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273235200 00000100:00100000:3.0:1746065149.259659:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36537 00000100:00100000:3.0:1746065149.259665:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:2489:x1830881273235200:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:3.0:1746065149.259685:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.259698:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f880d13 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b49 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.259742:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880d1a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259752:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880d1a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259760:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880d1a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259769:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8200/0x392ae0376f880d21 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259774:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8200/0x392ae0376f880d21 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259779:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8200/0x392ae0376f880d21 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259832:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880d28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259838:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880d28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259854:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880d28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:3.0:1746065149.259880:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 858 00000004:00200000:3.0:1746065149.259885:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065149.259897:0:7212:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880d28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259905:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880d28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259911:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880d1a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259915:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880d1a lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259921:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880d1a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259925:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11000 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065149.259928:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880d1a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259933:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880d1a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259942:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff88009fd0d500) 00010000:00010000:3.0:1746065149.259945:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065149.259948:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880d1a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259952:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x392ae0376f880d1a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259977:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8200/0x392ae0376f880d21 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259982:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8200/0x392ae0376f880d21 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259985:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8200/0x392ae0376f880d21 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259990:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8f8200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065149.259992:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8200/0x392ae0376f880d21 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.259996:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8200/0x392ae0376f880d21 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.260001:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0xf9ce3da1 (ffff880129d79c00) 00010000:00010000:3.0:1746065149.260003:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065149.260006:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8200/0x392ae0376f880d21 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.260009:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8200/0x392ae0376f880d21 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065149.260027:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f880d13 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b49 expref: 24 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.260035:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0x392ae0376f880d28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b49 expref: 23 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.260040:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:3.0:1746065149.260042:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065149.260043:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:3.0:1746065149.260105:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2489:x1830881273235200:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 440us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.260110:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36537 00000100:00100000:0.0:1746065149.262857:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065149.262937:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273235456 00000100:00100000:1.0:1746065149.262945:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273235456 00002000:00100000:1.0:1746065149.262979:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x18:0x0] (0->4095) req@ffff88009faca300 x1830881273235456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.262988:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faca300 with x1830881273235456 ext(0->4095) 00002000:00010000:1.0:1746065149.262992:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faca300 00000100:00100000:1.0:1746065149.263021:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13869 00000100:00100000:1.0:1746065149.263027:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273235456:12345-192.168.202.8@tcp:3:cp.0 00000100:00100000:1.0:1746065149.263156:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273235456:12345-192.168.202.8@tcp:3:cp.0 Request processed in 128us (314us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065149.263163:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13869 00002000:00100000:1.0:1746065149.263168:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x18:0x0] (0->4095) req@ffff88009faca300 x1830881273235456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cp.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.263174:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faca300 with x1830881273235456 ext(0->4095) 00002000:00010000:1.0:1746065149.263177:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faca300 00000100:00100000:1.0:1746065149.279707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065149.279810:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273235584 00000100:00100000:0.0:1746065149.279824:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273235584 00000100:00100000:0.0:1746065149.280520:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36538 00000100:00100000:0.0:1746065149.280529:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2493:x1830881273235584:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:0.0:1746065149.280550:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.280564:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880d2f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b50 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.280608:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280618:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280627:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280637:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880d3d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280642:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880d3d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280647:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880d3d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280802:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524200/0x392ae0376f880d44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280809:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524200/0x392ae0376f880d44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280815:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524200/0x392ae0376f880d44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:0.0:1746065149.280856:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 858 00000004:00200000:0.0:1746065149.280860:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065149.280874:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524200/0x392ae0376f880d44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280881:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524200/0x392ae0376f880d44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280888:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280892:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280897:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280901:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280905:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f524400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065149.280908:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280913:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280920:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff88009fd0d500) 00010000:00010000:0.0:1746065149.280922:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065149.280925:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.280929:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880d36 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.281417:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880d3d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.281424:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880d3d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.281429:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880d3d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.281433:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f525800 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065149.281435:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880d3d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.281440:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880d3d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.281447:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0xf9ce3da1 (ffff880129d79c00) 00010000:00010000:0.0:1746065149.281449:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065149.281451:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880d3d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.281455:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880d3d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065149.281478:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f880d2f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b50 expref: 15 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.281488:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524200/0x392ae0376f880d44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b50 expref: 14 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.281493:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:0.0:1746065149.281495:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065149.281497:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f524200, rc 0) 00000100:00100000:0.0:1746065149.282781:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2493:x1830881273235584:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 2248us (3076us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.282790:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36538 00000100:00100000:0.0:1746065149.286697:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.286956:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273235712 00000100:00100000:3.0:1746065149.286964:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273235712 00000100:00100000:3.0:1746065149.287007:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30857 00000100:00100000:3.0:1746065149.287013:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273235712:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:3.0:1746065149.287026:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.287039:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e000/0x392ae0376f880d4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b57 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.287100:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267822464:192.168.202.8@tcp:106: 00000100:00100000:3.0:1746065149.287175:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58900 going to sleep for 11 seconds 00002000:00010000:3.0:1746065149.289126:0:9559:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x18:0x0] updating lvb atime: 0 -> 1746065148 00000100:00100000:3.0:1746065149.289145:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267822464:192.168.202.8@tcp:106: 00010000:00010000:3.0:1746065149.289166:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e000/0x392ae0376f880d4b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b57 expref: 7 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.289179:0:9559:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e000/0x392ae0376f880d4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b57 expref: 7 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.289195:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e000, rc 0) 00000100:00100000:3.0:1746065149.289351:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2005:x1830881273235712:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 2336us (2658us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065149.289358:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30857 00000100:00100000:0.0:1746065149.291061:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.291256:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273235968 00000100:00100000:2.0:1746065149.291264:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273235968 00000100:00100000:2.0:1746065149.291358:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36539 00000100:00100000:2.0:1746065149.291366:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2493:x1830881273235968:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746065149.291381:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.291397:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072824a00/0x392ae0376f880d52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b5e expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.291481:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727df200/0x392ae0376f880d59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.291496:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727df200/0x392ae0376f880d59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x45:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.291505:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727df200/0x392ae0376f880d59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x45:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:2.0:1746065149.291515:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 858 00010000:00010000:2.0:1746065149.291591:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072824a00/0x392ae0376f880d52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x45:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b5e expref: 17 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.292180:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727df200/0x392ae0376f880d59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x45:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b5e expref: 16 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.292187:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:2.0:1746065149.292189:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065149.292192:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727df200, rc 0) 00000100:00100000:2.0:1746065149.292500:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+16:2493:x1830881273235968:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 1134us (1442us total) trans 4294983601 rc 0/0 00000100:00100000:2.0:1746065149.292507:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36539 00000100:00100000:0.0:1746065149.294590:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.294707:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273236096 00000100:00100000:3.0:1746065149.294713:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273236096 00000100:00100000:3.0:1746065149.294752:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30858 00000100:00100000:3.0:1746065149.294757:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273236096:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:3.0:1746065149.294770:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.294782:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f880d67 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b65 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.294819:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267822592:192.168.202.8@tcp:106: 00000100:00100000:3.0:1746065149.294906:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.296445:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267822592:192.168.202.8@tcp:106: 00010000:00010000:3.0:1746065149.296465:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f880d67 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b65 expref: 7 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.296476:0:9559:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f800/0x392ae0376f880d67 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b65 expref: 7 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.296498:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f800, rc 0) 00000100:00100000:3.0:1746065149.296525:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273236096:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 1767us (1940us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065149.296531:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30858 00000100:00100000:0.0:1746065149.298405:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.298561:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273236224 00000100:00100000:3.0:1746065149.298567:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273236224 00000100:00100000:3.0:1746065149.298606:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30859 00000100:00100000:3.0:1746065149.298612:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2493:x1830881273236224:12345-192.168.202.8@tcp:101:mmap_cat.0 00010000:00010000:3.0:1746065149.298625:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.298639:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f880d6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b6c expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.298659:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.298670:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.298672:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.298675:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f880d6e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b6c expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.298698:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.298709:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 8 pid: 9559 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065149.298719:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267822720:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065149.299066:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.300975:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267822720:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065149.300994:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f880d6e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b6c expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.301005:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e600, rc 0) 00000100:00100000:3.0:1746065149.301031:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2493:x1830881273236224:12345-192.168.202.8@tcp:101:mmap_cat.0 Request processed in 2419us (2629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.301037:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30859 00000100:00100000:0.0:1746065149.301391:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065149.301433:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273236352 00000100:00100000:0.0:1746065149.301437:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273236352 00010000:00010000:0.0:1746065149.301456:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 9 pid: 9559 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065149.301482:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14826 00000100:00100000:0.0:1746065149.301486:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273236352:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065149.301495:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065149.301510:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 9 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065149.301520:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 9 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065149.301535:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc000/0x392ae0376f880d0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b42 expref: 9 pid: 9559 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065149.301547:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.301548:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.301553:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f880d6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b6c expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.301560:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f880d6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b6c expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.301581:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0e600/0x392ae0376f880d6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b6c expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.301590:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aa41180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267822848:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065149.301631:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.304037:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.304180:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aa41180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267822848:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065149.304195:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.304546:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273236608 00000100:00100000:3.0:1746065149.304551:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273236608 00002000:00100000:3.0:1746065149.304583:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x18:0x0] (0->4095) req@ffff88009aa41500 x1830881273236608/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065149.304597:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aa41500 with x1830881273236608 ext(0->4095) 00002000:00010000:3.0:1746065149.304600:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aa41500 00000100:00100000:2.0:1746065149.304726:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273236352:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3238us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.304734:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14826 00000100:00100000:3.0:1746065149.304980:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13870 00000100:00100000:3.0:1746065149.304987:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881273236608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746065149.305122:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881273236608:12345-192.168.202.8@tcp:3:ptlrpcd_01_01.0 Request processed in 135us (1089us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065149.305128:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13870 00002000:00100000:3.0:1746065149.305133:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x18:0x0] (0->4095) req@ffff88009aa41500 x1830881273236608/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746065149.305140:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aa41500 with x1830881273236608 ext(0->4095) 00002000:00010000:3.0:1746065149.305143:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aa41500 00000100:00100000:0.0:1746065149.381461:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065149.381504:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065149.381544:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065149.381594:0:7208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273236736 00000100:00100000:3.0:1746065149.381602:0:7208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273236736 00000100:00100000:3.0:1746065149.381637:0:7208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 565 00000100:00100000:3.0:1746065149.381644:0:7208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70506d4b-f74d-460b-a2d0-0f9fd3b6e38b+12:2004:x1830881273236736:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065149.382170:0:7208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70506d4b-f74d-460b-a2d0-0f9fd3b6e38b+12:2004:x1830881273236736:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 525us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.382176:0:7208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 565 00000100:00100000:1.0:1746065149.382190:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273236992 00000100:00100000:1.0:1746065149.382195:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273236992 00000100:00100000:2.0:1746065149.382198:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273236864 00000100:00100000:2.0:1746065149.382201:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273236864 00000100:00080000:0.0:1746065149.382260:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065149.382301:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 830 00000100:00100000:2.0:1746065149.382307:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273236864:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1746065149.382699:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 831 00000100:00100000:1.0:1746065149.382706:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273236992:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1746065149.382888:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273236864:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 579us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.382894:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 830 00000100:00100000:1.0:1746065149.382940:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273236992:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 234us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.382947:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 831 00000001:00080000:0.0:1746065149.590808:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970737 is committed 00000001:00100000:0.0:1746065149.590822:0:9556:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb9e1243-8634-4680-83fd-4b7a1b6b07ce 00000001:00100000:0.0:1746065149.590826:0:9556:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb9e1243-8634-4680-83fd-4b7a1b6b07ce 00000020:00000080:0.0:1746065149.590829:0:9556:0:(genops.c:904:class_export_put()) final put ffff880072974000/eb9e1243-8634-4680-83fd-4b7a1b6b07ce 00000020:00000080:0.0:1746065149.590859:0:23901:0:(genops.c:863:class_export_destroy()) destroying export ffff880072974000/eb9e1243-8634-4680-83fd-4b7a1b6b07ce for lustre-OST0000 00000020:00000080:0.0:1746065149.590905:0:23901:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880072973800 for lustre-OST0000 00000001:00080000:1.0:1746065149.590987:0:7194:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983601 is committed 00000001:00080000:1.0:1746065149.591007:0:7194:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983600 is committed 00010000:00010000:2.0:1746065149.591019:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00000004:00080000:1.0:1746065149.591019:0:7194:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 20 committed 00000004:00080000:1.0:1746065149.591026:0:7194:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 19 committed 00010000:00010000:2.0:1746065149.591030:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591036:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591041:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11800 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.591044:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591049:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591061:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf0ce3da1 (ffff880131263600) 00010000:00010000:2.0:1746065149.591063:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.591066:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591070:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x392ae0376f880b61 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591103:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591108:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591115:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591119:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10a00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.591121:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591125:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591131:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9ce3d8f (ffff88009fd0d100) 00010000:00010000:2.0:1746065149.591133:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.591134:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591138:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x392ae0376f880ba0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591147:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591151:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591155:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591158:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.591160:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591164:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591170:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x44:0x0].0x0 (ffff88009fd0d200) 00010000:00010000:2.0:1746065149.591171:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.591173:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591177:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x392ae0376f880ba7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591183:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591192:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591196:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591199:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10000 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.591202:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591206:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591212:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff88009fd0d500) 00010000:00010000:2.0:1746065149.591214:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.591216:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591220:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x392ae0376f880bae lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065149.591228:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591233:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591237:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591240:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091064a00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.591242:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591245:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591250:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0xf9ce3da1 (ffff880129d79c00) 00010000:00010000:2.0:1746065149.591252:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.591254:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591257:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064a00/0x392ae0376f880c2c lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x9:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591267:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591271:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591275:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591279:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8f8400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065149.591280:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591285:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591290:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff880129d79000) 00010000:00010000:2.0:1746065149.591291:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.591292:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065149.591296:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880d05 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00000100:00100000:1.0:1746065149.591398:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aa41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267822976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1746065149.591450:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065149.591554:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267822976 00000100:00100000:0.0:1746065149.591560:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267822976 00000100:00100000:0.0:1746065149.591601:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30860 00000100:00100000:0.0:1746065149.591607:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3768:x1830881267822976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1746065149.591627:0:21550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:25 count 1 00010000:00010000:0.0:1746065149.591643:0:21550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.591657:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.591667:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065149.591669:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065149.591671:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.591691:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 5 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.591701:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 5 pid: 9635 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065149.591710:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aa42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267823104:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065149.591760:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f51840 going to sleep for 11 seconds 00000100:00080000:1.0:1746065149.592223:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065149.595656:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065149.595680:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273237120 00000100:00100000:2.0:1746065149.595685:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273237120 00000100:00100000:0.0:1746065149.595692:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aa42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267823104:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065149.595710:0:21550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.595712:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 6 pid: 9635 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065149.595736:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14827 00000100:00100000:2.0:1746065149.595742:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273237120:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.595754:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.595758:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 6 pid: 9635 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065149.595769:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 6 pid: 9635 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065149.595786:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f880b29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6a9a expref: 6 pid: 9635 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065149.595802:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.595804:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.595808:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.595815:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.595850:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065149.595869:0:21550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.595877:0:21550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.595886:0:21550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.595895:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2005:x1830881273237120:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 153us (246us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065149.595896:0:21550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.595902:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14827 00010000:00010000:0.0:1746065149.595914:0:21550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065149.596165:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3768:x1830881267822976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4557us (4715us total) trans 4294972159 rc 0/0 00000100:00100000:0.0:1746065149.596173:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30860 00000004:00080000:0.0:1746065149.596209:0:3768:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aa41f80/2, rc 0, transno 4294972159 00000100:00100000:0.0:1746065149.596213:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aa41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267822976:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1746065149.596227:0:7202:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065149.596231:0:7202:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.596237:0:7202:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f524800 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065149.596240:0:7202:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.596247:0:7202:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.596256:0:7202:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.596261:0:7202:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f880d75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.596276:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065149.596277:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065149.596278:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065150.260059:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065151.264923:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065152.267304:0:8891:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1746065152.558267:0:28493:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 16i: read after truncate file ============ 22:05:51 (1746065151) 00000100:00100000:1.0:1746065152.611604:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.615603:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273237248 00000100:00100000:2.0:1746065152.615612:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273237248 00000100:00100000:2.0:1746065152.615683:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36540 00000100:00100000:2.0:1746065152.615692:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:3133:x1830881273237248:12345-192.168.202.8@tcp:41:stat.0 00000004:00000024:2.0:1746065152.615732:0:7211:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7842095104 avail 7379050496 00000100:00100000:2.0:1746065152.615786:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:3133:x1830881273237248:12345-192.168.202.8@tcp:41:stat.0 Request processed in 95us (4185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.615791:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36540 00000100:00080000:1.0:1746065152.615871:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065152.623294:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267823488:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623342:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c4d7531-7474-4559-997c-c1b3824c301a:3765:1830881267823232:0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623342:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.623370:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.623373:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3767:1830881267824000:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623390:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267823744:0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623390:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.623402:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a091a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3767:1830881267824512:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623407:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.623416:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.623419:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267824256:0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623432:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1746065152.623435:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.623436:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830881267823616:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623445:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267824768:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623457:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.623459:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.623468:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1746065152.623473:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880124b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830881267823360:0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623473:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dfff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267824128:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623487:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.623492:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.623498:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3765:1830881267823872:0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623504:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a091b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267824640:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623511:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.623515:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.623521:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a091a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3765:1830881267824384:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623534:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.623537:0:8658:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267823488 00000100:00100000:2.0:1746065152.623543:0:8658:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267823488 00000100:00100000:3.0:1746065152.623553:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267823232 00000100:00100000:3.0:1746065152.623556:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267823232 00000100:00100000:2.0:1746065152.623569:0:8658:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267823744 00000100:00100000:2.0:1746065152.623571:0:8658:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267823744 00000100:00100000:3.0:1746065152.623577:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1746065152.623582:0:8658:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1746065152.623584:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3765:x1830881267823232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623586:0:8658:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3767:x1830881267823488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623618:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3765:x1830881267823232:12345-0@lo:400:kworker.0 Request processed in 35us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.623619:0:8658:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3767:x1830881267823488:12345-0@lo:400:kworker.0 Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.623624:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1746065152.623624:0:8658:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1746065152.623636:0:8658:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1746065152.623640:0:8658:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267823744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623645:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267824256 00000100:00100000:3.0:1746065152.623648:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267824256 00000100:00100000:2.0:1746065152.623659:0:8658:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267823744:12345-0@lo:400:kworker.0 Request processed in 19us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.623663:0:8658:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1746065152.623668:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267824768 00000100:00100000:3.0:1746065152.623670:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267824768 00000100:00100000:2.0:1746065152.623676:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267824000 00000100:00100000:2.0:1746065152.623678:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267824000 00000100:00100000:3.0:1746065152.623680:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267824128 00000100:00100000:3.0:1746065152.623682:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267824128 00000100:00100000:3.0:1746065152.623689:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267824640 00000100:00100000:3.0:1746065152.623691:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267824640 00000100:00100000:2.0:1746065152.623691:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267824512 00000100:00100000:2.0:1746065152.623692:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267824512 00000100:00100000:2.0:1746065152.623700:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267823616 00000100:00100000:3.0:1746065152.623701:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1746065152.623701:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267823616 00000100:00100000:3.0:1746065152.623705:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267824256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623708:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267823360 00000100:00100000:2.0:1746065152.623709:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267823360 00000100:00100000:2.0:1746065152.623714:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267823872 00000100:00100000:2.0:1746065152.623716:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267823872 00000100:00100000:2.0:1746065152.623723:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267824384 00000100:00100000:2.0:1746065152.623725:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267824384 00000100:00100000:3.0:1746065152.623728:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267824256:12345-0@lo:400:kworker.0 Request processed in 22us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.623732:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1746065152.623733:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1746065152.623737:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3767:x1830881267824000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623740:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1746065152.623744:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3765:x1830881267824768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623756:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3767:x1830881267824000:12345-0@lo:400:kworker.0 Request processed in 19us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.623761:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1746065152.623764:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3765:x1830881267824768:12345-0@lo:400:kworker.0 Request processed in 19us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.623768:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:2.0:1746065152.623769:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1746065152.623773:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830881267824512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623776:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1746065152.623780:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267824128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623789:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830881267824512:12345-0@lo:400:kworker.0 Request processed in 16us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.623794:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1746065152.623796:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267824128:12345-0@lo:400:kworker.0 Request processed in 16us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.623801:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:2.0:1746065152.623801:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1746065152.623805:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3767:x1830881267823616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623807:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1746065152.623811:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267824640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623835:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3767:x1830881267823616:12345-0@lo:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.623840:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1746065152.623842:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267824640:12345-0@lo:400:kworker.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.623847:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:2.0:1746065152.623849:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1746065152.623852:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3765:x1830881267823360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623864:0:11924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1746065152.623868:0:11924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830881267823872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623869:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3765:x1830881267823360:12345-0@lo:400:kworker.0 Request processed in 17us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.623877:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1746065152.623884:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1746065152.623888:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3765:x1830881267824384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623889:0:11924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009385ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830881267823872:12345-0@lo:400:kworker.0 Request processed in 21us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.623894:0:11924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1746065152.623906:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3765:x1830881267824384:12345-0@lo:400:kworker.0 Request processed in 17us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.623910:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1746065152.623931:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830881267823360:0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623939:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830881267823616:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623940:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3765:1830881267823872:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623946:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a091a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3765:1830881267824384:0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623947:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dfff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267824128:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623952:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c4d7531-7474-4559-997c-c1b3824c301a:3765:1830881267823232:0@lo:400:kworker.0 00000100:00100000:2.0:1746065152.623955:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a091b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267824640:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.623958:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967390 gen 2 00000100:00100000:2.0:1746065152.623961:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880124b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267823488:0@lo:400:kworker.0 00000004:00080000:3.0:1746065152.623963:0:3765:0:(osp_trans.c:1031:osp_request_commit_cb()) trans no 4294967390 committed transno 4294967390 00000100:00100000:2.0:1746065152.623967:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3767:1830881267824000:0@lo:400:kworker.0 00000020:00080000:3.0:1746065152.623968:0:3765:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009ea58b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1746065152.623971:0:3765:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff88009fd0dd00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88009ea58c00 00000100:00100000:2.0:1746065152.623973:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a091a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3767:1830881267824512:0@lo:400:kworker.0 00000020:00080000:3.0:1746065152.623974:0:3765:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].8 00000020:00080000:3.0:1746065152.623976:0:3765:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff88009fd0d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009fb10e00 00000020:00080000:3.0:1746065152.623978:0:3765:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].8 00000100:00100000:3.0:1746065152.623996:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013077aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267823744:0@lo:400:kworker.0 00000020:00080000:2.0:1746065152.624001:0:7241:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000100:00100000:3.0:1746065152.624004:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267824256:0@lo:400:kworker.0 00000100:00100000:3.0:1746065152.624011:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267824768:0@lo:400:kworker.0 00000020:00080000:2.0:1746065152.624042:0:7241:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00080000:1.0:1746065152.626820:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746065152.626827:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746065152.626830:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065152.626834:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065152.661759:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065152.661789:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273237376 00000100:00100000:0.0:1746065152.661796:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273237376 00000100:00100000:0.0:1746065152.661839:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36541 00000100:00100000:0.0:1746065152.661846:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:3137:x1830881273237376:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:0.0:1746065152.661860:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.661874:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091064e00/0x392ae0376f880d7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b73 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.661918:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.661929:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.661937:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.661946:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.661952:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.661957:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.661988:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.661994:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.661999:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662005:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662009:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091064000 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065152.662012:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662018:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662027:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065152.662030:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065152.662033:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662038:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064000/0x392ae0376f880d83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662046:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662050:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662055:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662058:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091065200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065152.662061:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662065:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662071:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ce3d8f (ffff880072945c00) 00010000:00010000:0.0:1746065152.662072:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065152.662074:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662078:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065152.662126:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064e00/0x392ae0376f880d7c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b73 expref: 11 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.662132:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064e00/0x392ae0376f880d7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b73 expref: 11 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.662138:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064e00, rc 0) 00000100:00100000:0.0:1746065152.662175:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:3137:x1830881273237376:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 329us (421us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065152.662180:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36541 00000100:00100000:1.0:1746065152.678100:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065152.678128:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273237632 00000100:00100000:1.0:1746065152.678134:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273237632 00000100:00100000:1.0:1746065152.678164:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36542 00000100:00100000:1.0:1746065152.678170:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:3137:x1830881273237632:12345-192.168.202.8@tcp:36:lfs.0 00010000:00010000:1.0:1746065152.678209:0:7212:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.678228:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10200/0x392ae0376f880bca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6abd expref: 10 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.678243:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065152.678246:0:7212:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065152.678295:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065152.678304:0:7212:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6afc expref: 11 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.678309:0:7212:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065152.678330:0:7212:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6afc expref: 11 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.678339:0:7212:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6afc expref: 11 pid: 7212 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065152.678349:0:7212:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009de3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7212:1830881267824896:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065152.678402:0:7212:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065152.685184:0:7212:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009de3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7212:1830881267824896:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065152.685195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065152.685206:0:7212:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000100:00100000:2.0:1746065152.685493:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273237760 00000100:00100000:2.0:1746065152.685499:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273237760 00010000:00010000:2.0:1746065152.686199:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6afc expref: 12 pid: 7212 timeout: 851 lvb_type: 0 00000100:00080000:0.0:1746065152.686201:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065152.686221:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14828 00000100:00100000:2.0:1746065152.686228:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2004:x1830881273237760:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.686238:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.686392:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6afc expref: 12 pid: 7212 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065152.686403:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6afc expref: 12 pid: 7212 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065152.686420:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880c6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6afc expref: 12 pid: 7212 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065152.686430:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065152.686434:0:8359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.686441:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.686446:0:8359:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.686470:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065152.686482:0:7212:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.686487:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000100:00100000:2.0:1746065152.686502:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273237760:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 275us (1308us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065152.686503:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00000100:00100000:2.0:1746065152.686508:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14828 00010000:00010000:0.0:1746065152.686510:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.686515:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000100:00100000:1.0:1746065152.687919:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267825024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065152.687955:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1746065152.688872:0:7212:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].9, 2152 off49752 00000100:00100000:2.0:1746065152.688912:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267825024 00000100:00100000:2.0:1746065152.688919:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267825024 00000100:00100000:2.0:1746065152.688946:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1746065152.688952:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3766:x1830881267825024:12345-0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1746065152.688959:0:7212:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].9, 2352 off51448 00000004:00080000:0.0:1746065152.688964:0:7212:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b18310c0 with version 19 00002000:00000024:2.0:1746065152.688971:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 502102848 pending 0 free 3920871424 avail 3689349120 00000004:00080000:3.0:1746065152.689003:0:8655:0:(osp_trans.c:1327:osp_get_next_request()) ou ffff880081c7d240 version 19 rpc_version 19 00000020:00100000:3.0:1746065152.689029:0:8655:0:(genops.c:2421:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1746065152.689036:0:8655:0:(client.c:764:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009f938a80 x1830881267825280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065152.689049:0:8655:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8655:1830881267825280:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1746065152.689093:0:8655:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.689131:0:8655:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.689168:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267825280 00000100:00100000:0.0:1746065152.689172:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267825280 00000100:00100000:2.0:1746065152.689186:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3766:x1830881267825024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 234us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.689192:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1746065152.689201:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1746065152.689206:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8655:x1830881267825280:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1746065152.689297:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267825024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065152.689608:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8655:x1830881267825280:12345-0@lo:1000:osp_up1-0.0 Request processed in 401us (513us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1746065152.689613:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1746065152.689673:0:8655:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8655:1830881267825280:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1746065152.689796:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.689806:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.689826:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.689839:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.689849:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.689854:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.689870:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 3/0,1 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.689876:0:7212:0:(ldlm_request.c:1021:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 3/0,1 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.690964:0:7212:0:(ldlm_request.c:1108:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 3/0,1 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7212 initiator: MDT0 00000100:00100000:0.0:1746065152.690980:0:7212:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aa42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7212:1830881267825408:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1746065152.691072:0:7212:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.692105:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267825408 00000100:00100000:2.0:1746065152.692111:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267825408 00000100:00100000:0.0:1746065152.692114:0:7212:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d8a3240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065152.692137:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1746065152.692142:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7212:x1830881267825408:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1746065152.692156:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.692168:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f524800/0x392ae0376f880db4 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x392ae0376f880dad expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.692185:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009f524800/0x392ae0376f880db4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x392ae0376f880dad expref: 7 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.692193:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f524800/0x392ae0376f880db4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x392ae0376f880dad expref: 7 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.692198:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff880072fba000) 00010000:00010000:2.0:1746065152.692200:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065152.692202:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f524800, rc 0) 00000100:00100000:2.0:1746065152.692223:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7212:x1830881267825408:12345-0@lo:101:mdt00_001.0 Request processed in 82us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.692227:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1746065152.692382:0:7212:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aa42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7212:1830881267825408:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1746065152.692394:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.692402:0:7212:0:(ldlm_request.c:783:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1746065152.692418:0:7212:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009de3c700 reply state ffff880072799000 transno 4294983602 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692425:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692430:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa:0x0].0x0 (ffff880072945000) 00010000:00010000:0.0:1746065152.692434:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065152.692436:0:7212:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065152.692441:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.692447:0:7212:0:(ldlm_lock.c:914:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746065152.692455:0:7212:0:(osp_object.c:1377:osp_invalidate()) Invalidate osp_object [0x240000401:0xa:0x0] 00000004:00010000:0.0:1746065152.692459:0:7212:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009de3c700 reply state ffff880072799000 transno 4294983602 ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692464:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692468:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x46:0x0].0x0 (ffff880072945700) 00010000:00010000:0.0:1746065152.692470:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065152.692471:0:7212:0:(service.c:173:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1746065152.692474:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x46:0x0]: returning size 4096 00010000:00010000:0.0:1746065152.692480:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692485:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692491:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692496:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b6c000 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065152.692499:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692504:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692514:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065152.692516:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065152.692519:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692523:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c000/0x392ae0376f880d91 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00000004:00010000:0.0:1746065152.692530:0:7212:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009de3c700 reply state ffff880072799000 transno 4294983602 ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692535:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.692539:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ce3d8f (ffff880072945e00) 00010000:00010000:0.0:1746065152.692540:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065152.692542:0:7212:0:(service.c:173:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1746065152.692600:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:3137:x1830881273237632:12345-192.168.202.8@tcp:36:lfs.0 Request processed in 14429us (14517us total) trans 4294983602 rc 0/0 00000100:00100000:0.0:1746065152.692606:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36542 00000100:00100000:0.0:1746065152.700190:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.700248:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273237888 00000100:00100000:2.0:1746065152.700256:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273237888 00000100:00100000:2.0:1746065152.700308:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36543 00000100:00100000:2.0:1746065152.700314:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:3138:x1830881273237888:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065152.700331:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.700347:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524000/0x392ae0376f880dbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b7a expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.700388:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880dc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.700398:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.700406:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:2.0:1746065152.700437:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1746065152.700440:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065152.700452:0:7212:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.700467:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524000/0x392ae0376f880dbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b7a expref: 13 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.700479:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b7a expref: 12 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.700486:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065152.700488:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065152.700490:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f524400, rc 0) 00000100:00100000:2.0:1746065152.700537:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:3138:x1830881273237888:12345-192.168.202.8@tcp:101:cp.0 Request processed in 223us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.700542:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36543 00000100:00100000:0.0:1746065152.702444:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.702482:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273238016 00000100:00100000:2.0:1746065152.702487:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273238016 00000100:00100000:2.0:1746065152.702516:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36544 00000100:00100000:2.0:1746065152.702522:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:3138:x1830881273238016:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065152.702533:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.702545:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880dc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b81 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.702576:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfcc00/0x392ae0376f880dd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702583:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfcc00/0x392ae0376f880dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702590:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfcc00/0x392ae0376f880dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702595:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880dd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702599:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702602:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702647:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc800/0x392ae0376f880dde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702650:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc800/0x392ae0376f880dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702662:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc800/0x392ae0376f880dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:2.0:1746065152.702699:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x46:0x0]: returning size 4096 00000004:00200000:2.0:1746065152.702701:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1746065152.702709:0:7212:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc800/0x392ae0376f880dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702714:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfcc00/0x392ae0376f880dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702718:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfcc00/0x392ae0376f880dd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702722:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfcc00/0x392ae0376f880dd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702725:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ddfcc00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065152.702727:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfcc00/0x392ae0376f880dd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702730:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfcc00/0x392ae0376f880dd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702736:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065152.702737:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065152.702739:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfcc00/0x392ae0376f880dd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702742:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfcc00/0x392ae0376f880dd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702747:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702750:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880dd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702752:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702755:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ddfd200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065152.702756:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702761:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880dd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702764:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ce3d8f (ffff880072945e00) 00010000:00010000:2.0:1746065152.702765:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065152.702766:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880dd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702769:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f880dd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.702779:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f880dc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b81 expref: 14 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.702785:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc800/0x392ae0376f880dde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b81 expref: 13 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.702788:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x46:0x0].0x0 (ffff880072945700) 00010000:00010000:2.0:1746065152.702789:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746065152.702789:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc800, rc 0) 00000100:00100000:2.0:1746065152.702830:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:3138:x1830881273238016:12345-192.168.202.8@tcp:101:cp.0 Request processed in 308us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.702836:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36544 00000100:00100000:0.0:1746065152.703578:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.703633:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273238144 00000100:00100000:2.0:1746065152.703637:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273238144 00000100:00100000:2.0:1746065152.703659:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36545 00000100:00100000:2.0:1746065152.703663:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:3138:x1830881273238144:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065152.703670:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.703677:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880de5 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b88 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.703694:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc000/0x392ae0376f880dec lrc: 3/1,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.703700:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc000/0x392ae0376f880dec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.703706:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc000/0x392ae0376f880dec lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:2.0:1746065152.703720:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000400:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1746065152.703722:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065152.703734:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc200/0x392ae0376f880de5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b88 expref: 15 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.703743:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc000/0x392ae0376f880dec lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b88 expref: 14 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.703748:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa:0x0].0x0 (ffff880072945000) 00010000:00010000:2.0:1746065152.703749:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065152.703751:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfc000, rc 0) 00000100:00100000:2.0:1746065152.703774:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:3138:x1830881273238144:12345-192.168.202.8@tcp:101:cp.0 Request processed in 110us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.703778:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36545 00000100:00100000:0.0:1746065152.704969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.705060:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273238272 00000100:00100000:2.0:1746065152.705065:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273238272 00000100:00100000:2.0:1746065152.705116:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36546 00000100:00100000:2.0:1746065152.705123:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:3138:x1830881273238272:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065152.705130:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.705142:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f525800/0x392ae0376f880df3 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b8f expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.705170:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88fc00/0x392ae0376f880dfa lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.705179:0:7212:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f524800/0x392ae0376f880db4 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x392ae0376f880dad expref: 6 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.705185:0:7212:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88fc00/0x392ae0376f880dfa lrc: 4/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.705207:0:7212:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009f524800/0x392ae0376f880db4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x392ae0376f880dad expref: 6 pid: 7216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.705219:0:7212:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7212:1830881267825536:0@lo:104: 00000100:00100000:2.0:1746065152.705246:0:7212:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.705284:0:7212:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065152.705291:0:8890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267825536 00000100:00100000:3.0:1746065152.705295:0:8890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267825536 00000100:00080000:0.0:1746065152.705320:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746065152.705370:0:8890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1746065152.705374:0:8890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7212:x1830881267825536:12345-0@lo:104: 00010000:00010000:3.0:1746065152.705382:0:8890:0:(ldlm_lockd.c:2491:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.705413:0:8890:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1746065152.705417:0:8890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7212:x1830881267825536:12345-0@lo:104: Request processed in 43us (170us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065152.705418:0:7202:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1746065152.705422:0:8890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:0.0:1746065152.705423:0:7202:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.705429:0:7202:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8f8200 already unused, calling callback (ffffffffa0f34e30) 00010000:00010000:0.0:1746065152.705433:0:7202:0:(ldlm_request.c:1284:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1746065152.705439:0:7202:0:(mdt_handler.c:3930:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.705454:0:7202:0:(ldlm_request.c:1331:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 2/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.705458:0:7202:0:(ldlm_request.c:1377:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1746065152.705481:0:7202:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 1/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.705486:0:7202:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f8f8200/0x392ae0376f880dad lrc: 0/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x392ae0376f880db4 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065152.705498:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aa43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267825664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1746065152.705498:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065152.705499:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065152.705500:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065152.705519:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.705644:0:7212:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7212:1830881267825536:0@lo:104: 00010000:00010000:2.0:1746065152.705653:0:7212:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88fc00/0x392ae0376f880dfa lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00000100:00100000:0.0:1746065152.705694:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267825664 00000100:00100000:0.0:1746065152.705697:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267825664 00010000:00010000:0.0:1746065152.705711:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009f524800/0x392ae0376f880db4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x392ae0376f880dad expref: 7 pid: 7216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.705791:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14829 00000100:00100000:0.0:1746065152.705796:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3767:x1830881267825664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1746065152.705803:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1746065152.707158:0:8350:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967391 is committed 00010000:00010000:0.0:1746065152.707205:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f524800/0x392ae0376f880db4 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x392ae0376f880dad expref: 6 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.707216:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff880072fba000) 00010000:00010000:0.0:1746065152.707221:0:8359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88fc00/0x392ae0376f880dfa lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.707227:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88fc00/0x392ae0376f880dfa lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.707231:0:8359:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88fc00/0x392ae0376f880dfa lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.707252:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065152.707274:0:7212:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88fc00/0x392ae0376f880dfa lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.707281:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88fc00/0x392ae0376f880dfa lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00000100:00100000:0.0:1746065152.707288:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267825664:12345-0@lo:103:ldlm_bl.0 Request processed in 1491us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.707294:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14829 00000004:00200000:2.0:1746065152.707313:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000401:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1746065152.707316:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1746065152.707317:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aa43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267825664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.707344:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f525800/0x392ae0376f880df3 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b8f expref: 8 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.707359:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88fc00/0x392ae0376f880dfa lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b8f expref: 7 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.707364:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff880072fba000) 00010000:00010000:2.0:1746065152.707367:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065152.707369:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f88fc00, rc 0) 00000100:00100000:2.0:1746065152.707396:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:3138:x1830881273238272:12345-192.168.202.8@tcp:101:cp.0 Request processed in 2274us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.707402:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36546 00000100:00100000:0.0:1746065152.709022:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.709115:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273238400 00000100:00100000:2.0:1746065152.709121:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273238400 00000100:00100000:2.0:1746065152.709154:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36547 00000100:00100000:2.0:1746065152.709159:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:3138:x1830881273238400:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065152.709172:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.709183:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e000/0x392ae0376f880e01 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b96 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.709265:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f200/0x392ae0376f880e08 lrc: 3/1,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.709273:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f200/0x392ae0376f880e08 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709280:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f200/0x392ae0376f880e08 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709309:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e400/0x392ae0376f880e0f lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.709319:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e400/0x392ae0376f880e0f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709324:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e400/0x392ae0376f880e0f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709361:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f200/0x392ae0376f880e08 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709367:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f200/0x392ae0376f880e08 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709372:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f200/0x392ae0376f880e08 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709376:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f88f200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065152.709380:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f200/0x392ae0376f880e08 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709384:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f200/0x392ae0376f880e08 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709391:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff880072fba000) 00010000:00010000:2.0:1746065152.709393:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065152.709396:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f200/0x392ae0376f880e08 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709400:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f200/0x392ae0376f880e08 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709407:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e400/0x392ae0376f880e0f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709412:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e400/0x392ae0376f880e0f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709416:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e400/0x392ae0376f880e0f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709419:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f88e400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065152.709421:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e400/0x392ae0376f880e0f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709426:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e400/0x392ae0376f880e0f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709430:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x2ce3da1 (ffff880072fba800) 00010000:00010000:2.0:1746065152.709432:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065152.709434:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e400/0x392ae0376f880e0f lrc: 2/0,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709438:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e400/0x392ae0376f880e0f lrc: 0/0,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.709458:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e000/0x392ae0376f880e01 lrc: 1/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b96 expref: 8 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.709464:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88e000/0x392ae0376f880e01 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b96 expref: 8 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.709470:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f88e000, rc 0) 00000100:00100000:2.0:1746065152.709613:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:3138:x1830881273238400:12345-192.168.202.8@tcp:101:cp.0 Request processed in 452us (594us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065152.709618:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36547 00000100:00100000:0.0:1746065152.711644:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.711716:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273238656 00000100:00100000:2.0:1746065152.711721:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273238656 00000100:00100000:2.0:1746065152.711761:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36548 00000100:00100000:2.0:1746065152.711767:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:3138:x1830881273238656:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065152.711778:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.711781:0:7212:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065152.711798:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88fc00/0x392ae0376f880dfa lrc: 0/0,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b8f expref: 7 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.711824:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff880072fba000) 00010000:00010000:2.0:1746065152.711832:0:7212:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065152.711841:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88ea00/0x392ae0376f880e16 lrc: 2/0,0 mode: --/CW res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6b9d expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.711925:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f400/0x392ae0376f880e1d lrc: 3/0,1 mode: --/CW res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.711934:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f400/0x392ae0376f880e1d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.711941:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f400/0x392ae0376f880e1d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.711950:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.711955:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.711959:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00000004:00080000:2.0:1746065152.712289:0:7212:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1746065152.712370:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd11400/0x392ae0376f880e2b lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.712377:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd11400/0x392ae0376f880e2b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.712383:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd11400/0x392ae0376f880e2b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.712403:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f400/0x392ae0376f880e1d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.712408:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f400/0x392ae0376f880e1d lrc: 2/0,0 mode: CW/CW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.712413:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f400/0x392ae0376f880e1d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.712418:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f88f400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065152.712421:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f400/0x392ae0376f880e1d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.712426:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f400/0x392ae0376f880e1d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.712432:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff880072fba200) 00010000:00010000:2.0:1746065152.712435:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065152.712437:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f400/0x392ae0376f880e1d lrc: 2/0,0 mode: --/CW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.712441:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88f400/0x392ae0376f880e1d lrc: 0/0,0 mode: --/CW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00000004:00010000:2.0:1746065152.712448:0:7212:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aa41180 reply state ffff88009d1df000 transno 4294967392 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.712455:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.712460:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x2ce3da1 (ffff880072fba600) 00010000:00010000:2.0:1746065152.712461:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065152.712463:0:7212:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065152.712478:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f88ea00/0x392ae0376f880e16 lrc: 0/0,0 mode: --/CW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b9d expref: 9 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.712489:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd11400/0x392ae0376f880e2b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b9d expref: 8 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.712495:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff880072fbaf00) 00010000:00010000:2.0:1746065152.712496:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065152.712498:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd11400, rc 0) 00000100:00100000:2.0:1746065152.712642:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:3138:x1830881273238656:12345-192.168.202.8@tcp:101:cp.0 Request processed in 874us (1003us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1746065152.712648:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36548 00000100:00100000:0.0:1746065152.714720:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.714773:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273238784 00000100:00100000:2.0:1746065152.714780:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273238784 00000100:00080000:0.0:1746065152.714834:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065152.714849:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30861 00000100:00100000:2.0:1746065152.714856:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2004:x1830881273238784:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:2.0:1746065152.714868:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.714881:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f880e39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ba4 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065152.714900:0:9559:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065152.714915:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.714917:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.714924:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f880e39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ba4 expref: 6 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.714940:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f880e39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ba4 expref: 6 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.714948:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd11800, rc 0) 00000100:00100000:2.0:1746065152.714982:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273238784:12345-192.168.202.8@tcp:101:cp.0 Request processed in 127us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.714988:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30861 00000100:00100000:3.0:1746065152.718154:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065152.718369:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273238912 00000100:00100000:0.0:1746065152.718377:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273238912 00000100:00100000:0.0:1746065152.718415:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30862 00000100:00100000:0.0:1746065152.718421:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:3138:x1830881273238912:12345-192.168.202.8@tcp:101:cp.0 00010000:00010000:0.0:1746065152.718434:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.718447:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bab expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.718469:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f880e39 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ba4 expref: 7 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.718475:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.718476:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.718479:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.718501:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f880e39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ba4 expref: 7 pid: 9559 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.718510:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f880e39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ba4 expref: 7 pid: 9559 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065152.718520:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f6b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267825792:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065152.718597:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d8a3240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065152.719570:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f6b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267825792:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065152.719587:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.719597:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f0600, rc 0) 00000100:00100000:2.0:1746065152.719627:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:3138:x1830881273238912:12345-192.168.202.8@tcp:101:cp.0 Request processed in 1207us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.719633:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30862 00000100:00100000:0.0:1746065152.720064:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.720152:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273239040 00000100:00100000:2.0:1746065152.720156:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273239040 00010000:00010000:2.0:1746065152.720172:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f880e39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ba4 expref: 7 pid: 9559 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065152.720189:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14830 00000100:00100000:2.0:1746065152.720193:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273239040:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.720202:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.720216:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f880e39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ba4 expref: 7 pid: 9559 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065152.720224:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f880e39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ba4 expref: 7 pid: 9559 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065152.720378:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f880e39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ba4 expref: 7 pid: 9559 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065152.720395:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.720396:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.720402:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.720409:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.720429:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.720437:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267825920:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065152.720493:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065152.721320:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267825920:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065152.721329:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.721423:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273239040:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1228us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.721429:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14830 00000100:00100000:0.0:1746065152.722015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.722154:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273239296 00000100:00100000:2.0:1746065152.722159:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273239296 00000100:00100000:2.0:1746065152.722192:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 194 00000100:00100000:2.0:1746065152.722197:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:3138:x1830881273239296:12345-192.168.202.8@tcp:35:cp.0 00000001:00080000:2.0:1746065152.722333:0:7214:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967393 00000100:00100000:2.0:1746065152.722393:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:3138:x1830881273239296:12345-192.168.202.8@tcp:35:cp.0 Request processed in 194us (381us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1746065152.722398:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 194 00000020:00080000:2.0:1746065152.722401:0:7214:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065152.751404:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.751500:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273239552 00000100:00100000:2.0:1746065152.751508:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273239552 00000100:00100000:2.0:1746065152.751557:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36549 00000100:00100000:2.0:1746065152.751564:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:3141:x1830881273239552:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065152.751582:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.751596:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd10800/0x392ae0376f880e47 lrc: 2/0,0 mode: --/CR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bb2 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.751669:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd11e00/0x392ae0376f880e4e lrc: 3/1,0 mode: --/CR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.751679:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd11e00/0x392ae0376f880e4e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0xd:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065152.751688:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd11e00/0x392ae0376f880e4e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0xd:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00000004:00200000:2.0:1746065152.751696:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000402:0xd:0x0]: returning size 1716 00010000:00010000:2.0:1746065152.751770:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd10800/0x392ae0376f880e47 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb2 expref: 14 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.751799:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd11e00/0x392ae0376f880e4e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0xd:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb2 expref: 13 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.751807:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff880072fbaf00) 00010000:00010000:2.0:1746065152.751809:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065152.751826:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd11e00, rc 0) 00000100:00100000:2.0:1746065152.751859:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:3141:x1830881273239552:12345-192.168.202.8@tcp:101:dd.0 Request processed in 295us (461us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1746065152.751864:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36549 00000100:00100000:3.0:1746065152.783726:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065152.783745:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f6b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267826048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746065152.783796:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.783945:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267826048 00000100:00100000:2.0:1746065152.783951:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267826048 00000100:00100000:2.0:1746065152.784166:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1746065152.784173:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267826048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746065152.784191:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 502102848 pending 0 free 3920871424 avail 3689349120 00000100:00100000:2.0:1746065152.784231:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267826048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.784236:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1746065152.784264:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f6b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267826048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065152.804238:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065152.804309:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273239680 00000100:00100000:1.0:1746065152.804317:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273239680 00000100:00100000:1.0:1746065152.804371:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36550 00000100:00100000:1.0:1746065152.804378:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:3145:x1830881273239680:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065152.804400:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.804414:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6d800/0x392ae0376f880e5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bb9 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.804460:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.804471:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.804479:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:1.0:1746065152.804514:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1746065152.804517:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065152.804530:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.804546:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6d800/0x392ae0376f880e5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb9 expref: 13 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.804575:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb9 expref: 12 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.804581:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065152.804583:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065152.804586:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6c200, rc 0) 00000100:00100000:1.0:1746065152.804619:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:3145:x1830881273239680:12345-192.168.202.8@tcp:101:dd.0 Request processed in 242us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.804624:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36550 00000100:00100000:0.0:1746065152.807936:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.807997:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273239808 00000100:00100000:2.0:1746065152.808004:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273239808 00000100:00100000:2.0:1746065152.808049:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36551 00000100:00100000:2.0:1746065152.808055:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:3145:x1830881273239808:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065152.808069:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.808104:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10800/0x392ae0376f880e6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bc0 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.808144:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808153:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808162:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808169:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880e78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808173:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808178:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808232:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880e7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808238:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880e7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x46:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808243:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880e7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x46:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:2.0:1746065152.808287:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x46:0x0]: returning size 4096 00000004:00200000:2.0:1746065152.808291:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1746065152.808302:0:7212:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880e7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x46:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808309:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808314:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808319:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808328:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd11800 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065152.808331:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808336:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808344:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065152.808346:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065152.808349:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808353:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808373:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.808378:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880e78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.809671:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880e78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.809677:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd10e00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065152.809680:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880e78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.809685:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880e78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.809693:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ce3d8f (ffff880072945e00) 00010000:00010000:2.0:1746065152.809695:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065152.809697:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880e78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.809702:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880e78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.809724:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10800/0x392ae0376f880e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bc0 expref: 14 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.809733:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525800/0x392ae0376f880e7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x46:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bc0 expref: 13 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.809738:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x46:0x0].0x0 (ffff880072945700) 00010000:00010000:2.0:1746065152.809740:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746065152.809742:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f525800, rc 0) 00000100:00100000:2.0:1746065152.809786:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:3145:x1830881273239808:12345-192.168.202.8@tcp:101:dd.0 Request processed in 1731us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.809791:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36551 00000100:00100000:0.0:1746065152.814165:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.814305:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273239936 00000100:00100000:2.0:1746065152.814312:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273239936 00000100:00100000:2.0:1746065152.814915:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36552 00000100:00100000:2.0:1746065152.814922:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:3145:x1830881273239936:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065152.814936:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.814950:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e86 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bc7 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.814987:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11c00/0x392ae0376f880e8d lrc: 3/1,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.814997:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11c00/0x392ae0376f880e8d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:2.0:1746065152.815006:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11c00/0x392ae0376f880e8d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:2.0:1746065152.815035:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000400:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1746065152.815038:0:7212:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065152.815061:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11800/0x392ae0376f880e86 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bc7 expref: 15 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.815072:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11c00/0x392ae0376f880e8d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bc7 expref: 14 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.815502:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa:0x0].0x0 (ffff880072945000) 00010000:00010000:2.0:1746065152.815506:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065152.815510:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd11c00, rc 0) 00000100:00100000:2.0:1746065152.815543:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:3145:x1830881273239936:12345-192.168.202.8@tcp:101:dd.0 Request processed in 622us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.815548:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36552 00000100:00100000:0.0:1746065152.817546:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065152.817667:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273240064 00000100:00100000:1.0:1746065152.817673:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273240064 00000100:00100000:1.0:1746065152.817723:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36553 00000100:00100000:1.0:1746065152.817729:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:3145:x1830881273240064:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065152.817742:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.817755:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880e94 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bce expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.817792:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ce00/0x392ae0376f880e9b lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.817800:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ce00/0x392ae0376f880e9b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.817809:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ce00/0x392ae0376f880e9b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00000004:00200000:1.0:1746065152.817854:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000401:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1746065152.817857:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065152.817884:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880e94 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bce expref: 8 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.817901:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ce00/0x392ae0376f880e9b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bce expref: 7 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.817906:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff88009fe2fd00) 00010000:00010000:1.0:1746065152.817908:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065152.817910:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6ce00, rc 0) 00000100:00100000:1.0:1746065152.817937:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:3145:x1830881273240064:12345-192.168.202.8@tcp:101:dd.0 Request processed in 208us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.817942:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36553 00000100:00080000:0.0:1746065152.818093:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746065152.819441:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065152.819516:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273240320 00000100:00100000:0.0:1746065152.819521:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273240320 00000100:00100000:0.0:1746065152.819560:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36554 00000100:00100000:0.0:1746065152.819567:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:3145:x1830881273240320:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:0.0:1746065152.819577:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.819587:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0800/0x392ae0376f880ea2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bd5 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.819627:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0200/0x392ae0376f880ea9 lrc: 3/1,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.819635:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0200/0x392ae0376f880ea9 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819642:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0200/0x392ae0376f880ea9 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819649:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1600/0x392ae0376f880eb0 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.819654:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1600/0x392ae0376f880eb0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819658:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1600/0x392ae0376f880eb0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819725:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:0.0:1746065152.819732:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819737:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT1 00000004:00200000:0.0:1746065152.819743:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000402:0xd:0x0]: returning size 1716 00010000:00010000:0.0:1746065152.819799:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0200/0x392ae0376f880ea9 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819804:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0200/0x392ae0376f880ea9 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819808:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0200/0x392ae0376f880ea9 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819823:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800726f0200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065152.819827:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0200/0x392ae0376f880ea9 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819832:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0200/0x392ae0376f880ea9 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819842:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff88009fe2fd00) 00010000:00010000:0.0:1746065152.819844:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065152.819846:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0200/0x392ae0376f880ea9 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819851:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0200/0x392ae0376f880ea9 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819873:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1600/0x392ae0376f880eb0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819877:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1600/0x392ae0376f880eb0 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819881:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1600/0x392ae0376f880eb0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819885:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800726f1600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065152.819887:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1600/0x392ae0376f880eb0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819891:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1600/0x392ae0376f880eb0 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819897:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x2ce3da1 (ffff880072fba600) 00010000:00010000:0.0:1746065152.819899:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065152.819901:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1600/0x392ae0376f880eb0 lrc: 2/0,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819908:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1600/0x392ae0376f880eb0 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:0.0:1746065152.819935:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f0800/0x392ae0376f880ea2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bd5 expref: 10 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.819944:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bd5 expref: 9 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.819949:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff880072fbaf00) 00010000:00010000:0.0:1746065152.819951:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065152.819952:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800726f1800, rc 0) 00000100:00100000:0.0:1746065152.819982:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:3145:x1830881273240320:12345-192.168.202.8@tcp:101:dd.0 Request processed in 416us (544us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1746065152.819988:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36554 00000100:00100000:0.0:1746065152.822957:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.823015:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273240448 00000100:00100000:2.0:1746065152.823026:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273240448 00000100:00100000:2.0:1746065152.823108:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30863 00000100:00100000:2.0:1746065152.823115:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:3145:x1830881273240448:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065152.823129:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.823143:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bdc expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.823168:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.823179:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065152.823181:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065152.823184:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.823207:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.823217:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 5 pid: 9559 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065152.823226:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267826176:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065152.823299:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58540 going to sleep for 11 seconds 00000100:00080000:0.0:1746065152.823412:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065152.825801:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065152.825845:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273240576 00000100:00100000:0.0:1746065152.825851:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273240576 00002000:00100000:0.0:1746065152.825886:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5:0x0] (0->1715) req@ffff88012f6ba680 x1830881273240576/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:68/0 lens 2208/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.825894:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6ba680 with x1830881273240576 ext(0->1715) 00010000:00010000:0.0:1746065152.825900:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 6 pid: 9559 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065152.825913:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 6 pid: 9559 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746065152.825920:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f6ba680 00000100:00100000:0.0:1746065152.825936:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3160 00000100:00100000:0.0:1746065152.825942:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273240576:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:3.0:1746065152.826398:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267826176:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065152.826418:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.826430:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd10800, rc 0) 00000100:00100000:3.0:1746065152.826475:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:3145:x1830881273240448:12345-192.168.202.8@tcp:101:dd.0 Request processed in 3359us (3525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.826482:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30863 00000100:00100000:0.0:1746065152.827671:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273240576:12345-192.168.202.8@tcp:4:dd.0 Request processed in 1727us (1875us total) trans 4294970738 rc 0/0 00000100:00100000:0.0:1746065152.827678:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3160 00002000:00100000:0.0:1746065152.827684:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5:0x0] (0->1715) req@ffff88012f6ba680 x1830881273240576/t4294970738(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:68/0 lens 2208/448 e 0 to 0 dl 1746065163 ref 1 fl Complete:H/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.827692:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6ba680 with x1830881273240576 ext(0->1715) 00010000:00010000:0.0:1746065152.827699:0:27161:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 8 pid: 9559 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065152.827709:0:27161:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 8 pid: 9559 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746065152.827715:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f6ba680 00000100:00100000:0.0:1746065152.828774:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.828940:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273240704 00000100:00100000:2.0:1746065152.828946:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273240704 00010000:00010000:2.0:1746065152.828969:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 8 pid: 9559 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065152.828988:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14831 00000100:00100000:2.0:1746065152.828994:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5944450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273240704:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.829004:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065152.829014:0:8359:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 1716 00002000:00010000:2.0:1746065152.829016:0:8359:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1746065152 00002000:00010000:2.0:1746065152.829018:0:8359:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1746065152 00002000:00010000:2.0:1746065152.829019:0:8359:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1746065152 00002000:00010000:2.0:1746065152.829021:0:8359:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1746065152.829026:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 8 pid: 9559 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065152.829035:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 8 pid: 9559 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065152.829053:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800726f0600/0x392ae0376f880e40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bab expref: 8 pid: 9559 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065152.829095:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.829097:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.829103:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.829110:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.829136:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.829150:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267826304:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065152.829194:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065152.832603:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267826304:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065152.832643:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.832677:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5944450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273240704:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3683us (3904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.832686:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14831 00000100:00100000:0.0:1746065152.832882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065152.833046:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273240960 00000100:00100000:1.0:1746065152.833052:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273240960 00002000:00100000:1.0:1746065152.833110:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5:0x0] (0->4095) req@ffff88012f6baa00 x1830881273240960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.833119:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6baa00 with x1830881273240960 ext(0->4095) 00002000:00010000:1.0:1746065152.833123:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f6baa00 00000100:00100000:1.0:1746065152.833994:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13871 00000100:00100000:1.0:1746065152.834002:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273240960:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:1.0:1746065152.834132:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273240960:12345-192.168.202.8@tcp:3:dd.0 Request processed in 130us (1251us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065152.834137:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13871 00002000:00100000:1.0:1746065152.834142:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5:0x0] (0->4095) req@ffff88012f6baa00 x1830881273240960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.834150:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6baa00 with x1830881273240960 ext(0->4095) 00002000:00010000:1.0:1746065152.834154:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f6baa00 00000100:00100000:0.0:1746065152.863899:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065152.863917:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009de3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267826432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065152.863984:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.864242:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267826432 00000100:00100000:2.0:1746065152.864249:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267826432 00000100:00100000:3.0:1746065152.867115:0:8373:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1746065152.867128:0:8373:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3766:x1830881267826432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746065152.867875:0:8373:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1445957632 avail 1316495360 00000100:00100000:3.0:1746065152.867977:0:8373:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3766:x1830881267826432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 850us (3990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.867985:0:8373:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1746065152.868141:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009de3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267826432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065152.882955:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.883441:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273241216 00000100:00100000:2.0:1746065152.883454:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273241216 00000100:00100000:2.0:1746065152.884398:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 195 00000100:00100000:2.0:1746065152.884409:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:3145:x1830881273241216:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:2.0:1746065152.884759:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+10:3145:x1830881273241216:12345-192.168.202.8@tcp:35:dd.0 Request processed in 351us (1810us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1746065152.884767:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 195 00000100:00100000:0.0:1746065152.906774:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065152.906903:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273241344 00000100:00100000:1.0:1746065152.906916:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273241344 00000100:00100000:1.0:1746065152.908429:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36555 00000100:00100000:1.0:1746065152.908446:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:3148:x1830881273241344:12345-192.168.202.8@tcp:101:truncate.0 00010000:00010000:1.0:1746065152.908474:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.908497:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880ecc lrc: 2/0,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6be3 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.908533:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6d800/0x392ae0376f880ed3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.908546:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6d800/0x392ae0376f880ed3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.908560:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6d800/0x392ae0376f880ed3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.908677:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880ecc lrc: 0/0,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6be3 expref: 15 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.908708:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6d800/0x392ae0376f880ed3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6be3 expref: 14 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.908716:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff880072fbaf00) 00010000:00010000:1.0:1746065152.908719:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065152.908722:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6d800, rc 0) 00000100:00100000:1.0:1746065152.908785:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:3148:x1830881273241344:12345-192.168.202.8@tcp:101:truncate.0 Request processed in 345us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.908792:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36555 00000100:00100000:0.0:1746065152.912842:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065152.913131:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273241600 00000100:00100000:1.0:1746065152.913143:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273241600 00000100:00100000:1.0:1746065152.913205:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36556 00000100:00100000:1.0:1746065152.913214:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:3148:x1830881273241600:12345-192.168.202.8@tcp:36:truncate.0 00010000:00010000:1.0:1746065152.913637:0:7211:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.913667:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009fd11400/0x392ae0376f880e2b lrc: 0/0,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b9d expref: 14 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.913686:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff880072fbaf00) 00010000:00010000:1.0:1746065152.913690:0:7211:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065152.913861:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,1 mode: --/PW res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.913873:0:7211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bd5 expref: 9 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.913880:0:7211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 4/0,1 mode: --/PW res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.913912:0:7211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bd5 expref: 9 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.913924:0:7211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bd5 expref: 9 pid: 7212 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746065152.913937:0:7211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009de3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7211:1830881267826560:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065152.914711:0:7211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.916370:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065152.916472:0:7211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009de3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7211:1830881267826560:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065152.916496:0:7211:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,1 mode: --/PW res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00000100:00100000:2.0:1746065152.916904:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273241728 00000100:00100000:2.0:1746065152.916911:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273241728 00010000:00010000:2.0:1746065152.916941:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bd5 expref: 10 pid: 7212 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065152.916963:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14832 00000100:00100000:2.0:1746065152.916969:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+10:2004:x1830881273241728:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.916980:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.916985:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bd5 expref: 10 pid: 7212 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065152.916994:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bd5 expref: 10 pid: 7212 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065152.917013:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800726f1800/0x392ae0376f880eb7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bd5 expref: 10 pid: 7212 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065152.917402:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff880072fbaf00) 00010000:00010000:2.0:1746065152.917407:0:8359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,1 mode: --/PW res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00010000:00010000:2.0:1746065152.917854:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT1 00010000:00010000:2.0:1746065152.917862:0:8359:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT1 00010000:00010000:2.0:1746065152.917890:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.917943:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2004:x1830881273241728:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 973us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.917951:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14832 00010000:00010000:1.0:1746065152.918004:0:7211:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.918010:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00000001:00080000:1.0:1746065152.918106:0:7211:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967398 00000004:00010000:1.0:1746065152.918159:0:7211:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f6bb800 reply state ffff88007279f000 transno 4294967399 ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.918169:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.918174:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff880072fbaf00) 00010000:00010000:1.0:1746065152.918177:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065152.918179:0:7211:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065152.918242:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3148:x1830881273241600:12345-192.168.202.8@tcp:36:truncate.0 Request processed in 5030us (5408us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1746065152.918248:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36556 00000020:00080000:1.0:1746065152.918252:0:7211:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065152.922660:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065152.923470:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273241856 00000100:00100000:3.0:1746065152.923482:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273241856 00000100:00100000:3.0:1746065152.923531:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30864 00000100:00100000:3.0:1746065152.923539:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:3148:x1830881273241856:12345-192.168.202.8@tcp:101:truncate.0 00010000:00010000:3.0:1746065152.923559:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.923579:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bea expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.923611:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.923618:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.923620:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.923623:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.923670:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.923683:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 6 pid: 9559 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065152.923701:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267826688:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065152.923772:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb84b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.926632:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.926687:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273241984 00000100:00100000:2.0:1746065152.926700:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273241984 00010000:00010000:2.0:1746065152.926738:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 7 pid: 9559 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065152.926781:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14833 00000100:00100000:2.0:1746065152.926788:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273241984:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.926808:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.926842:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 7 pid: 9559 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065152.926892:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267826688:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065152.926926:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 7 pid: 9559 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065152.927007:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.927021:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb6c000, rc 0) 00010000:00010000:2.0:1746065152.927148:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10800/0x392ae0376f880ec5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bdc expref: 7 pid: 9559 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065152.927194:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.927197:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.927202:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.927210:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.927239:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.927251:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267826816:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065152.927316:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:3148:x1830881273241856:12345-192.168.202.8@tcp:101:truncate.0 Request processed in 3777us (4664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.927323:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30864 00000100:00100000:2.0:1746065152.932027:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea580c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065152.935047:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267826816:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065152.935071:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.935141:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273241984:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 8352us (8514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.935154:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14833 00000100:00100000:0.0:1746065152.940862:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065152.940968:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273242112 00000100:00100000:2.0:1746065152.940978:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273242112 00002000:00010000:2.0:1746065152.941019:0:27164:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/5 (858->18446744073709551615) 00002000:00100000:2.0:1746065152.941024:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6b8380 with x1830881273242112 ext(858->18446744073709551615) 00002000:00010000:2.0:1746065152.941036:0:27164:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f6b8380. 00000100:00100000:2.0:1746065152.941072:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13872 00000100:00100000:2.0:1746065152.941109:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273242112:12345-192.168.202.8@tcp:10:truncate.0 00002000:00010000:2.0:1746065152.941378:0:27164:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 1716 -> 858 00002000:00010000:2.0:1746065152.941381:0:27164:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1746065152 -> 1746065152 00002000:00010000:2.0:1746065152.941384:0:27164:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1746065152 -> 1746065152 00002000:00010000:2.0:1746065152.941386:0:27164:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1746065152 -> 1746065152 00002000:00010000:2.0:1746065152.941388:0:27164:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1746065152.941435:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273242112:12345-192.168.202.8@tcp:10:truncate.0 Request processed in 355us (584us total) trans 4294970739 rc 0/0 00000100:00100000:2.0:1746065152.941442:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13872 00002000:00010000:2.0:1746065152.941446:0:27164:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/5 (858->18446744073709551615) 00002000:00100000:2.0:1746065152.941448:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6b8380 with x1830881273242112 ext(858->18446744073709551615) 00002000:00010000:2.0:1746065152.941452:0:27164:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f6b8380. 00000100:00100000:0.0:1746065152.962610:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065152.962732:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273242368 00000100:00100000:1.0:1746065152.962740:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273242368 00000100:00100000:1.0:1746065152.962790:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36557 00000100:00100000:1.0:1746065152.962797:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3150:x1830881273242368:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065152.962826:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.962843:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880ee8 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bf1 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.962902:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 3/1,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.962915:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.962925:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.962934:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007299a600/0x392ae0376f880ef6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.962940:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007299a600/0x392ae0376f880ef6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.962944:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007299a600/0x392ae0376f880ef6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.963015:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8800/0x392ae0376f880efd lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.963021:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8800/0x392ae0376f880efd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.963026:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8800/0x392ae0376f880efd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00000004:00200000:1.0:1746065152.963033:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000402:0xd:0x0]: returning size 858 00010000:00010000:1.0:1746065152.963114:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.963119:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.963124:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.963129:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.963135:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727dec00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065152.963138:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.963144:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 5/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.963152:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff88009fe2fd00) 00010000:00010000:1.0:1746065152.963155:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065152.963158:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 3/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.963163:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727dec00/0x392ae0376f880eef lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.964428:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007299a600/0x392ae0376f880ef6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.964435:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007299a600/0x392ae0376f880ef6 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.964440:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007299a600/0x392ae0376f880ef6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.964444:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007299a600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065152.964446:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007299a600/0x392ae0376f880ef6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.964450:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007299a600/0x392ae0376f880ef6 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.964457:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x2ce3da1 (ffff880072fba600) 00010000:00010000:1.0:1746065152.964459:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065152.964462:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007299a600/0x392ae0376f880ef6 lrc: 2/0,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.964466:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007299a600/0x392ae0376f880ef6 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.964500:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6c000/0x392ae0376f880ee8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bf1 expref: 19 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.964509:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8800/0x392ae0376f880efd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bf1 expref: 18 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.964515:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff880072fbaf00) 00010000:00010000:1.0:1746065152.964517:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065152.964519:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a04b8800, rc 0) 00000100:00100000:1.0:1746065152.965288:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:3150:x1830881273242368:12345-192.168.202.8@tcp:101:dd.0 Request processed in 2489us (2684us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1746065152.965295:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36557 00000100:00100000:0.0:1746065152.966695:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065152.967761:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273242624 00000100:00100000:3.0:1746065152.967769:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273242624 00000100:00100000:3.0:1746065152.967841:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 196 00000100:00100000:3.0:1746065152.967847:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:3150:x1830881273242624:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:3.0:1746065152.968302:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:3150:x1830881273242624:12345-192.168.202.8@tcp:35:dd.0 Request processed in 455us (1610us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1746065152.968309:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 196 00000100:00100000:0.0:1746065152.971900:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065152.972537:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273242880 00000100:00100000:1.0:1746065152.972544:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273242880 00002000:00100000:1.0:1746065152.972579:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5:0x0] (0->4095) req@ffff8801352c0380 x1830881273242880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.972588:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352c0380 with x1830881273242880 ext(0->4095) 00002000:00010000:1.0:1746065152.972592:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801352c0380 00000100:00100000:1.0:1746065152.972608:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13873 00000100:00100000:1.0:1746065152.972614:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273242880:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:1.0:1746065152.972718:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273242880:12345-192.168.202.8@tcp:3:dd.0 Request processed in 104us (824us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065152.972727:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13873 00002000:00100000:1.0:1746065152.972731:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5:0x0] (0->4095) req@ffff8801352c0380 x1830881273242880/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.972738:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352c0380 with x1830881273242880 ext(0->4095) 00002000:00010000:1.0:1746065152.972740:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801352c0380 00000100:00100000:0.0:1746065152.993483:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065152.993746:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273243136 00000100:00100000:1.0:1746065152.993759:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273243136 00000100:00100000:1.0:1746065152.993819:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36558 00000100:00100000:1.0:1746065152.993827:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:3154:x1830881273243136:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065152.993848:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.993865:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8a00/0x392ae0376f880f0b lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bf8 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.993927:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 3/1,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.993937:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.993947:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.993955:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b9600/0x392ae0376f880f19 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.993960:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b9600/0x392ae0376f880f19 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.993964:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b9600/0x392ae0376f880f19 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.994044:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8e00/0x392ae0376f880f20 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065152.994050:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8e00/0x392ae0376f880f20 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.994058:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8e00/0x392ae0376f880f20 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00000004:00200000:1.0:1746065152.994068:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000402:0xd:0x0]: returning size 858 00010000:00010000:1.0:1746065152.994153:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.994159:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.994164:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.994169:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.994173:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a04b8400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065152.994176:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.994181:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.994190:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff88009fe2fd00) 00010000:00010000:1.0:1746065152.994193:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065152.994196:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 3/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.994205:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8400/0x392ae0376f880f12 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.995531:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b9600/0x392ae0376f880f19 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.995538:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b9600/0x392ae0376f880f19 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.995543:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b9600/0x392ae0376f880f19 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.995547:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a04b9600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065152.995550:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b9600/0x392ae0376f880f19 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.995554:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b9600/0x392ae0376f880f19 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.995563:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x2ce3da1 (ffff880072fba600) 00010000:00010000:1.0:1746065152.995565:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065152.995568:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b9600/0x392ae0376f880f19 lrc: 2/0,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.995572:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b9600/0x392ae0376f880f19 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT1 00010000:00010000:1.0:1746065152.995606:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8a00/0x392ae0376f880f0b lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bf8 expref: 12 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.995616:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a04b8e00/0x392ae0376f880f20 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bf8 expref: 11 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.995627:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff880072fbaf00) 00010000:00010000:1.0:1746065152.995628:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065152.995630:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a04b8e00, rc 0) 00000100:00100000:1.0:1746065152.995682:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:3154:x1830881273243136:12345-192.168.202.8@tcp:101:dd.0 Request processed in 1855us (2206us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1746065152.995689:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36558 00000100:00100000:0.0:1746065152.997595:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065152.997676:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273243264 00000100:00100000:3.0:1746065152.997683:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273243264 00000100:00100000:3.0:1746065152.997713:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30865 00000100:00100000:3.0:1746065152.997718:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:3154:x1830881273243264:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1746065152.997729:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.997747:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb6d000/0x392ae0376f880f2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6bff expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.997767:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.997773:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065152.997774:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065152.997780:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb6d000/0x392ae0376f880f2e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bff expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.997802:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.997823:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 8 pid: 9559 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065152.997834:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267826944:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065153.001338:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb84e40 going to sleep for 10 seconds 00000100:00100000:3.0:1746065153.006468:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9559:1830881267826944:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065153.006496:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb6d000/0x392ae0376f880f2e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bff expref: 7 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.006512:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb6d000, rc 0) 00000100:00100000:3.0:1746065153.006567:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:3154:x1830881273243264:12345-192.168.202.8@tcp:101:dd.0 Request processed in 8847us (8975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065153.006574:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30865 00000100:00100000:0.0:1746065153.006638:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065153.007271:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273243392 00000100:00100000:2.0:1746065153.007277:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273243392 00010000:00010000:2.0:1746065153.007306:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 9 pid: 9559 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065153.007333:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14834 00000100:00100000:2.0:1746065153.007339:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273243392:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065153.007349:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065153.007368:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 9 pid: 9559 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065153.007378:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 9 pid: 9559 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065153.007399:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb6c000/0x392ae0376f880ee1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bea expref: 9 pid: 9559 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065153.007421:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065153.007424:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065153.007428:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb6d000/0x392ae0376f880f2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bff expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.007435:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb6d000/0x392ae0376f880f2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bff expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.007465:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb6d000/0x392ae0376f880f2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bff expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065153.007476:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267827072:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065153.007537:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea580c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065153.011195:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065153.011256:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273243648 00000100:00100000:3.0:1746065153.011264:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273243648 00002000:00100000:3.0:1746065153.011304:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x5:0x0] (0->4095) req@ffff8801352c1180 x1830881273243648/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:69/0 lens 488/0 e 0 to 0 dl 1746065164 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065153.011313:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352c1180 with x1830881273243648 ext(0->4095) 00002000:00010000:3.0:1746065153.011317:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801352c1180 00000100:00100000:3.0:1746065153.011348:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13874 00000100:00100000:3.0:1746065153.011355:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881273243648:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:3.0:1746065153.011473:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881273243648:12345-192.168.202.8@tcp:3:dd.0 Request processed in 118us (286us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065153.011478:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13874 00002000:00100000:3.0:1746065153.011484:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x5:0x0] (0->4095) req@ffff8801352c1180 x1830881273243648/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:69/0 lens 488/4536 e 0 to 0 dl 1746065164 ref 1 fl Complete:/200/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065153.011490:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352c1180 with x1830881273243648 ext(0->4095) 00002000:00010000:3.0:1746065153.011493:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801352c1180 00000100:00100000:2.0:1746065153.011531:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267827072:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065153.011545:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065153.011568:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273243392:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4229us (4930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065153.011575:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14834 00000100:00100000:0.0:1746065153.029563:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065153.029625:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273243904 00000100:00100000:3.0:1746065153.029633:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273243904 00000100:00100000:3.0:1746065153.029684:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 197 00000100:00100000:3.0:1746065153.029692:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:3154:x1830881273243904:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:3.0:1746065153.029872:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:3154:x1830881273243904:12345-192.168.202.8@tcp:35:dd.0 Request processed in 180us (314us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1746065153.029878:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 197 00010000:00010000:3.0:1746065153.270007:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065154.000022:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009de3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267827200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746065154.000094:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065154.010685:0:8373:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267827200 00000100:00100000:3.0:1746065154.010697:0:8373:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267827200 00000100:00100000:3.0:1746065154.010749:0:8373:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1746065154.010756:0:8373:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3766:x1830881267827200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1746065154.010791:0:8373:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446170624 avail 1316708352 00000100:00100000:3.0:1746065154.010856:0:8373:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3766:x1830881267827200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (10775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.010862:0:8373:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1746065154.010900:0:3766:0:(client.c:2927:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967391 gen 2 00000004:00080000:2.0:1746065154.010905:0:3766:0:(osp_trans.c:1031:osp_request_commit_cb()) trans no 4294967391 committed transno 4294967391 00000100:00100000:2.0:1746065154.010942:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009de3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267827200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746065154.063183:0:3768:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065154.063198:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267827328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746065154.063246:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065154.063296:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267827328 00000100:00100000:1.0:1746065154.063302:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267827328 00000100:00100000:1.0:1746065154.063332:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1746065154.063337:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267827328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746065154.063359:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 498625344 pending 28672 free 3921219584 avail 3689697280 00000100:00100000:1.0:1746065154.063383:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267827328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.063388:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1746065154.063413:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267827328:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1746065154.063429:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065154.127393:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065154.127411:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267827456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065154.127464:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065154.127598:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267827456 00000100:00100000:2.0:1746065154.127604:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267827456 00000100:00080000:1.0:1746065154.127630:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065154.127645:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1746065154.127651:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267827456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746065154.127673:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 498625344 pending 28672 free 3921219584 avail 3689697280 00000100:00100000:2.0:1746065154.127708:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267827456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.127713:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1746065154.127903:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267827456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1746065154.272222:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065154.393139:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065154.393877:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065154.393954:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273244160 00000100:00100000:1.0:1746065154.393962:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273244160 00000100:00100000:1.0:1746065154.394005:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1207 00000100:00100000:1.0:1746065154.394012:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2004:x1830881273244160:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1746065154.394062:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2004:x1830881273244160:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 51us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.394068:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1207 00000100:00080000:1.0:1746065154.394098:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065154.394381:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273244416 00000100:00100000:3.0:1746065154.394385:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273244416 00000100:00100000:3.0:1746065154.394413:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 836 00000100:00100000:3.0:1746065154.394418:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273244416:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065154.394441:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273244416:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.394447:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 836 00000100:00080000:1.0:1746065154.394692:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065154.394931:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065154.394947:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065154.394974:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065154.394990:0:7208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273244032 00000100:00100000:3.0:1746065154.394993:0:7208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273244032 00000100:00100000:3.0:1746065154.395014:0:7208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 567 00000100:00100000:3.0:1746065154.395019:0:7208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b95f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70506d4b-f74d-460b-a2d0-0f9fd3b6e38b+12:2004:x1830881273244032:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065154.395042:0:7208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b95f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70506d4b-f74d-460b-a2d0-0f9fd3b6e38b+12:2004:x1830881273244032:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 24us (68us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.395047:0:7208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 567 00000100:00100000:2.0:1746065154.395961:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273244928 00000100:00100000:2.0:1746065154.395965:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273244928 00000100:00100000:2.0:1746065154.395987:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 837 00000100:00100000:2.0:1746065154.395991:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273244928:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1746065154.396017:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273244928:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 25us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.396022:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 837 00000100:00080000:1.0:1746065154.396226:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065154.396577:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273244672 00000100:00100000:0.0:1746065154.396581:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273244672 00000100:00100000:0.0:1746065154.396608:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1208 00000100:00100000:0.0:1746065154.396612:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2004:x1830881273244672:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:0.0:1746065154.396638:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2004:x1830881273244672:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 25us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.396643:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1208 00000100:00080000:1.0:1746065154.396699:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065154.396882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065154.396912:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065154.396957:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065154.396978:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065154.396991:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273244288 00000100:00100000:3.0:1746065154.396994:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273244288 00000100:00100000:3.0:1746065154.397011:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273244800 00000100:00100000:3.0:1746065154.397013:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273244800 00000100:00100000:3.0:1746065154.397025:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1209 00000100:00100000:3.0:1746065154.397030:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2004:x1830881273244288:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065154.397057:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2004:x1830881273244288:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 26us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.397062:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1209 00000100:00100000:3.0:1746065154.397072:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1210 00000100:00100000:3.0:1746065154.397076:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2004:x1830881273244800:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065154.397112:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2004:x1830881273244800:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.397117:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1210 00000100:00100000:3.0:1746065154.397167:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273244544 00000100:00100000:3.0:1746065154.397170:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273244544 00000100:00100000:3.0:1746065154.397185:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273245056 00000100:00100000:3.0:1746065154.397187:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273245056 00000100:00100000:3.0:1746065154.397200:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 838 00000100:00100000:3.0:1746065154.397204:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2004:x1830881273244544:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065154.397226:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2004:x1830881273244544:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 21us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.397231:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 838 00000100:00100000:3.0:1746065154.397239:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 839 00000100:00100000:3.0:1746065154.397243:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273245056:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065154.397260:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:2004:x1830881273245056:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 16us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.397265:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 839 00000100:00080000:1.0:1746065154.397530:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065154.397533:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1746065155.274247:0:8891:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1746065155.601532:0:10896:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294972159 is committed 00000001:02000400:3.0:1746065156.153847:0:28754:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 16j: race dio with buffered i/o ========== 22:05:54 (1746065154) 00000100:00100000:3.0:1746065156.194027:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065156.194280:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273245312 00000100:00100000:0.0:1746065156.194288:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273245312 00000100:00100000:0.0:1746065156.194330:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36559 00000100:00100000:0.0:1746065156.194336:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:3792:x1830881273245312:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:0.0:1746065156.194351:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.194354:0:7211:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065156.194376:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f524400/0x392ae0376f880dc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6b7a expref: 14 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.194388:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065156.194392:0:7211:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065156.194401:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8a00/0x392ae0376f880f35 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c06 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.194474:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.194485:0:7211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb9 expref: 13 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.194491:0:7211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.194513:0:7211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb9 expref: 13 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.194524:0:7211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb9 expref: 13 pid: 7211 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746065156.194534:0:7211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7211:1830881267827584:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065156.194596:0:7211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572b40 going to sleep for 11 seconds 00000100:00080000:0.0:1746065156.194614:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065156.200337:0:7211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7211:1830881267827584:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065156.200356:0:7211:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000100:00100000:2.0:1746065156.200425:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065156.200446:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273245440 00000100:00100000:2.0:1746065156.200450:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273245440 00010000:00010000:2.0:1746065156.200478:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb9 expref: 14 pid: 7211 timeout: 855 lvb_type: 0 00000100:00080000:0.0:1746065156.200490:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065156.200496:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14835 00000100:00100000:2.0:1746065156.200501:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2004:x1830881273245440:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.200512:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.200523:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb9 expref: 14 pid: 7211 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065156.200534:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb9 expref: 14 pid: 7211 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065156.200554:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f880e63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6bb9 expref: 14 pid: 7211 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065156.200564:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065156.200568:0:8359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065156.200575:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065156.200581:0:8359:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065156.200607:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.200637:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2004:x1830881273245440:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 135us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.200643:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14835 00010000:00010000:0.0:1746065156.201011:0:7211:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201017:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201070:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201077:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201105:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201361:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201367:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201372:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:0.0:1746065156.201378:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x47:0x0]: returning size 0 00010000:00010000:0.0:1746065156.201395:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201402:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201406:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201411:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201415:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a04b9600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065156.201418:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201423:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201429:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065156.201432:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065156.201435:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201439:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f880f3c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00000004:00010000:0.0:1746065156.201446:0:7211:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801307cd880 reply state ffff88008256c000 transno 4294983603 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201451:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.201455:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6ecf (ffff880072945b00) 00010000:00010000:0.0:1746065156.201456:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065156.201458:0:7211:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065156.201479:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8a00/0x392ae0376f880f35 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c06 expref: 16 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.201488:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c06 expref: 15 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.201493:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff880072945d00) 00010000:00010000:0.0:1746065156.201495:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065156.201497:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a04b8600, rc 0) 00000100:00100000:0.0:1746065156.201533:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3792:x1830881273245312:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 7197us (7510us total) trans 4294983603 rc 0/0 00000100:00100000:0.0:1746065156.201539:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36559 00000100:00100000:0.0:1746065156.204914:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065156.204968:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273245696 00000100:00100000:1.0:1746065156.204975:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273245696 00000100:00100000:1.0:1746065156.205021:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36560 00000100:00100000:1.0:1746065156.205028:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3792:x1830881273245696:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:1.0:1746065156.205046:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065156.205059:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f880f58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c0d expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.205155:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.205164:0:7211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c06 expref: 17 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.205169:0:7211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.205193:0:7211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c06 expref: 17 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.205203:0:7211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c06 expref: 17 pid: 7211 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746065156.205217:0:7211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009de3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7211:1830881267827712:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065156.205275:0:7211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ff779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065156.207037:0:7211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009de3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7211:1830881267827712:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065156.207054:0:7211:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000100:00100000:0.0:1746065156.212072:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065156.212112:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273245824 00000100:00100000:0.0:1746065156.212119:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273245824 00010000:00010000:0.0:1746065156.212143:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c06 expref: 18 pid: 7211 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746065156.212168:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14836 00000100:00100000:0.0:1746065156.212173:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273245824:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065156.212182:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.212187:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c06 expref: 18 pid: 7211 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746065156.212197:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c06 expref: 18 pid: 7211 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746065156.212213:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f880f4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c06 expref: 18 pid: 7211 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746065156.212224:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff880072945d00) 00010000:00010000:0.0:1746065156.212228:0:8359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.212234:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.212240:0:8359:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065156.212264:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065156.212269:0:7211:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.212277:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:1.0:1746065156.212293:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x47:0x0]: returning size 0 00000100:00100000:0.0:1746065156.212299:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881273245824:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 126us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.212305:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14836 00000004:00080000:1.0:1746065156.212401:0:7211:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1a:0x0], index 1: 0 00000004:00080000:1.0:1746065156.212407:0:7211:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x19:0x0], index 0: 0 00010000:00010000:1.0:1746065156.212476:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.212483:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.212488:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.212493:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072568a00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065156.212496:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.212502:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.212512:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff880072945d00) 00010000:00010000:1.0:1746065156.212514:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065156.212517:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.212521:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f880f5f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.212557:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f880f58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c0d expref: 17 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.212564:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f880f58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c0d expref: 17 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.212570:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072568800, rc 0) 00000100:00100000:1.0:1746065156.212600:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3792:x1830881273245696:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 7566us (7686us total) trans 4294983604 rc 301/301 00000100:00100000:1.0:1746065156.212607:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36560 00000100:00100000:0.0:1746065156.217153:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065156.218695:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273246080 00000100:00100000:0.0:1746065156.218701:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273246080 00000100:00100000:0.0:1746065156.219465:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 198 00000100:00100000:0.0:1746065156.219473:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3792:x1830881273246080:12345-192.168.202.8@tcp:35:lfs.0 00000100:00100000:0.0:1746065156.219641:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:3792:x1830881273246080:12345-192.168.202.8@tcp:35:lfs.0 Request processed in 169us (2494us total) trans 4294983605 rc 0/0 00000100:00100000:0.0:1746065156.219647:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 198 00000100:00100000:0.0:1746065156.222288:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065156.222340:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273246208 00000100:00100000:1.0:1746065156.222347:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273246208 00000100:00100000:1.0:1746065156.222379:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36561 00000100:00100000:1.0:1746065156.222386:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:3792:x1830881273246208:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:1.0:1746065156.222401:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065156.222415:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072569800/0x392ae0376f880f6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c14 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.222456:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072569800/0x392ae0376f880f6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c14 expref: 18 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.222472:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569800/0x392ae0376f880f6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c14 expref: 18 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.222485:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:1.0:1746065156.222488:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065156.222491:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072569800, rc 0) 00000100:00100000:1.0:1746065156.222522:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:3792:x1830881273246208:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 137us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065156.222528:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36561 00000100:00100000:0.0:1746065156.225389:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065156.225474:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273246464 00000100:00100000:2.0:1746065156.225482:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273246464 00000100:00100000:2.0:1746065156.225570:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 199 00000100:00100000:2.0:1746065156.225578:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:3792:x1830881273246464:12345-192.168.202.8@tcp:35:lfs.0 00000100:00100000:2.0:1746065156.226071:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:3792:x1830881273246464:12345-192.168.202.8@tcp:35:lfs.0 Request processed in 492us (688us total) trans 4294983606 rc 0/0 00000100:00100000:2.0:1746065156.226077:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 199 00000100:00100000:0.0:1746065156.241950:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065156.242601:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273246592 00000100:00100000:3.0:1746065156.242609:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273246592 00000100:00100000:3.0:1746065156.242659:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36562 00000100:00100000:3.0:1746065156.242666:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:3796:x1830881273246592:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1746065156.242684:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.242698:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184a00/0x392ae0376f880f74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c1b expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.242745:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185e00/0x392ae0376f880f7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.242755:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185e00/0x392ae0376f880f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.242763:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185e00/0x392ae0376f880f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:3.0:1746065156.242809:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1746065156.244771:0:21520:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065156.244810:0:21520:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185e00/0x392ae0376f880f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.244838:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184a00/0x392ae0376f880f74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c1b expref: 21 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.244875:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185e00/0x392ae0376f880f7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c1b expref: 20 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.244891:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065156.244893:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065156.244896:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d185e00, rc 0) 00000100:00100000:3.0:1746065156.244949:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:3796:x1830881273246592:12345-192.168.202.8@tcp:101:dd.0 Request processed in 2284us (3006us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.244955:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36562 00000100:00100000:2.0:1746065156.248810:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065156.249173:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273246848 00000100:00100000:3.0:1746065156.249181:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273246848 00000100:00100000:3.0:1746065156.249236:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36563 00000100:00100000:3.0:1746065156.249243:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:3796:x1830881273246848:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1746065156.249259:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.249262:0:21520:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065156.249325:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185e00/0x392ae0376f880f7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c1b expref: 20 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.249338:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065156.249342:0:21520:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065156.249351:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185000/0x392ae0376f880f82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c22 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.249445:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f880f89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249454:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f880f89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249461:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f880f89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249472:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f880f90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249477:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f880f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249482:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f880f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249518:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185400/0x392ae0376f880f97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249524:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185400/0x392ae0376f880f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249528:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185400/0x392ae0376f880f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:3.0:1746065156.249534:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x47:0x0]: returning size 0 00010000:00010000:3.0:1746065156.249589:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f880f89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249594:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f880f89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249600:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f880f89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249604:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d184c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065156.249608:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f880f89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249613:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f880f89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249620:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065156.249622:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065156.249625:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f880f89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249629:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f880f89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249635:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f880f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249639:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f880f90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249642:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f880f90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249646:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d184000 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065156.249648:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f880f90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249652:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f880f90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249657:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6ecf (ffff880072945b00) 00010000:00010000:3.0:1746065156.249658:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065156.249660:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f880f90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249664:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f880f90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.249687:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185000/0x392ae0376f880f82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c22 expref: 22 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.249696:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185400/0x392ae0376f880f97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c22 expref: 21 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.249701:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:3.0:1746065156.249703:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065156.249704:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d185400, rc 0) 00000100:00100000:3.0:1746065156.250021:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:3796:x1830881273246848:12345-192.168.202.8@tcp:101:dd.0 Request processed in 777us (1216us total) trans 4294983607 rc 0/0 00000100:00100000:3.0:1746065156.250027:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36563 00000100:00100000:0.0:1746065156.252012:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065156.252104:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273246976 00000100:00100000:3.0:1746065156.252110:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273246976 00000100:00100000:3.0:1746065156.252149:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36564 00000100:00100000:3.0:1746065156.252154:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:3796:x1830881273246976:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1746065156.252170:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.252183:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185800/0x392ae0376f880fa5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c29 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.252204:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185600/0x392ae0376f880fac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.252213:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185600/0x392ae0376f880fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.252222:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185600/0x392ae0376f880fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065156.252295:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185800/0x392ae0376f880fa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c29 expref: 23 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.252310:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185600/0x392ae0376f880fac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c29 expref: 22 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.252316:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:3.0:1746065156.252318:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065156.252320:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d185600, rc 0) 00000100:00100000:3.0:1746065156.252539:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:3796:x1830881273246976:12345-192.168.202.8@tcp:101:dd.0 Request processed in 384us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.252545:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36564 00000100:00100000:2.0:1746065156.254777:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065156.255407:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273247232 00000100:00100000:1.0:1746065156.255414:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273247232 00000100:00100000:1.0:1746065156.255544:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36565 00000100:00100000:1.0:1746065156.255552:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+22:3796:x1830881273247232:12345-192.168.202.8@tcp:36:dd.0 00010000:00010000:1.0:1746065156.255587:0:7211:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065156.255606:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185400/0x392ae0376f880f97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c22 expref: 22 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.255720:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:1.0:1746065156.255724:0:7211:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065156.255843:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.255854:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.255861:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000001:00080000:1.0:1746065156.255903:0:7211:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294983608 00000004:00010000:1.0:1746065156.255917:0:7211:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801352ce680 reply state ffff88009f994000 transno 4294983609 ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.255925:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065156.255931:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:1.0:1746065156.255933:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065156.255935:0:7211:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065156.255996:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:3796:x1830881273247232:12345-192.168.202.8@tcp:36:dd.0 Request processed in 445us (1223us total) trans 4294983609 rc 0/0 00000100:00100000:1.0:1746065156.256002:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36565 00000020:00080000:1.0:1746065156.256005:0:7211:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065156.258015:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065156.258074:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273247360 00000100:00100000:2.0:1746065156.258099:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273247360 00000100:00080000:0.0:1746065156.258169:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065156.258256:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30866 00000100:00100000:2.0:1746065156.258264:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:3796:x1830881273247360:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065156.258276:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.258289:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c30 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065156.258305:0:9559:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065156.258319:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.258321:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.258325:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.258337:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.258345:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f88ea00, rc 0) 00000100:00100000:2.0:1746065156.258381:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:3796:x1830881273247360:12345-192.168.202.8@tcp:101:dd.0 Request processed in 119us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.258386:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30866 00000100:00100000:0.0:1746065156.260072:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065156.260534:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273247488 00000100:00100000:3.0:1746065156.260541:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273247488 00000100:00080000:0.0:1746065156.260660:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065156.260700:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30867 00000100:00100000:3.0:1746065156.260708:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:3796:x1830881273247488:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1746065156.260721:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.260735:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d184e00/0x392ae0376f880fc1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c37 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065156.260753:0:9558:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065156.260768:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.260769:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.260774:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d184e00/0x392ae0376f880fc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c37 expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.260798:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d184e00/0x392ae0376f880fc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c37 expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.260809:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d184e00, rc 0) 00000100:00100000:3.0:1746065156.260837:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:3796:x1830881273247488:12345-192.168.202.8@tcp:101:dd.0 Request processed in 131us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.260842:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30867 00000100:00100000:0.0:1746065156.262824:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065156.263052:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065156.263208:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273247616 00000100:00100000:1.0:1746065156.263215:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273247616 00002000:00010000:1.0:1746065156.263241:0:27161:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/26 (0->18446744073709551615) 00002000:00100000:1.0:1746065156.263245:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8380 with x1830881273247616 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065156.263254:0:27161:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b8380. 00000100:00100000:1.0:1746065156.263267:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273247744 00000100:00100000:1.0:1746065156.263269:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273247744 00002000:00010000:1.0:1746065156.263276:0:27161:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/25 (0->18446744073709551615) 00002000:00100000:1.0:1746065156.263279:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8700 with x1830881273247744 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065156.263283:0:27161:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237b8700. 00000100:00100000:1.0:1746065156.263294:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13875 00000100:00100000:1.0:1746065156.263300:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273247616:12345-192.168.202.8@tcp:10:dd.0 00002000:00010000:1.0:1746065156.263416:0:27161:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x1a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065156.263419:0:27161:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x1a:0x0] updating lvb mtime from disk: 0 -> 1746065155 00002000:00010000:1.0:1746065156.263421:0:27161:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x1a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065156.263423:0:27161:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x1a:0x0] updating lvb ctime from disk: 0 -> 1746065155 00002000:00010000:1.0:1746065156.263424:0:27161:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x1a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065156.263454:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273247616:12345-192.168.202.8@tcp:10:dd.0 Request processed in 153us (635us total) trans 4294972160 rc 0/0 00000100:00100000:1.0:1746065156.263459:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13875 00002000:00010000:1.0:1746065156.263462:0:27161:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/26 (0->18446744073709551615) 00002000:00100000:1.0:1746065156.263464:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8380 with x1830881273247616 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065156.263467:0:27161:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b8380. 00000100:00100000:1.0:1746065156.263479:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13876 00000100:00100000:1.0:1746065156.263484:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273247744:12345-192.168.202.8@tcp:10:dd.0 00002000:00010000:1.0:1746065156.263541:0:27161:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065156.263543:0:27161:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb mtime from disk: 0 -> 1746065155 00002000:00010000:1.0:1746065156.263545:0:27161:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065156.263547:0:27161:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb ctime from disk: 0 -> 1746065155 00002000:00010000:1.0:1746065156.263548:0:27161:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065156.263564:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881273247744:12345-192.168.202.8@tcp:10:dd.0 Request processed in 80us (512us total) trans 4294970740 rc 0/0 00000100:00100000:1.0:1746065156.263569:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13876 00002000:00010000:1.0:1746065156.263571:0:27161:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/25 (0->18446744073709551615) 00002000:00100000:1.0:1746065156.263573:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8700 with x1830881273247744 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065156.263576:0:27161:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237b8700. 00010000:00010000:2.0:1746065156.275401:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065156.745269:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065156.745363:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273248000 00000100:00100000:3.0:1746065156.745371:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273248000 00002000:00100000:3.0:1746065156.745407:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1a:0x0] (0->4194303) req@ffff8801237b8a80 x1830881273248000/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.745439:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8a80 with x1830881273248000 ext(0->4194303) 00002000:00010000:3.0:1746065156.745444:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b8a80 00000100:00100000:3.0:1746065156.746147:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13877 00000100:00100000:3.0:1746065156.746156:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273248000:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065156.756905:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065156.756930:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273248256 00000100:00100000:0.0:1746065156.756937:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273248256 00002000:00100000:0.0:1746065156.756971:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x19:0x0] (0->4194303) req@ffff8801237b8e00 x1830881273248256/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.756979:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8e00 with x1830881273248256 ext(0->4194303) 00002000:00010000:0.0:1746065156.756984:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237b8e00 00000100:00100000:0.0:1746065156.757001:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13878 00000100:00100000:0.0:1746065156.757008:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881273248256:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065156.819715:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273248000:12345-192.168.202.8@tcp:4:dd.0 Request processed in 73551us (74444us total) trans 4294972161 rc 0/0 00000100:00100000:0.0:1746065156.819726:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13877 00002000:00100000:0.0:1746065156.819735:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1a:0x0] (0->4194303) req@ffff8801237b8a80 x1830881273248000/t4294972161(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.819744:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8a80 with x1830881273248000 ext(0->4194303) 00002000:00010000:0.0:1746065156.819749:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b8a80 00000100:00100000:0.0:1746065156.833393:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2004:x1830881273248256:12345-192.168.202.8@tcp:4:dd.0 Request processed in 76376us (76486us total) trans 4294970741 rc 0/0 00000100:00100000:0.0:1746065156.833404:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13878 00002000:00100000:0.0:1746065156.833414:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x19:0x0] (0->4194303) req@ffff8801237b8e00 x1830881273248256/t4294970741(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.833425:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8e00 with x1830881273248256 ext(0->4194303) 00002000:00010000:0.0:1746065156.833430:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237b8e00 00000100:00100000:0.0:1746065156.848706:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065156.848861:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273248512 00000100:00100000:2.0:1746065156.848869:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273248512 00002000:00100000:2.0:1746065156.848907:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1a:0x0] (4194304->8388607) req@ffff8801237b9180 x1830881273248512/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.848916:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b9180 with x1830881273248512 ext(4194304->8388607) 00002000:00010000:2.0:1746065156.848921:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b9180 00000100:00100000:2.0:1746065156.848949:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13879 00000100:00100000:2.0:1746065156.848956:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273248512:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:2.0:1746065156.866233:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065156.866476:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273248768 00000100:00100000:1.0:1746065156.866484:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273248768 00002000:00100000:1.0:1746065156.866517:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x19:0x0] (4194304->8388607) req@ffff8801352cea00 x1830881273248768/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.866531:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352cea00 with x1830881273248768 ext(4194304->8388607) 00002000:00010000:1.0:1746065156.866537:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801352cea00 00000100:00100000:1.0:1746065156.866550:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13880 00000100:00100000:1.0:1746065156.866556:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2004:x1830881273248768:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065156.912871:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2004:x1830881273248512:12345-192.168.202.8@tcp:4:dd.0 Request processed in 63908us (64165us total) trans 4294972162 rc 0/0 00000100:00100000:0.0:1746065156.912881:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13879 00002000:00100000:0.0:1746065156.912892:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1a:0x0] (4194304->8388607) req@ffff8801237b9180 x1830881273248512/t4294972162(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.912901:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b9180 with x1830881273248512 ext(4194304->8388607) 00002000:00010000:0.0:1746065156.912906:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b9180 00000100:00100000:2.0:1746065156.937815:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2004:x1830881273248768:12345-192.168.202.8@tcp:4:dd.0 Request processed in 71249us (71580us total) trans 4294970742 rc 0/0 00000100:00100000:2.0:1746065156.937825:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13880 00002000:00100000:2.0:1746065156.937834:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x19:0x0] (4194304->8388607) req@ffff8801352cea00 x1830881273248768/t4294970742(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.937842:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352cea00 with x1830881273248768 ext(4194304->8388607) 00002000:00010000:2.0:1746065156.937847:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801352cea00 00000100:00100000:0.0:1746065156.956761:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065156.956925:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273249024 00000100:00100000:2.0:1746065156.956934:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273249024 00002000:00100000:2.0:1746065156.956970:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1a:0x0] (8388608->12582911) req@ffff8801237b9500 x1830881273249024/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.956979:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b9500 with x1830881273249024 ext(8388608->12582911) 00002000:00010000:2.0:1746065156.956984:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b9500 00000100:00100000:2.0:1746065156.957012:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13881 00000100:00100000:2.0:1746065156.957018:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2002:x1830881273249024:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:1.0:1746065156.977188:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065156.977646:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065156.977732:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273249536 00000100:00100000:3.0:1746065156.977740:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273249536 00000100:00100000:3.0:1746065156.977789:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 200 00000100:00100000:3.0:1746065156.977796:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:3796:x1830881273249536:12345-192.168.202.8@tcp:35:dd.0 00000001:00080000:3.0:1746065156.977946:0:7214:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294983610 00000100:00100000:3.0:1746065156.978011:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:3796:x1830881273249536:12345-192.168.202.8@tcp:35:dd.0 Request processed in 216us (365us total) trans 4294983611 rc 0/0 00000100:00100000:3.0:1746065156.978018:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 200 00000020:00080000:3.0:1746065156.978022:0:7214:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1746065156.978803:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273249280 00000100:00100000:2.0:1746065156.978809:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273249280 00002000:00100000:2.0:1746065156.978834:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x19:0x0] (8388608->12582911) req@ffff88009de3ea00 x1830881273249280/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.978843:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3ea00 with x1830881273249280 ext(8388608->12582911) 00002000:00010000:2.0:1746065156.978847:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009de3ea00 00000100:00100000:2.0:1746065156.978873:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13882 00000100:00100000:2.0:1746065156.978880:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2003:x1830881273249280:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065157.010625:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2002:x1830881273249024:12345-192.168.202.8@tcp:4:dd.0 Request processed in 53598us (53863us total) trans 4294972163 rc 0/0 00000100:00100000:0.0:1746065157.010637:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13881 00002000:00100000:0.0:1746065157.010648:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1a:0x0] (8388608->12582911) req@ffff8801237b9500 x1830881273249024/t4294972163(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.010657:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b9500 with x1830881273249024 ext(8388608->12582911) 00002000:00010000:0.0:1746065157.010663:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b9500 00000100:00100000:0.0:1746065157.027411:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.027440:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273249664 00000100:00100000:0.0:1746065157.027447:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273249664 00000100:00100000:0.0:1746065157.027490:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36566 00000100:00100000:0.0:1746065157.027496:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+26:3801:x1830881273249664:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:0.0:1746065157.027519:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.027550:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f880fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c3e expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.027600:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f880fcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.027610:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f880fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.027618:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f880fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:3.0:1746065157.027645:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1746065157.027647:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065157.027658:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f880fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.027672:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f880fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c3e expref: 28 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.027697:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f880fcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c3e expref: 27 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.027704:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065157.027706:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065157.027708:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d184600, rc 0) 00000100:00100000:3.0:1746065157.027738:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:3801:x1830881273249664:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 242us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.027742:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36566 00000100:00100000:0.0:1746065157.035405:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273249280:12345-192.168.202.8@tcp:4:dd.0 Request processed in 56518us (58217us total) trans 4294970743 rc 0/0 00000100:00100000:0.0:1746065157.035416:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13882 00002000:00100000:0.0:1746065157.035425:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x19:0x0] (8388608->12582911) req@ffff88009de3ea00 x1830881273249280/t4294970743(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.035434:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009de3ea00 with x1830881273249280 ext(8388608->12582911) 00002000:00010000:0.0:1746065157.035438:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009de3ea00 00010000:00010000:0.0:1746065157.277151:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065157.484324:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.484466:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273249920 00000100:00100000:3.0:1746065157.484474:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273249920 00000100:00100000:3.0:1746065157.484524:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36567 00000100:00100000:3.0:1746065157.484531:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:3812:x1830881273249920:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:3.0:1746065157.484550:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.484553:0:7211:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065157.484575:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f880fcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c3e expref: 27 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.484587:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065157.484591:0:7211:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065157.484598:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9200/0x392ae0376f880fd6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c45 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.484662:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.484672:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.484680:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.484689:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.484694:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.484699:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.484957:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.484963:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.484973:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:3.0:1746065157.484980:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x49:0x0]: returning size 0 00010000:00010000:3.0:1746065157.484997:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.485002:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.485008:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.485013:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.485017:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e3000 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065157.485020:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.485025:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.485032:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065157.485034:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065157.485037:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.485041:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e3000/0x392ae0376f880fdd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00000004:00010000:3.0:1746065157.485048:0:7211:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801237b9f80 reply state ffff88009f880000 transno 4294983612 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.485057:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.485062:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff880072c11e00) 00010000:00010000:3.0:1746065157.485064:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065157.485065:0:7211:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065157.485103:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9200/0x392ae0376f880fd6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c45 expref: 29 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.485113:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c45 expref: 28 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.485119:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff880072c11200) 00010000:00010000:3.0:1746065157.485121:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065157.485122:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b30e00, rc 0) 00000100:00100000:3.0:1746065157.485159:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:3812:x1830881273249920:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 629us (839us total) trans 4294983612 rc 0/0 00000100:00100000:3.0:1746065157.485166:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36567 00000100:00100000:2.0:1746065157.490656:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.490711:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273250176 00000100:00100000:3.0:1746065157.490719:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273250176 00000100:00100000:3.0:1746065157.490749:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36568 00000100:00100000:3.0:1746065157.490754:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:3812:x1830881273250176:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:3.0:1746065157.490780:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.490793:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b31400/0x392ae0376f880ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c4c expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.490862:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065157.490875:0:21520:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c45 expref: 30 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.490881:0:21520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065157.490901:0:21520:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c45 expref: 30 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.490911:0:21520:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c45 expref: 30 pid: 7211 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746065157.490921:0:21520:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21520:1830881267827840:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065157.490980:0:21520:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb84540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.492769:0:21520:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21520:1830881267827840:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065157.492800:0:21520:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000100:00100000:2.0:1746065157.494008:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.494024:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273250304 00000100:00100000:0.0:1746065157.494030:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273250304 00010000:00010000:0.0:1746065157.494054:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c45 expref: 31 pid: 7211 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746065157.494073:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14837 00000100:00100000:0.0:1746065157.494092:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881273250304:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.494101:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.494105:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c45 expref: 31 pid: 7211 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746065157.494115:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c45 expref: 31 pid: 7211 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746065157.494131:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30e00/0x392ae0376f880feb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c45 expref: 31 pid: 7211 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746065157.494145:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff880072c11200) 00010000:00010000:0.0:1746065157.494148:0:7198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:0.0:1746065157.494155:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21520 initiator: MDT0 00010000:00010000:0.0:1746065157.494160:0:7198:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21520 initiator: MDT0 00010000:00010000:0.0:1746065157.494182:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065157.494208:0:21520:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000100:00100000:0.0:1746065157.494210:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:2004:x1830881273250304:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 131us (205us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065157.494215:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000100:00100000:0.0:1746065157.494216:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14837 00000004:00200000:2.0:1746065157.494228:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x49:0x0]: returning size 0 00000004:00080000:2.0:1746065157.494334:0:21520:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1a:0x0], index 0: 0 00000004:00080000:2.0:1746065157.494338:0:21520:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1b:0x0], index 1: 0 00010000:00010000:2.0:1746065157.494421:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065157.494427:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065157.494432:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065157.494436:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a04b9600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065157.494439:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065157.494444:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065157.494450:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff880072c11200) 00010000:00010000:2.0:1746065157.494452:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065157.494455:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065157.494459:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9600/0x392ae0376f881000 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065157.494495:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b31400/0x392ae0376f880ff9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c4c expref: 30 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.494501:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b31400/0x392ae0376f880ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c4c expref: 30 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.494506:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b31400, rc 0) 00000100:00100000:2.0:1746065157.494537:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:3812:x1830881273250176:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 3782us (3884us total) trans 4294983613 rc 301/301 00000100:00100000:2.0:1746065157.494543:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36568 00000100:00100000:2.0:1746065157.496372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.496410:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273250560 00000100:00100000:3.0:1746065157.496416:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273250560 00000100:00100000:3.0:1746065157.496458:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 201 00000100:00100000:3.0:1746065157.496464:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:3812:x1830881273250560:12345-192.168.202.8@tcp:35:lfs.0 00000100:00100000:3.0:1746065157.496629:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:3812:x1830881273250560:12345-192.168.202.8@tcp:35:lfs.0 Request processed in 164us (259us total) trans 4294983614 rc 0/0 00000100:00100000:3.0:1746065157.496634:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 201 00000100:00100000:0.0:1746065157.500538:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.500607:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273250688 00000100:00100000:2.0:1746065157.500614:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273250688 00000100:00100000:2.0:1746065157.500651:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36569 00000100:00100000:2.0:1746065157.500656:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:3812:x1830881273250688:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:2.0:1746065157.500673:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.500688:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30800/0x392ae0376f88100e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c53 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.500727:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30800/0x392ae0376f88100e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c53 expref: 31 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.500736:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30800/0x392ae0376f88100e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c53 expref: 31 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.500753:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:2.0:1746065157.500756:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065157.500758:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b30800, rc 0) 00000100:00100000:2.0:1746065157.500802:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:3812:x1830881273250688:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 145us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.500807:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36569 00000100:00100000:0.0:1746065157.501879:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.501907:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273250944 00000100:00100000:0.0:1746065157.501911:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273250944 00000100:00100000:0.0:1746065157.501931:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 202 00000100:00100000:0.0:1746065157.501935:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:3812:x1830881273250944:12345-192.168.202.8@tcp:35:lfs.0 00000100:00100000:0.0:1746065157.502047:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:3812:x1830881273250944:12345-192.168.202.8@tcp:35:lfs.0 Request processed in 111us (168us total) trans 4294983615 rc 0/0 00000100:00100000:0.0:1746065157.502053:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 202 00000100:00100000:0.0:1746065157.514416:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.514445:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.514472:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273251072 00000100:00100000:0.0:1746065157.514479:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273251072 00000100:00100000:0.0:1746065157.514510:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273251200 00000100:00100000:0.0:1746065157.514512:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273251200 00000100:00100000:0.0:1746065157.514527:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36570 00000100:00100000:0.0:1746065157.514534:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:3814:x1830881273251072:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:0.0:1746065157.514550:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.514565:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881015 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c5a expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.514610:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88101c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065157.514620:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88101c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065157.514629:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88101c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:0.0:1746065157.514661:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1746065157.514663:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065157.514676:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88101c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065157.514692:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881015 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c5a expref: 15 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.514703:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88101c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c5a expref: 14 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.514709:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065157.514712:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746065157.514714:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072568a00, rc 0) 00000100:00100000:0.0:1746065157.514750:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:3814:x1830881273251072:12345-192.168.202.8@tcp:101:dd.0 Request processed in 216us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.514755:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36570 00000100:00100000:0.0:1746065157.514805:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36571 00000100:00100000:0.0:1746065157.514811:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:3813:x1830881273251200:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:0.0:1746065157.514820:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.514825:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f881023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c61 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.514844:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x392ae0376f88102a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065157.514850:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x392ae0376f88102a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065157.514855:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x392ae0376f88102a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:0.0:1746065157.514866:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1746065157.514868:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065157.514874:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x392ae0376f88102a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:0.0:1746065157.514883:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f525200/0x392ae0376f881023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c61 expref: 34 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.514893:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x392ae0376f88102a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c61 expref: 33 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.514897:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065157.514899:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746065157.514902:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:0.0:1746065157.514916:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:3813:x1830881273251200:12345-192.168.202.8@tcp:101:dd.0 Request processed in 106us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.514920:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36571 00000100:00100000:1.0:1746065157.522951:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.522983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.523006:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273251456 00000100:00100000:1.0:1746065157.523015:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273251456 00000100:00100000:1.0:1746065157.523044:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273251712 00000100:00100000:1.0:1746065157.523045:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273251712 00000100:00100000:1.0:1746065157.523058:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36572 00000100:00100000:1.0:1746065157.523065:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:3814:x1830881273251456:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065157.523078:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.523108:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234600/0x392ae0376f881031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c68 expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.523173:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f881038 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523183:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f881038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523191:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f881038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523198:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f88103f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523206:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f88103f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523210:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f88103f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523280:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185e00/0x392ae0376f881046 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523286:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185e00/0x392ae0376f881046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523291:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185e00/0x392ae0376f881046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:1.0:1746065157.523297:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x47:0x0]: returning size 26214400 00010000:00010000:1.0:1746065157.523346:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f881038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523351:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f881038 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523356:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f881038 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523359:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d184600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065157.523362:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f881038 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523367:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f881038 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523374:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065157.523376:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.523379:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f881038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523383:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184600/0x392ae0376f881038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523390:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f88103f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523394:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f88103f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523398:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f88103f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523401:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d184000 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065157.523403:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f88103f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523406:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f88103f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523410:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6ecf (ffff880072945b00) 00010000:00010000:1.0:1746065157.523411:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.523413:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f88103f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523417:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184000/0x392ae0376f88103f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523437:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234600/0x392ae0376f881031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c68 expref: 17 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.523446:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185e00/0x392ae0376f881046 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c68 expref: 16 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.523452:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:1.0:1746065157.523454:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065157.523455:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d185e00, rc 0) 00000100:00100000:1.0:1746065157.523489:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+16:3814:x1830881273251456:12345-192.168.202.8@tcp:101:dd.0 Request processed in 425us (543us total) trans 4294983616 rc 0/0 00000100:00100000:1.0:1746065157.523494:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36572 00000100:00100000:1.0:1746065157.523507:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36573 00000100:00100000:1.0:1746065157.523512:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:3813:x1830881273251712:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065157.523518:0:7212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.523523:0:7212:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f881054 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c6f expref: -99 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.523543:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234400/0x392ae0376f88105b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523548:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234400/0x392ae0376f88105b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523553:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234400/0x392ae0376f88105b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523559:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881062 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523563:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523567:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523595:0:7212:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f881069 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523600:0:7212:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f881069 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523605:0:7212:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f881069 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7212 initiator: MDT0 00000004:00200000:1.0:1746065157.523608:0:7212:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x47:0x0]: returning size 26214400 00010000:00010000:1.0:1746065157.523630:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234400/0x392ae0376f88105b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523634:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234400/0x392ae0376f88105b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523638:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234400/0x392ae0376f88105b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523641:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a1234400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065157.523643:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234400/0x392ae0376f88105b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523646:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234400/0x392ae0376f88105b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523652:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065157.523653:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.523655:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234400/0x392ae0376f88105b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523658:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1234400/0x392ae0376f88105b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523667:0:7212:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523671:0:7212:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881062 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523675:0:7212:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523678:0:7212:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ddfc400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065157.523679:0:7212:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523684:0:7212:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881062 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523688:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6ecf (ffff880072945b00) 00010000:00010000:1.0:1746065157.523689:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.523690:0:7212:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881062 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523693:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881062 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:1.0:1746065157.523708:0:7212:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f881054 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c6f expref: 36 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.523715:0:7212:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfd200/0x392ae0376f881069 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c6f expref: 35 pid: 7212 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.523720:0:7212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:1.0:1746065157.523722:0:7212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065157.523723:0:7212:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfd200, rc 0) 00000100:00100000:1.0:1746065157.523737:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:3813:x1830881273251712:12345-192.168.202.8@tcp:101:dd.0 Request processed in 225us (755us total) trans 4294983617 rc 0/0 00000100:00100000:1.0:1746065157.523742:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36573 00000100:00100000:1.0:1746065157.529823:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.529868:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.529892:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273251968 00000100:00100000:1.0:1746065157.529899:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273251968 00000100:00100000:1.0:1746065157.529931:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273252224 00000100:00100000:1.0:1746065157.529933:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273252224 00000100:00100000:1.0:1746065157.529947:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36574 00000100:00100000:1.0:1746065157.529954:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+16:3814:x1830881273251968:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065157.529971:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.529973:0:7213:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065157.529994:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88101c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c5a expref: 16 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.530005:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065157.530009:0:7213:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065157.530017:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7c4a00/0x392ae0376f881077 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c76 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.530127:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530137:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530143:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530151:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21c00/0x392ae0376f881085 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530155:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21c00/0x392ae0376f881085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530160:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21c00/0x392ae0376f881085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530194:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530200:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530205:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:1.0:1746065157.530212:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x49:0x0]: returning size 0 00010000:00010000:1.0:1746065157.530267:0:7213:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530273:0:7213:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530278:0:7213:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530282:0:7213:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530286:0:7213:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b21200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065157.530289:0:7213:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530298:0:7213:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530304:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065157.530306:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.530309:0:7213:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530313:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21200/0x392ae0376f88107e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530320:0:7213:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21c00/0x392ae0376f881085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530324:0:7213:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21c00/0x392ae0376f881085 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530329:0:7213:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21c00/0x392ae0376f881085 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530333:0:7213:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b21c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065157.530334:0:7213:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21c00/0x392ae0376f881085 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530339:0:7213:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21c00/0x392ae0376f881085 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530344:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff880072c11e00) 00010000:00010000:1.0:1746065157.530346:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.530348:0:7213:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21c00/0x392ae0376f881085 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530352:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21c00/0x392ae0376f881085 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530375:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7c4a00/0x392ae0376f881077 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c76 expref: 18 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.530384:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c76 expref: 17 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.530389:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:1.0:1746065157.530391:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065157.530393:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b20c00, rc 0) 00000100:00100000:1.0:1746065157.530430:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:3814:x1830881273251968:12345-192.168.202.8@tcp:101:dd.0 Request processed in 477us (614us total) trans 4294983618 rc 0/0 00000100:00100000:1.0:1746065157.530435:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36574 00000100:00100000:1.0:1746065157.530449:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36575 00000100:00100000:1.0:1746065157.530454:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:3813:x1830881273252224:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065157.530462:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.530464:0:7213:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065157.530471:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x392ae0376f88102a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c61 expref: 35 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.530478:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065157.530480:0:7213:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065157.530484:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88109a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c7d expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.530512:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530521:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530526:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530577:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530583:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530588:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00080000:1.0:1746065157.530790:0:7213:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1b:0x0], index 0: 0 00010000:00010000:1.0:1746065157.530865:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff19400/0x392ae0376f8810af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530871:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff19400/0x392ae0376f8810af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530876:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff19400/0x392ae0376f8810af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530890:0:7213:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530894:0:7213:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530898:0:7213:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530905:0:7213:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530908:0:7213:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b21e00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065157.530910:0:7213:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530913:0:7213:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530919:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065157.530920:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.530922:0:7213:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530926:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f8810a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00000004:00010000:1.0:1746065157.530932:0:7213:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ea75500 reply state ffff880079d6f000 transno 4294983619 ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530938:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065157.530943:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6c9b94d9 (ffff88009ffaba00) 00010000:00010000:1.0:1746065157.530944:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065157.530946:0:7213:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065157.530959:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88109a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c7d expref: 37 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.530967:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff19400/0x392ae0376f8810af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c7d expref: 36 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.530976:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4a:0x0].0x0 (ffff88009ffabb00) 00010000:00010000:1.0:1746065157.530978:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065157.530980:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff19400, rc 0) 00000100:00100000:1.0:1746065157.530999:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:3813:x1830881273252224:12345-192.168.202.8@tcp:101:dd.0 Request processed in 544us (1130us total) trans 4294983619 rc 0/0 00000100:00100000:1.0:1746065157.531003:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36575 00000100:00100000:1.0:1746065157.533310:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.533365:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273252352 00000100:00100000:2.0:1746065157.533373:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273252352 00000100:00100000:2.0:1746065157.533416:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30868 00000100:00100000:2.0:1746065157.533423:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+5:3814:x1830881273252352:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065157.533433:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.533446:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f8810bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c84 expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.533467:0:9559:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 12 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.533473:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065157.533475:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065157.533478:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f8810bd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c84 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.533500:0:9559:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 12 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.533511:0:9559:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 12 pid: 9559 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746065157.533521:0:9559:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267827968:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065157.533572:0:9559:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58180 going to sleep for 11 seconds 00000100:00080000:0.0:1746065157.536664:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065157.540136:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.542905:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.542987:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273252608 00000100:00100000:2.0:1746065157.542995:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273252608 00000100:00100000:2.0:1746065157.543649:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273252864 00000100:00100000:2.0:1746065157.543652:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273252864 00000100:00100000:3.0:1746065157.543684:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13883 00000100:00100000:3.0:1746065157.543693:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2005:x1830881273252608:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065157.543723:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.543736:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065157.543739:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.543747:0:27166:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.543803:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13884 00000100:00100000:2.0:1746065157.543809:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273252864:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065157.543823:0:27164:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.543832:0:27164:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d184e00/0x392ae0376f880fc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c37 expref: 16 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.543838:0:27164:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065157.543840:0:27164:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065157.543841:0:27164:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.543863:0:27164:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d184e00/0x392ae0376f880fc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c37 expref: 16 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.543872:0:27164:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d184e00/0x392ae0376f880fc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c37 expref: 16 pid: 9558 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746065157.543884:0:27164:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0000_UUID:27164:1830881267828096:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065157.543942:0:27164:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.544359:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.544415:0:9559:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9559:1830881267827968:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065157.544430:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f8810bd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c84 expref: 6 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.544441:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f524800, rc 0) 00000100:00100000:2.0:1746065157.544461:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:3814:x1830881273252352:12345-192.168.202.8@tcp:101:dd.0 Request processed in 11039us (11158us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.544467:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30868 00000100:00100000:0.0:1746065157.544520:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273252992 00000100:00100000:0.0:1746065157.544524:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273252992 00002000:00100000:0.0:1746065157.544542:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1a:0x0] (12582912->13631487) req@ffff88012f6a8380 x1830881273252992/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.544550:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8380 with x1830881273252992 ext(12582912->13631487) 00010000:00010000:0.0:1746065157.544555:0:9564:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 14 pid: 9559 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746065157.544564:0:9564:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 14 pid: 9559 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746065157.544569:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f6a8380 00000100:00100000:0.0:1746065157.544589:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3161 00000100:00100000:0.0:1746065157.544779:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2005:x1830881273252992:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:2.0:1746065157.546817:0:27164:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0000_UUID:27164:1830881267828096:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065157.546833:0:27164:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.553828:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.555493:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273253120 00000100:00100000:0.0:1746065157.555502:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273253120 00010000:00010000:0.0:1746065157.555535:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d184e00/0x392ae0376f880fc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c37 expref: 17 pid: 9558 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746065157.555559:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14838 00000100:00100000:0.0:1746065157.555565:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5944050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881273253120:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.555576:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065157.555588:0:8359:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb size from disk: 0 -> 12582912 00002000:00010000:0.0:1746065157.555591:0:8359:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb mtime from disk: 1746065155 -> 1746065156 00002000:00010000:0.0:1746065157.555592:0:8359:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb ctime from disk: 1746065155 -> 1746065156 00002000:00010000:0.0:1746065157.555594:0:8359:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb blocks from disk: 0 -> 24576 00010000:00010000:0.0:1746065157.555598:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d184e00/0x392ae0376f880fc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c37 expref: 17 pid: 9558 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746065157.555608:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d184e00/0x392ae0376f880fc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c37 expref: 17 pid: 9558 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746065157.555625:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d184e00/0x392ae0376f880fc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c37 expref: 17 pid: 9558 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746065157.555639:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.555641:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.555644:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.555651:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.555666:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.555699:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5944050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273253120:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 133us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.555704:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14838 00010000:00010000:2.0:1746065157.562443:0:27164:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.562456:0:27164:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.566526:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273252992:12345-192.168.202.8@tcp:4:dd.0 Request processed in 21924us (22160us total) trans 4294972164 rc 0/0 00000100:00100000:2.0:1746065157.566537:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3161 00002000:00100000:2.0:1746065157.566547:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1a:0x0] (12582912->13631487) req@ffff88012f6a8380 x1830881273252992/t4294972164(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.566555:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8380 with x1830881273252992 ext(12582912->13631487) 00010000:00010000:2.0:1746065157.566565:0:9564:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 16 pid: 9559 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746065157.566578:0:9564:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 16 pid: 9559 timeout: 856 lvb_type: 0 00002000:00010000:2.0:1746065157.566584:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f6a8380 00000100:00100000:1.0:1746065157.581281:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.581333:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273253248 00000100:00100000:0.0:1746065157.581341:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273253248 00010000:00010000:0.0:1746065157.581370:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 16 pid: 9559 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746065157.581408:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14839 00010000:00010000:2.0:1746065157.581411:0:27164:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.581414:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273253248:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.581420:0:27164:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.581424:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.581427:0:27164:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.581433:0:27164:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072efb000 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065157.581436:0:27164:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065157.581437:0:7198:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x1a:0x0] updating lvb size from disk: 0 -> 13631488 00002000:00010000:0.0:1746065157.581440:0:7198:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x1a:0x0] updating lvb mtime from disk: 1746065155 -> 1746065156 00002000:00010000:0.0:1746065157.581442:0:7198:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x1a:0x0] updating lvb ctime from disk: 1746065155 -> 1746065156 00010000:00010000:2.0:1746065157.581443:0:27164:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065157.581443:0:7198:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x1a:0x0] updating lvb blocks from disk: 0 -> 26624 00010000:00010000:0.0:1746065157.581447:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 16 pid: 9559 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746065157.581457:0:27164:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.581457:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 16 pid: 9559 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746065157.581463:0:27164:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072efb000/0x392ae0376f8810cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.581471:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f88ea00/0x392ae0376f880fba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c30 expref: 16 pid: 9559 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746065157.581498:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.581500:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.581506:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f8810bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c84 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.581512:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f8810bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c84 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.581524:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.581525:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.581527:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.581534:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.581556:0:27166:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.581562:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f524800/0x392ae0376f8810bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c84 expref: 5 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.581563:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.581573:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801237baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267828224:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065157.581652:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.584191:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2004:x1830881273252864:12345-192.168.202.8@tcp:3:dd.0 Request processed in 40373us (41282us total) trans 0 rc 1040384/1040384 00000100:00100000:2.0:1746065157.584201:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13884 00000100:00100000:2.0:1746065157.584523:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801237baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267828224:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065157.584539:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.584574:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273253248:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3160us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.584581:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14839 00000100:00100000:1.0:1746065157.585765:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.586602:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273253504 00000100:00100000:2.0:1746065157.586609:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273253504 00002000:00100000:2.0:1746065157.586646:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1a:0x0] (0->1048575) req@ffff88012f6a8a80 x1830881273253504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.586655:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8a80 with x1830881273253504 ext(0->1048575) 00002000:00010000:2.0:1746065157.586659:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f6a8a80 00010000:00010000:1.0:1746065157.587355:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.587364:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.587371:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.587376:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072f37200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065157.587380:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.587386:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.587403:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.587408:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f8810c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.587460:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2005:x1830881273252608:12345-192.168.202.8@tcp:3:dd.0 Request processed in 43769us (47329us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.587466:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13883 00000100:00100000:1.0:1746065157.587482:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13885 00000100:00100000:1.0:1746065157.587488:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273253504:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:1.0:1746065157.597999:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.598107:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273253760 00000100:00100000:2.0:1746065157.598114:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273253760 00000100:00100000:2.0:1746065157.598167:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13886 00000100:00100000:2.0:1746065157.598175:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2004:x1830881273253760:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:2.0:1746065157.598209:0:27164:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065157.598216:0:27164:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f8810d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.598227:0:27164:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.598229:0:27164:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.598232:0:27164:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f8810d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2088959] (req 0->2088959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.598243:0:27164:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f8810d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2088959] (req 0->2088959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.599661:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:2004:x1830881273253504:12345-192.168.202.8@tcp:3:dd.0 Request processed in 12168us (13894us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065157.599668:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13885 00002000:00100000:0.0:1746065157.599675:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1a:0x0] (0->1048575) req@ffff88012f6a8a80 x1830881273253504/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.599685:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8a80 with x1830881273253504 ext(0->1048575) 00002000:00010000:0.0:1746065157.599689:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f6a8a80 00000100:00100000:0.0:1746065157.609416:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.609521:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273253888 00000100:00100000:2.0:1746065157.609528:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273253888 00000100:00100000:2.0:1746065157.609590:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30869 00000100:00100000:2.0:1746065157.609598:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:3814:x1830881273253888:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065157.609613:0:9559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746065157.609618:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746065157.609628:0:9559:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7d600/0x392ae0376f8810d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c8b expref: -99 pid: 9559 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065157.609646:0:9559:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 12582912, mtime: 0x6812d704, atime: 0x0, ctime: 0x6812d704, blocks: 0x6000 00010000:00010000:2.0:1746065157.609664:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.609666:0:9559:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.609672:0:9559:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7d600/0x392ae0376f8810d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c8b expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.609683:0:9559:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7d600/0x392ae0376f8810d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c8b expref: 8 pid: 9559 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.609692:0:9559:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0b7d600, rc 0) 00000100:00100000:2.0:1746065157.610623:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:3814:x1830881273253888:12345-192.168.202.8@tcp:101:dd.0 Request processed in 1022us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.610631:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30869 00000100:00100000:0.0:1746065157.614477:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.614691:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273254144 00000100:00100000:3.0:1746065157.614698:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273254144 00002000:00100000:3.0:1746065157.614732:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x19:0x0] (0->1040383) req@ffff8801237bb100 x1830881273254144/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.614741:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237bb100 with x1830881273254144 ext(0->1040383) 00002000:00010000:3.0:1746065157.614746:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237bb100 00000100:00100000:3.0:1746065157.614788:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13887 00000100:00100000:3.0:1746065157.614795:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:2004:x1830881273254144:12345-192.168.202.8@tcp:3:dd.0 00000001:00080000:0.0:1746065157.615722:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970744 is committed 00002000:00010000:2.0:1746065157.616264:0:27164:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 0 -> 2088960 00002000:00010000:2.0:1746065157.616267:0:27164:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb mtime from disk: 0 -> 1746065156 00002000:00010000:2.0:1746065157.616608:0:27164:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb ctime from disk: 0 -> 1746065156 00002000:00010000:2.0:1746065157.616611:0:27164:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 0 -> 4080 00010000:00010000:2.0:1746065157.616623:0:27164:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f8810d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2088959] (req 0->2088959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.616632:0:27164:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f8810d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2088959] (req 0->2088959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.616638:0:27164:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f8810d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2088959] (req 0->2088959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.616645:0:27164:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007c0a0c00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065157.616648:0:27164:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f8810d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2088959] (req 0->2088959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.616654:0:27164:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f8810d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2088959] (req 0->2088959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.616669:0:27164:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f8810d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2088959] (req 0->2088959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.616674:0:27164:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f8810d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2088959] (req 0->2088959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.616739:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2004:x1830881273253760:12345-192.168.202.8@tcp:4:dd.0 Request processed in 18563us (18744us total) trans 4294970744 rc 0/0 00000100:00100000:2.0:1746065157.616746:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13886 00000100:00100000:3.0:1746065157.625873:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:2004:x1830881273254144:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11072us (11397us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746065157.625883:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13887 00002000:00100000:3.0:1746065157.625892:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x19:0x0] (0->1040383) req@ffff8801237bb100 x1830881273254144/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.625901:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237bb100 with x1830881273254144 ext(0->1040383) 00002000:00010000:3.0:1746065157.625906:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237bb100 00000100:00100000:3.0:1746065157.631254:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c4d7531-7474-4559-997c-c1b3824c301a:3765:1830881267828352:0@lo:400:kworker.0 00000100:00100000:2.0:1746065157.631284:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3768:1830881267828736:0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.631308:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.631308:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065157.631361:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3766:1830881267828480:0@lo:400:kworker.0 00000100:00100000:1.0:1746065157.631433:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267828608:0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.631963:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267828352 00000100:00100000:2.0:1746065157.631968:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267829248:0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.631969:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267828352 00000100:00100000:2.0:1746065157.631987:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.631999:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267829760:0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.632002:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1746065157.632009:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3765:x1830881267828352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065157.632010:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.632031:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267828736 00000100:00100000:2.0:1746065157.632035:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267828736 00000100:00100000:3.0:1746065157.632044:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3765:x1830881267828352:12345-0@lo:400:kworker.0 Request processed in 36us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.632049:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1746065157.632056:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1746065157.632061:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3768:x1830881267828736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.632075:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267829248 00000100:00100000:3.0:1746065157.632077:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267829248 00000100:00100000:2.0:1746065157.632104:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3768:x1830881267828736:12345-0@lo:400:kworker.0 Request processed in 42us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.632109:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1746065157.632114:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267829760 00000100:00100000:3.0:1746065157.632116:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267829760 00000100:00100000:3.0:1746065157.632127:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1746065157.632132:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267829248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065157.632140:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3768:1830881267828736:0@lo:400:kworker.0 00000100:00100000:2.0:1746065157.632155:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:2.0:1746065157.632160:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267829760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.632163:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267829248:12345-0@lo:400:kworker.0 Request processed in 30us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.632168:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:2.0:1746065157.632181:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3768:x1830881267829760:12345-0@lo:400:kworker.0 Request processed in 22us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.632186:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1746065157.632200:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c4d7531-7474-4559-997c-c1b3824c301a:3765:1830881267828352:0@lo:400:kworker.0 00000100:00100000:2.0:1746065157.632201:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267829248:0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.632205:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267828864:0@lo:400:kworker.0 00000100:00100000:2.0:1746065157.632207:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267829760:0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.632224:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1746065157.632226:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746065157.632228:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065157.632238:0:8373:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267828864 00000100:00100000:2.0:1746065157.632240:0:8373:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267828864 00000100:00100000:3.0:1746065157.632244:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267829376:0@lo:400:kworker.0 00000100:00100000:2.0:1746065157.632255:0:8373:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1746065157.632257:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.632258:0:8373:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267828864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.632267:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aa40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267829888:0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.632281:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.632281:0:8373:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267828864:12345-0@lo:400:kworker.0 Request processed in 22us (57us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.632285:0:8373:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1746065157.632295:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267828864:0@lo:400:kworker.0 00000100:00100000:2.0:1746065157.632299:0:9559:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267829376 00000100:00100000:2.0:1746065157.632300:0:9559:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267829376 00000100:00100000:3.0:1746065157.632310:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267829888 00000100:00100000:3.0:1746065157.632312:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267829888 00000100:00100000:2.0:1746065157.632313:0:9559:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1746065157.632316:0:9559:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267829376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.632329:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:3.0:1746065157.632334:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267829888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065157.632334:0:9559:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267829376:12345-0@lo:400:kworker.0 Request processed in 17us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.632338:0:9559:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00080000:2.0:1746065157.632345:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746065157.632346:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065157.632356:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267829888:12345-0@lo:400:kworker.0 Request processed in 23us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.632356:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267829376:0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.632360:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1746065157.632363:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294972159 gen 2 00000004:00080000:2.0:1746065157.632366:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aa41f80, transno 4294972159 00000100:00100000:2.0:1746065157.632372:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aa40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267829888:0@lo:400:kworker.0 00000100:00100000:1.0:1746065157.632860:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065157.632877:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3767:1830881267829120:0@lo:400:kworker.0 00000100:00100000:1.0:1746065157.632894:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.632954:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267828608 00000100:00100000:2.0:1746065157.632958:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267828608 00000100:00100000:1.0:1746065157.633659:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009facb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3767:1830881267829632:0@lo:400:kworker.0 00000100:00100000:1.0:1746065157.633677:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065157.633704:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267829120 00000100:00100000:1.0:1746065157.633707:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267829120 00000100:00100000:1.0:1746065157.633726:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267829632 00000100:00100000:1.0:1746065157.633728:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267829632 00000100:00100000:1.0:1746065157.633739:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1746065157.633744:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3767:x1830881267829120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065157.633781:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3767:x1830881267829120:12345-0@lo:400:kworker.0 Request processed in 25us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.633787:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1746065157.633798:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1746065157.633801:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830881267829632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065157.633820:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830881267829632:12345-0@lo:400:kworker.0 Request processed in 19us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.633825:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1746065157.633844:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3767:1830881267829120:0@lo:400:kworker.0 00000100:00100000:1.0:1746065157.633851:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009facb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3767:1830881267829632:0@lo:400:kworker.0 00000100:00080000:1.0:1746065157.633870:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065157.633925:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065157.633942:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3766:1830881267828992:0@lo:400:kworker.0 00000100:00100000:0.0:1746065157.633958:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065157.633968:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009facaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3766:1830881267829504:0@lo:400:kworker.0 00000100:00100000:0.0:1746065157.633979:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.634052:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1746065157.634059:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3767:x1830881267828608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065157.634099:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3767:x1830881267828608:12345-0@lo:400:kworker.0 Request processed in 41us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.634103:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1746065157.634121:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267828608:0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.634291:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267828480 00000100:00100000:3.0:1746065157.634294:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267828480 00000100:00100000:3.0:1746065157.634310:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1746065157.634315:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3766:x1830881267828480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.634342:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3766:x1830881267828480:12345-0@lo:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.634346:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1746065157.634354:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267828992 00000100:00100000:3.0:1746065157.634356:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267828992 00000100:00100000:3.0:1746065157.634369:0:7212:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267829504 00000100:00100000:3.0:1746065157.634371:0:7212:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267829504 00000100:00100000:3.0:1746065157.634379:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1746065157.634382:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3766:x1830881267828992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.634398:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3766:x1830881267828992:12345-0@lo:400:kworker.0 Request processed in 16us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.634405:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1746065157.634412:0:7212:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1746065157.634415:0:7212:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3766:x1830881267829504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065157.634430:0:7212:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3766:x1830881267829504:12345-0@lo:400:kworker.0 Request processed in 15us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.634434:0:7212:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00080000:3.0:1746065157.634445:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065157.634517:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3766:1830881267828480:0@lo:400:kworker.0 00000100:00100000:0.0:1746065157.634524:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3766:1830881267828992:0@lo:400:kworker.0 00000100:00100000:0.0:1746065157.634531:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009facaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3766:1830881267829504:0@lo:400:kworker.0 00000001:00080000:2.0:1746065157.635108:0:7194:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983619 is committed 00000001:00080000:2.0:1746065157.635117:0:7194:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983618 is committed 00000020:00080000:2.0:1746065157.635140:0:7194:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b1831900 refcount 2 committed 0 result 0 batchid 9 00000020:00080000:2.0:1746065157.635143:0:7194:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff880072945200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b18310c0 00000020:00080000:2.0:1746065157.635147:0:7194:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].9 00000020:00080000:2.0:1746065157.635149:0:7194:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff880072945a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880091064800 00000020:00080000:2.0:1746065157.635151:0:7194:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].9 00000020:00080000:2.0:1746065157.635157:0:7194:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00010000:00010000:3.0:1746065157.635299:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635307:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635313:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635318:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091065200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065157.635321:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635326:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635336:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ce3d8f (ffff880072945e00) 00010000:00010000:3.0:1746065157.635339:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065157.635342:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635346:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f880d98 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635365:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635370:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635374:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635377:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091064200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065157.635379:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635383:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635388:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x46:0x0].0x0 (ffff880072945700) 00010000:00010000:3.0:1746065157.635390:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065157.635391:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635395:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f880d9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635401:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635405:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635408:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635411:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8f8400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065157.635413:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635417:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635422:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa:0x0].0x0 (ffff880072945000) 00010000:00010000:3.0:1746065157.635423:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065157.635425:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635428:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8f8400/0x392ae0376f880da6 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT0 00010000:00010000:3.0:1746065157.635435:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635439:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635442:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635445:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb6ce00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065157.635447:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635451:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635455:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6ecf (ffff880072945b00) 00010000:00010000:3.0:1746065157.635457:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065157.635459:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635465:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb6ce00/0x392ae0376f880f43 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635473:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635477:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635480:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635483:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072568600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065157.635485:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635488:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635492:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:3.0:1746065157.635494:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065157.635495:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635499:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f880fb3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x47:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635504:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635508:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635511:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635515:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd10e00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065157.635517:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635521:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635525:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff880072c11e00) 00010000:00010000:3.0:1746065157.635526:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065157.635527:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635531:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f880fe4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065157.635538:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065157.635542:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065157.635546:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065157.635549:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b20200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065157.635550:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065157.635554:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065157.635558:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6c9b94d9 (ffff88009ffaba00) 00010000:00010000:3.0:1746065157.635560:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065157.635562:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065157.635566:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20200/0x392ae0376f8810a8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00000020:00080000:0.0:1746065157.635609:0:7241:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 9 committed batchid 8 00000004:00080000:0.0:1746065157.635682:0:7241:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012e572600 with version 20 00000020:00080000:0.0:1746065157.635688:0:7241:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8 cancel update log [0x240000401:0x2:0x0].8: rc = 0 00000020:00080000:0.0:1746065157.635718:0:7241:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8 cancel update log [0x200000400:0x2:0x0].8: rc = 0 00000020:00080000:0.0:1746065157.635722:0:7241:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1746065157.635801:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.635824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.635853:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273254272 00000100:00100000:1.0:1746065157.635857:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273254272 00000100:00100000:1.0:1746065157.635874:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273254400 00000100:00100000:1.0:1746065157.635876:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273254400 00000100:00100000:1.0:1746065157.635886:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30870 00000100:00100000:1.0:1746065157.635891:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+14:2003:x1830881273254272:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065157.635900:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.635911:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f8810e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c92 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.635924:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.635926:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.635931:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f8810e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c92 expref: 15 pid: 9558 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065157.636331:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30871 00000100:00100000:0.0:1746065157.636339:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+5:2003:x1830881273254400:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:0.0:1746065157.636347:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.636356:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x392ae0376f8810e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6c99 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.636367:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.636368:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.636372:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x392ae0376f8810e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c99 expref: 6 pid: 9642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.636383:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x392ae0376f8810e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c99 expref: 6 pid: 9642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.636391:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:0.0:1746065157.636425:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273254400:12345-192.168.202.8@tcp:101:dd.0 Request processed in 88us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.636430:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30871 00010000:00010000:1.0:1746065157.636579:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0fa00/0x392ae0376f8810e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c92 expref: 15 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.636588:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fa00, rc 0) 00000100:00100000:1.0:1746065157.636607:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2003:x1830881273254272:12345-192.168.202.8@tcp:101:dd.0 Request processed in 715us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.636611:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30870 00000004:00080000:3.0:1746065157.636988:0:8655:0:(osp_trans.c:1327:osp_get_next_request()) ou ffff880081c7d240 version 20 rpc_version 20 00000020:00100000:3.0:1746065157.637011:0:8655:0:(genops.c:2421:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1746065157.637017:0:8655:0:(client.c:764:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801307ce680 x1830881267830144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746065157.637032:0:8655:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307ce680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8655:1830881267830144:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1746065157.637061:0:8655:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065157.637097:0:8655:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.637114:0:8373:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267830144 00000100:00100000:3.0:1746065157.637118:0:8373:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267830144 00000100:00100000:3.0:1746065157.637137:0:8373:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1746065157.637141:0:8373:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8655:x1830881267830144:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1746065157.637228:0:8373:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8655:x1830881267830144:12345-0@lo:1000:osp_up1-0.0 Request processed in 86us (166us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1746065157.637233:0:8373:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1746065157.637262:0:8655:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307ce680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8655:1830881267830144:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1746065157.641000:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.641066:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273254784 00000100:00100000:2.0:1746065157.641073:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273254784 00000100:00100000:2.0:1746065157.641144:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30872 00000100:00100000:2.0:1746065157.641152:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:3814:x1830881273254784:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065157.641165:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.641181:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ca0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065157.641199:0:9558:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065157.641216:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.641217:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.641224:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.641236:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 9 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.641245:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f85c000, rc 0) 00000100:00100000:2.0:1746065157.641290:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:3814:x1830881273254784:12345-192.168.202.8@tcp:101:dd.0 Request processed in 140us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.641296:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30872 00000100:00100000:0.0:1746065157.643308:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.643353:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.643694:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273254912 00000100:00100000:3.0:1746065157.643700:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273254912 00000100:00100000:3.0:1746065157.643745:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273255168 00000100:00100000:3.0:1746065157.643747:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273255168 00000100:00100000:3.0:1746065157.643846:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13888 00000100:00100000:0.0:1746065157.643851:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13889 00000100:00100000:3.0:1746065157.643853:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273254912:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:0.0:1746065157.643856:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008251e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273255168:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065157.643878:0:9564:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8810f5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.643879:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8810fc lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.643889:0:9564:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.643889:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.643891:0:9564:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.643891:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.643894:0:9564:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8810f5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1040384->2080767] (req 1040384->2080767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.643894:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8810fc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.643904:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8810fc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.643906:0:9564:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8810f5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1040384->2080767] (req 1040384->2080767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.653816:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8810fc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.653833:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8810fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.653840:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8810fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.653847:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11a00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065157.653850:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8810fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.653857:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8810fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.653874:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8810fc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.653880:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x392ae0376f8810fc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.653972:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008251e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273255168:12345-192.168.202.8@tcp:3:dd.0 Request processed in 10111us (10614us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.653982:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13889 00000100:00100000:2.0:1746065157.655446:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.655566:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273255296 00000100:00100000:0.0:1746065157.655573:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273255296 00000100:00100000:0.0:1746065157.655897:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30873 00000100:00100000:0.0:1746065157.655904:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+6:3814:x1830881273255296:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:0.0:1746065157.655916:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.655930:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb69a00/0x392ae0376f881103 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ca7 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065157.655947:0:9560:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065157.656054:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.656056:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.656062:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69a00/0x392ae0376f881103 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca7 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.656073:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69a00/0x392ae0376f881103 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca7 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.656109:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb69a00, rc 0) 00000100:00100000:0.0:1746065157.656181:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:3814:x1830881273255296:12345-192.168.202.8@tcp:101:dd.0 Request processed in 278us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.656186:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30873 00010000:00010000:3.0:1746065157.657938:0:9564:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8810f5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1040384->2080767] (req 1040384->2080767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.657949:0:9564:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8810f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1040384->2080767] (req 1040384->2080767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.657955:0:9564:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8810f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1040384->2080767] (req 1040384->2080767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.657960:0:9564:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8c1600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065157.657963:0:9564:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8810f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1040384->2080767] (req 1040384->2080767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.657969:0:9564:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8810f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1040384->2080767] (req 1040384->2080767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.657981:0:9564:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8810f5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1040384->2080767] (req 1040384->2080767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.657990:0:9564:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8810f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1040384->2080767] (req 1040384->2080767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.658046:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273254912:12345-192.168.202.8@tcp:3:dd.0 Request processed in 14193us (14742us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746065157.658127:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13888 00000100:00100000:1.0:1746065157.664157:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.664646:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273255552 00000100:00100000:3.0:1746065157.664653:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273255552 00000100:00100000:3.0:1746065157.664700:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13890 00000100:00100000:3.0:1746065157.664707:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273255552:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:3.0:1746065157.664747:0:9564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 2088960, mtime: 0x6812d704, atime: 0x0, ctime: 0x6812d704, blocks: 0xff0 00010000:00010000:3.0:1746065157.664753:0:9564:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f88110a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.664764:0:9564:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.664766:0:9564:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.664781:0:9564:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f88110a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2088960->4177919] (req 2088960->4177919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.664792:0:9564:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f88110a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2088960->4177919] (req 2088960->4177919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.691358:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.691392:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.691425:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273255936 00000100:00100000:2.0:1746065157.691434:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273255936 00002000:00100000:2.0:1746065157.691468:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x19:0x0] (1040384->2097151) req@ffff8801237bad80 x1830881273255936/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.691479:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237bad80 with x1830881273255936 ext(1040384->2097151) 00002000:00010000:2.0:1746065157.691483:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237bad80 00000100:00100000:2.0:1746065157.691508:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273256064 00000100:00100000:2.0:1746065157.691510:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273256064 00002000:00100000:2.0:1746065157.691523:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1a:0x0] (1048576->2097151) req@ffff8801237baa00 x1830881273256064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000100:00100000:3.0:1746065157.691529:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13891 00002000:00100000:2.0:1746065157.691529:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237baa00 with x1830881273256064 ext(1048576->2097151) 00002000:00010000:2.0:1746065157.691532:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237baa00 00000100:00100000:3.0:1746065157.691537:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2004:x1830881273255936:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065157.691543:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13892 00000100:00100000:2.0:1746065157.691548:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273256064:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065157.695245:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065157.695262:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267830272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065157.695308:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.695364:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267830272 00000100:00100000:2.0:1746065157.695370:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267830272 00000100:00100000:2.0:1746065157.695400:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1746065157.695406:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267830272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746065157.695425:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1064960 granted 512326464 pending 13729792 free 3920871424 avail 3689349120 00000100:00100000:2.0:1746065157.695452:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267830272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.695457:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1746065157.695487:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267830272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065157.702805:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273256064:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11249us (11405us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065157.702816:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13892 00002000:00100000:0.0:1746065157.702825:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1a:0x0] (1048576->2097151) req@ffff8801237baa00 x1830881273256064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.702834:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237baa00 with x1830881273256064 ext(1048576->2097151) 00002000:00010000:0.0:1746065157.702839:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237baa00 00000100:00100000:3.0:1746065157.703069:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2004:x1830881273255936:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11533us (11719us total) trans 0 rc 1056768/1056768 00000100:00100000:3.0:1746065157.703458:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13891 00002000:00100000:3.0:1746065157.703464:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x19:0x0] (1040384->2097151) req@ffff8801237bad80 x1830881273255936/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1056768/1056768 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.703470:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237bad80 with x1830881273255936 ext(1040384->2097151) 00002000:00010000:3.0:1746065157.703473:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237bad80 00000001:00080000:0.0:1746065157.704522:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970745 is committed 00002000:00010000:3.0:1746065157.704718:0:9564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 2088960 -> 4177920 00002000:00010000:3.0:1746065157.704722:0:9564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 4080 -> 8160 00010000:00010000:3.0:1746065157.704731:0:9564:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f88110a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2088960->4177919] (req 2088960->4177919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.704740:0:9564:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f88110a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2088960->4177919] (req 2088960->4177919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.704747:0:9564:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f88110a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2088960->4177919] (req 2088960->4177919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.704754:0:9564:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8c1600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065157.704758:0:9564:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f88110a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2088960->4177919] (req 2088960->4177919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.704766:0:9564:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f88110a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2088960->4177919] (req 2088960->4177919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.704798:0:9564:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f88110a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2088960->4177919] (req 2088960->4177919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.704804:0:9564:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f88110a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2088960->4177919] (req 2088960->4177919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.704868:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273255552:12345-192.168.202.8@tcp:4:dd.0 Request processed in 40160us (40717us total) trans 4294970745 rc 0/0 00000100:00100000:3.0:1746065157.704876:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13890 00000100:00100000:2.0:1746065157.709249:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.709281:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.709316:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.709409:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273256320 00000100:00100000:1.0:1746065157.709417:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273256320 00000100:00100000:1.0:1746065157.709470:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273256576 00000100:00100000:1.0:1746065157.709512:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273256576 00000100:00100000:1.0:1746065157.709538:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273256832 00000100:00100000:1.0:1746065157.709541:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273256832 00000100:00100000:1.0:1746065157.709559:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13893 00000100:00100000:1.0:1746065157.709564:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273256320:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:3.0:1746065157.709726:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13894 00000100:00100000:3.0:1746065157.709734:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2003:x1830881273256576:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065157.709759:0:9564:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x392ae0376f881111 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.709784:0:9564:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.709786:0:9564:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065157.709790:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13895 00010000:00010000:3.0:1746065157.709791:0:9564:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x392ae0376f881111 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.709797:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273256832:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065157.709802:0:9564:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x392ae0376f881111 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.709813:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881118 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.709821:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.709822:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.709825:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881118 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3121151] (req 2097152->3121151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.709834:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881118 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3121151] (req 2097152->3121151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.710239:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f88111f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.710247:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.710248:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.710251:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f88111f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.710258:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f88111f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.710304:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f88111f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.710311:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f88111f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.710317:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f88111f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.710322:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f846800 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065157.710325:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f88111f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.710332:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f88111f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.710342:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f88111f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.710348:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f88111f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.710394:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2002:x1830881273256320:12345-192.168.202.8@tcp:3:dd.0 Request processed in 829us (1151us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1746065157.710399:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13893 00010000:00010000:2.0:1746065157.723243:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881118 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3121151] (req 2097152->3121151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.723256:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881118 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3121151] (req 2097152->3121151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.723263:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881118 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3121151] (req 2097152->3121151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.723269:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f85ce00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065157.723273:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881118 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3121151] (req 2097152->3121151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.723279:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881118 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3121151] (req 2097152->3121151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.723298:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881118 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3121151] (req 2097152->3121151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.723303:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881118 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3121151] (req 2097152->3121151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.723358:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273256832:12345-192.168.202.8@tcp:3:dd.0 Request processed in 13559us (14038us total) trans 0 rc 1024000/1024000 00000100:00100000:2.0:1746065157.723367:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13895 00010000:00010000:3.0:1746065157.723794:0:9564:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x392ae0376f881111 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.723804:0:9564:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x392ae0376f881111 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.723810:0:9564:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x392ae0376f881111 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.723814:0:9564:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98f200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065157.723817:0:9564:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x392ae0376f881111 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.723823:0:9564:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x392ae0376f881111 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.723833:0:9564:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x392ae0376f881111 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.723839:0:9564:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x392ae0376f881111 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.723880:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2003:x1830881273256576:12345-192.168.202.8@tcp:3:dd.0 Request processed in 14147us (14597us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.723887:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13894 00000100:00100000:0.0:1746065157.729462:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.729559:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273257088 00000100:00100000:3.0:1746065157.729567:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273257088 00000100:00100000:3.0:1746065157.729630:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13896 00000100:00100000:3.0:1746065157.729637:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273257088:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:3.0:1746065157.729673:0:9564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 4177920, mtime: 0x6812d704, atime: 0x0, ctime: 0x6812d704, blocks: 0x1fe0 00010000:00010000:3.0:1746065157.729680:0:9564:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881126 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.729690:0:9564:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.729691:0:9564:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.729696:0:9564:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4177920->6266879] (req 4177920->6266879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.729707:0:9564:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4177920->6266879] (req 4177920->6266879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746065157.744195:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970746 is committed 00002000:00010000:3.0:1746065157.744351:0:9564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 4177920 -> 6266880 00002000:00010000:3.0:1746065157.744355:0:9564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb mtime from disk: 1746065156 -> 1746065157 00002000:00010000:3.0:1746065157.744357:0:9564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 8160 -> 12240 00010000:00010000:3.0:1746065157.744367:0:9564:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4177920->6266879] (req 4177920->6266879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.744376:0:9564:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881126 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4177920->6266879] (req 4177920->6266879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.744383:0:9564:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881126 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4177920->6266879] (req 4177920->6266879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.744390:0:9564:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98ea00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065157.744393:0:9564:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881126 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4177920->6266879] (req 4177920->6266879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.744399:0:9564:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881126 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4177920->6266879] (req 4177920->6266879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.744413:0:9564:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881126 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4177920->6266879] (req 4177920->6266879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.744419:0:9564:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881126 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4177920->6266879] (req 4177920->6266879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.745071:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273257088:12345-192.168.202.8@tcp:4:dd.0 Request processed in 15430us (15611us total) trans 4294970746 rc 0/0 00000100:00100000:3.0:1746065157.745105:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13896 00000100:00100000:3.0:1746065157.746930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.746969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.747035:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273257472 00000100:00100000:0.0:1746065157.747043:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273257472 00002000:00100000:0.0:1746065157.747076:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x19:0x0] (2097152->3145727) req@ffff8801307ced80 x1830881273257472/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.747113:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ced80 with x1830881273257472 ext(2097152->3145727) 00002000:00010000:0.0:1746065157.747118:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307ced80 00000100:00100000:0.0:1746065157.747135:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273257600 00000100:00100000:0.0:1746065157.747138:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273257600 00002000:00100000:0.0:1746065157.747150:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1a:0x0] (2097152->3145727) req@ffff8801307cf100 x1830881273257600/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.747156:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cf100 with x1830881273257600 ext(2097152->3145727) 00002000:00010000:0.0:1746065157.747159:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307cf100 00000100:00100000:0.0:1746065157.747175:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13897 00000100:00100000:0.0:1746065157.747180:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2005:x1830881273257472:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:0.0:1746065157.748158:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13898 00000100:00100000:0.0:1746065157.748166:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273257600:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065157.750824:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.750863:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.750943:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273257984 00000100:00100000:3.0:1746065157.750944:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273258112 00000100:00100000:3.0:1746065157.750951:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273258112 00000100:00100000:1.0:1746065157.750951:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273257984 00000100:00100000:1.0:1746065157.751006:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13899 00000100:00100000:3.0:1746065157.751011:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13900 00000100:00100000:1.0:1746065157.751013:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273257984:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:3.0:1746065157.751016:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273258112:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065157.751037:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f881134 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.751037:0:27164:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072568a00/0x392ae0376f88112d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.751047:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.751047:0:27164:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.751049:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.751049:0:27164:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.751053:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f881134 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.751053:0:27164:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072568a00/0x392ae0376f88112d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.751064:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f881134 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.751064:0:27164:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072568a00/0x392ae0376f88112d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.754187:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2005:x1830881273257472:12345-192.168.202.8@tcp:3:dd.0 Request processed in 7000us (7255us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.754198:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13897 00002000:00100000:1.0:1746065157.754206:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x19:0x0] (2097152->3145727) req@ffff8801307ced80 x1830881273257472/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.754212:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ced80 with x1830881273257472 ext(2097152->3145727) 00002000:00010000:1.0:1746065157.754216:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307ced80 00000100:00100000:2.0:1746065157.761018:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273257600:12345-192.168.202.8@tcp:3:dd.0 Request processed in 12841us (14036us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.761029:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13898 00002000:00100000:2.0:1746065157.761039:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1a:0x0] (2097152->3145727) req@ffff8801307cf100 x1830881273257600/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.761047:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cf100 with x1830881273257600 ext(2097152->3145727) 00002000:00010000:2.0:1746065157.761052:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307cf100 00010000:00010000:1.0:1746065157.762313:0:27164:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072568a00/0x392ae0376f88112d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.762323:0:27164:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880072568a00/0x392ae0376f88112d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.762328:0:27164:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880072568a00/0x392ae0376f88112d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.762333:0:27164:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072568a00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065157.762336:0:27164:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880072568a00/0x392ae0376f88112d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.762342:0:27164:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880072568a00/0x392ae0376f88112d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.762357:0:27164:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880072568a00/0x392ae0376f88112d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.762363:0:27164:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072568a00/0x392ae0376f88112d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.762423:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273257984:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11409us (11604us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.762430:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13899 00010000:00010000:3.0:1746065157.765502:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f881134 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.765517:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f881134 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.765524:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f881134 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.765530:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98f200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065157.765535:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f881134 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.765541:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f881134 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.765556:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f881134 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.765561:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f881134 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.765629:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273258112:12345-192.168.202.8@tcp:3:dd.0 Request processed in 14608us (14761us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746065157.765644:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13900 00000100:00100000:0.0:1746065157.767457:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.767560:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273258496 00000100:00100000:3.0:1746065157.767568:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273258496 00002000:00100000:3.0:1746065157.767602:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1a:0x0] (3145728->4194303) req@ffff8801237b8700 x1830881273258496/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.767611:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8700 with x1830881273258496 ext(3145728->4194303) 00002000:00010000:3.0:1746065157.767615:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b8700 00000100:00100000:3.0:1746065157.767745:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13901 00000100:00100000:3.0:1746065157.767752:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881273258496:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065157.775864:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.775899:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.775923:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.775939:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.775951:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.775974:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273259008 00000100:00100000:0.0:1746065157.775982:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273259008 00002000:00100000:0.0:1746065157.776016:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x19:0x0] (3145728->4194303) req@ffff880130779880 x1830881273259008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.776026:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779880 with x1830881273259008 ext(3145728->4194303) 00002000:00010000:0.0:1746065157.776031:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130779880 00000100:00100000:0.0:1746065157.776046:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273259264 00000100:00100000:0.0:1746065157.776048:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273259264 00002000:00100000:0.0:1746065157.776060:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1a:0x0] (4194304->5242879) req@ffff88013077b100 x1830881273259264/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000100:00100000:2.0:1746065157.776065:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:2005:x1830881273258496:12345-192.168.202.8@tcp:3:dd.0 Request processed in 8312us (8611us total) trans 0 rc 1048576/1048576 00002000:00100000:0.0:1746065157.776067:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b100 with x1830881273259264 ext(4194304->5242879) 00002000:00010000:0.0:1746065157.776069:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077b100 00000100:00100000:2.0:1746065157.776076:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13901 00000100:00100000:0.0:1746065157.776077:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273258752 00000100:00100000:0.0:1746065157.776093:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273258752 00002000:00100000:2.0:1746065157.776097:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1a:0x0] (3145728->4194303) req@ffff8801237b8700 x1830881273258496/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.776104:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8700 with x1830881273258496 ext(3145728->4194303) 00002000:00010000:2.0:1746065157.776107:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b8700 00000100:00100000:0.0:1746065157.776109:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273259520 00000100:00100000:0.0:1746065157.776111:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273259520 00000100:00100000:2.0:1746065157.776120:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273259776 00002000:00100000:0.0:1746065157.776120:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x19:0x0] (4194304->5242879) req@ffff880130779c00 x1830881273259520/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000100:00100000:2.0:1746065157.776123:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273259776 00002000:00100000:0.0:1746065157.776127:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779c00 with x1830881273259520 ext(4194304->5242879) 00002000:00010000:0.0:1746065157.776129:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130779c00 00002000:00100000:2.0:1746065157.776136:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1a:0x0] (5242880->6291455) req@ffff88013077aa00 x1830881273259776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.776144:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077aa00 with x1830881273259776 ext(5242880->6291455) 00000100:00100000:0.0:1746065157.776145:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13902 00002000:00010000:2.0:1746065157.776147:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077aa00 00000100:00100000:0.0:1746065157.776152:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+10:2005:x1830881273259008:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065157.776163:0:27165:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13903 00000100:00100000:2.0:1746065157.776168:0:27165:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:2005:x1830881273259264:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:0.0:1746065157.776639:0:27174:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13904 00000100:00100000:0.0:1746065157.776644:0:27174:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273258752:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:1.0:1746065157.776667:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13905 00002000:00010000:0.0:1746065157.776668:0:27174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 6266880, mtime: 0x6812d705, atime: 0x0, ctime: 0x6812d704, blocks: 0x2fd0 00010000:00010000:0.0:1746065157.776674:0:27174:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d184200/0x392ae0376f88113b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27174 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.776675:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273259520:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065157.776684:0:27174:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.776685:0:27174:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.776689:0:27174:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d184200/0x392ae0376f88113b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6266880->8355839] (req 6266880->8355839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27174 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.776699:0:27174:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d184200/0x392ae0376f88113b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6266880->8355839] (req 6266880->8355839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27174 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.777234:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13906 00000100:00100000:1.0:1746065157.777240:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2004:x1830881273259776:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065157.779458:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.779478:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273260032 00000100:00100000:3.0:1746065157.779486:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273260032 00002000:00100000:3.0:1746065157.779513:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x19:0x0] (5242880->6291455) req@ffff88009aa41500 x1830881273260032/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.779528:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aa41500 with x1830881273260032 ext(5242880->6291455) 00002000:00010000:3.0:1746065157.779533:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aa41500 00000100:00100000:3.0:1746065157.779548:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13907 00000100:00100000:3.0:1746065157.779555:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273260032:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065157.790150:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273259008:12345-192.168.202.8@tcp:3:dd.0 Request processed in 13990us (14285us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.790161:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13902 00002000:00100000:2.0:1746065157.790171:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x19:0x0] (3145728->4194303) req@ffff880130779880 x1830881273259008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.790179:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779880 with x1830881273259008 ext(3145728->4194303) 00002000:00010000:2.0:1746065157.790184:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130779880 00000100:00100000:2.0:1746065157.791332:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801307cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267830400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746065157.791374:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065157.791557:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267830400 00000100:00100000:1.0:1746065157.791564:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267830400 00000100:00100000:1.0:1746065157.792155:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1746065157.792163:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082409450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267830400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746065157.792184:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2105344 granted 512326464 pending 13729792 free 3920871424 avail 3689349120 00000100:00100000:1.0:1746065157.793166:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082409450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267830400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1001us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.793174:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1746065157.797471:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801307cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267830400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746065157.798248:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273259520:12345-192.168.202.8@tcp:3:dd.0 Request processed in 21571us (22304us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.798256:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13905 00002000:00100000:1.0:1746065157.798263:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x19:0x0] (4194304->5242879) req@ffff880130779c00 x1830881273259520/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.798272:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130779c00 with x1830881273259520 ext(4194304->5242879) 00002000:00010000:1.0:1746065157.798277:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130779c00 00000100:00100000:0.0:1746065157.808346:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2004:x1830881273259776:12345-192.168.202.8@tcp:3:dd.0 Request processed in 31098us (32385us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065157.808358:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13906 00002000:00100000:0.0:1746065157.808369:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1a:0x0] (5242880->6291455) req@ffff88013077aa00 x1830881273259776/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.808377:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077aa00 with x1830881273259776 ext(5242880->6291455) 00002000:00010000:0.0:1746065157.808382:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077aa00 00000100:00100000:2.0:1746065157.812116:0:27165:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2005:x1830881273259264:12345-192.168.202.8@tcp:3:dd.0 Request processed in 35939us (36208us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.812127:0:27165:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13903 00002000:00100000:2.0:1746065157.812138:0:27165:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x1a:0x0] (4194304->5242879) req@ffff88013077b100 x1830881273259264/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.812146:0:27165:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013077b100 with x1830881273259264 ext(4194304->5242879) 00002000:00010000:2.0:1746065157.812151:0:27165:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013077b100 00000001:00080000:2.0:1746065157.814002:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970747 is committed 00002000:00010000:1.0:1746065157.814179:0:27174:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 6266880 -> 8355840 00002000:00010000:1.0:1746065157.814182:0:27174:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb ctime from disk: 1746065156 -> 1746065157 00002000:00010000:1.0:1746065157.814184:0:27174:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 12240 -> 16320 00010000:00010000:1.0:1746065157.814193:0:27174:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d184200/0x392ae0376f88113b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6266880->8355839] (req 6266880->8355839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27174 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.814201:0:27174:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d184200/0x392ae0376f88113b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6266880->8355839] (req 6266880->8355839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27174 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.814207:0:27174:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d184200/0x392ae0376f88113b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6266880->8355839] (req 6266880->8355839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27174 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.814213:0:27174:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d184200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065157.814217:0:27174:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d184200/0x392ae0376f88113b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6266880->8355839] (req 6266880->8355839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27174 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.814227:0:27174:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d184200/0x392ae0376f88113b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6266880->8355839] (req 6266880->8355839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27174 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.814243:0:27174:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d184200/0x392ae0376f88113b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6266880->8355839] (req 6266880->8355839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27174 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.814248:0:27174:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d184200/0x392ae0376f88113b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6266880->8355839] (req 6266880->8355839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27174 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.814308:0:27174:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273258752:12345-192.168.202.8@tcp:4:dd.0 Request processed in 37661us (38381us total) trans 4294970747 rc 0/0 00000100:00100000:1.0:1746065157.814316:0:27174:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13904 00000100:00100000:3.0:1746065157.816100:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2005:x1830881273260032:12345-192.168.202.8@tcp:3:dd.0 Request processed in 36515us (36617us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.816109:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13907 00002000:00100000:3.0:1746065157.816118:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x19:0x0] (5242880->6291455) req@ffff88009aa41500 x1830881273260032/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.816125:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aa41500 with x1830881273260032 ext(5242880->6291455) 00002000:00010000:3.0:1746065157.816130:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aa41500 00000100:00100000:2.0:1746065157.817979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.818017:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.818866:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273260416 00000100:00100000:3.0:1746065157.818875:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273260416 00000100:00100000:3.0:1746065157.818916:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273260672 00000100:00100000:3.0:1746065157.818919:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273260672 00000100:00100000:3.0:1746065157.818941:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13908 00000100:00100000:3.0:1746065157.818947:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273260416:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065157.818976:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881142 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.818987:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.818989:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.818993:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881142 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4161536->5201919] (req 4161536->5201919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.819008:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881142 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4161536->5201919] (req 4161536->5201919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.819580:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13909 00000100:00100000:0.0:1746065157.819588:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273260672:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065157.819604:0:27164:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f881149 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.819612:0:27164:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.819613:0:27164:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.819616:0:27164:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f881149 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.819623:0:27164:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f881149 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.828316:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.828394:0:27165:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273260928 00000100:00100000:2.0:1746065157.828402:0:27165:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273260928 00002000:00100000:2.0:1746065157.828435:0:27165:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x1a:0x0] (0->4194303) req@ffff8801237b8a80 x1830881273260928/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.828444:0:27165:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8a80 with x1830881273260928 ext(0->4194303) 00002000:00010000:2.0:1746065157.828449:0:27165:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237b8a80 00000100:00100000:2.0:1746065157.828477:0:27165:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13910 00000100:00100000:2.0:1746065157.828484:0:27165:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2005:x1830881273260928:12345-192.168.202.8@tcp:4:dd.0 00010000:00010000:1.0:1746065157.837653:0:27164:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f881149 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.837670:0:27164:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f881149 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.837677:0:27164:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f881149 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.837684:0:27164:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d184200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065157.837687:0:27164:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f881149 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.837693:0:27164:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f881149 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.837712:0:27164:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f881149 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.837718:0:27164:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184200/0x392ae0376f881149 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27164 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.837787:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273260672:12345-192.168.202.8@tcp:3:dd.0 Request processed in 18197us (19765us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.837795:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13909 00000100:00100000:2.0:1746065157.839187:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.839803:0:27164:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273261184 00000100:00100000:1.0:1746065157.839811:0:27164:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273261184 00002000:00100000:1.0:1746065157.839844:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1b:0x0] (0->4194303) req@ffff88009aa40a80 x1830881273261184/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.839852:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aa40a80 with x1830881273261184 ext(0->4194303) 00002000:00010000:1.0:1746065157.839857:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aa40a80 00000100:00100000:1.0:1746065157.839873:0:27164:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13911 00000100:00100000:1.0:1746065157.839879:0:27164:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+7:2004:x1830881273261184:12345-192.168.202.8@tcp:4:dd.0 00010000:00010000:3.0:1746065157.844033:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881142 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4161536->5201919] (req 4161536->5201919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.844047:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881142 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4161536->5201919] (req 4161536->5201919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.844054:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881142 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4161536->5201919] (req 4161536->5201919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.844060:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98ea00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065157.844064:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881142 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4161536->5201919] (req 4161536->5201919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.844071:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881142 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4161536->5201919] (req 4161536->5201919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.844101:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881142 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4161536->5201919] (req 4161536->5201919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.844107:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98ea00/0x392ae0376f881142 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4161536->5201919] (req 4161536->5201919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.844161:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273260416:12345-192.168.202.8@tcp:3:dd.0 Request processed in 25211us (26184us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746065157.844173:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13908 00000100:00100000:3.0:1746065157.855458:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.855503:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.855527:0:27174:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273261568 00000100:00100000:3.0:1746065157.855535:0:27174:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273261568 00002000:00100000:3.0:1746065157.855571:0:27174:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x1a:0x0] (6291456->7340031) req@ffff8801307cf800 x1830881273261568/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.855581:0:27174:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cf800 with x1830881273261568 ext(6291456->7340031) 00002000:00010000:3.0:1746065157.855585:0:27174:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307cf800 00000100:00100000:3.0:1746065157.855614:0:27174:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273261696 00000100:00100000:3.0:1746065157.855617:0:27174:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273261696 00000100:00100000:3.0:1746065157.855637:0:27174:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13912 00000100:00100000:3.0:1746065157.855642:0:27174:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2004:x1830881273261568:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:1.0:1746065157.855670:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13913 00000100:00100000:1.0:1746065157.855678:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273261696:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1746065157.855709:0:20722:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 8355840, mtime: 0x6812d705, atime: 0x0, ctime: 0x6812d705, blocks: 0x3fc0 00010000:00010000:1.0:1746065157.855717:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b200/0x392ae0376f881150 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.855727:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.855729:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.855733:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b200/0x392ae0376f881150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8355840->10444799] (req 8355840->10444799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.855743:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b200/0x392ae0376f881150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8355840->10444799] (req 8355840->10444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.856257:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.856274:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273261952 00000100:00100000:3.0:1746065157.856276:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273261952 00002000:00100000:3.0:1746065157.856293:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x19:0x0] (6291456->7340031) req@ffff8801307cf480 x1830881273261952/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.856299:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cf480 with x1830881273261952 ext(6291456->7340031) 00002000:00010000:3.0:1746065157.856303:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307cf480 00000100:00100000:3.0:1746065157.856313:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13914 00000100:00100000:3.0:1746065157.856317:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273261952:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065157.866678:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.866701:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273262336 00000100:00100000:2.0:1746065157.866707:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273262336 00002000:00100000:2.0:1746065157.866736:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x19:0x0] (7340032->8388607) req@ffff88009aa41c00 x1830881273262336/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.866752:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aa41c00 with x1830881273262336 ext(7340032->8388607) 00002000:00010000:2.0:1746065157.866757:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aa41c00 00000100:00100000:2.0:1746065157.866792:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13915 00000100:00100000:2.0:1746065157.866799:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2005:x1830881273262336:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:3.0:1746065157.867003:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.869664:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.871552:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273262464 00000100:00100000:2.0:1746065157.871564:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273262464 00002000:00100000:2.0:1746065157.871610:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1a:0x0] (7340032->8388607) req@ffff8801307cc700 x1830881273262464/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.871619:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cc700 with x1830881273262464 ext(7340032->8388607) 00002000:00010000:2.0:1746065157.871623:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307cc700 00000100:00100000:2.0:1746065157.871648:0:9564:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273262720 00000100:00100000:2.0:1746065157.871651:0:9564:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273262720 00002000:00100000:2.0:1746065157.871662:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1a:0x0] (8388608->9437183) req@ffff8801307cce00 x1830881273262720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.871668:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cce00 with x1830881273262720 ext(8388608->9437183) 00002000:00010000:2.0:1746065157.871671:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307cce00 00000100:00100000:2.0:1746065157.871684:0:9564:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13916 00000100:00100000:2.0:1746065157.871691:0:9564:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273262464:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:0.0:1746065157.871897:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13917 00000100:00100000:0.0:1746065157.871904:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273262720:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:3.0:1746065157.872497:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.872512:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273262976 00000100:00100000:3.0:1746065157.872515:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273262976 00002000:00100000:3.0:1746065157.872532:0:9565:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x19:0x0] (8388608->9437183) req@ffff8801307cd500 x1830881273262976/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.872539:0:9565:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cd500 with x1830881273262976 ext(8388608->9437183) 00002000:00010000:3.0:1746065157.872542:0:9565:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307cd500 00000100:00100000:3.0:1746065157.872558:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13918 00000100:00100000:3.0:1746065157.872563:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2004:x1830881273262976:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:0.0:1746065157.873597:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.873614:0:9563:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273263232 00000100:00100000:0.0:1746065157.873618:0:9563:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273263232 00002000:00100000:0.0:1746065157.873635:0:9563:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1a:0x0] (9437184->10485759) req@ffff8801237b8e00 x1830881273263232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.873643:0:9563:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8e00 with x1830881273263232 ext(9437184->10485759) 00002000:00010000:0.0:1746065157.873646:0:9563:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b8e00 00000100:00100000:0.0:1746065157.873657:0:9563:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13919 00000100:00100000:0.0:1746065157.873662:0:9563:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2005:x1830881273263232:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:3.0:1746065157.874147:0:27174:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2004:x1830881273261568:12345-192.168.202.8@tcp:3:dd.0 Request processed in 18503us (18694us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.874154:0:27174:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13912 00002000:00100000:3.0:1746065157.874160:0:27174:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x1a:0x0] (6291456->7340031) req@ffff8801307cf800 x1830881273261568/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.874168:0:27174:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cf800 with x1830881273261568 ext(6291456->7340031) 00002000:00010000:3.0:1746065157.874171:0:27174:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307cf800 00000100:00100000:0.0:1746065157.874802:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801237b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267830528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065157.874838:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065157.875033:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267830528 00000100:00100000:3.0:1746065157.875038:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267830528 00000100:00100000:3.0:1746065157.875061:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1746065157.875066:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3768:x1830881267830528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746065157.875104:0:7216:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1445957632 avail 1316495360 00000100:00100000:3.0:1746065157.875138:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3768:x1830881267830528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.875143:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1746065157.875487:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801237b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3768:1830881267830528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746065157.876752:0:27165:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2005:x1830881273260928:12345-192.168.202.8@tcp:4:dd.0 Request processed in 48255us (48430us total) trans 4294970748 rc 0/0 00000100:00100000:2.0:1746065157.876761:0:27165:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13910 00002000:00100000:2.0:1746065157.876781:0:27165:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x1a:0x0] (0->4194303) req@ffff8801237b8a80 x1830881273260928/t4294970748(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.876795:0:27165:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8a80 with x1830881273260928 ext(0->4194303) 00002000:00010000:2.0:1746065157.876800:0:27165:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237b8a80 00000100:00100000:3.0:1746065157.879969:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065157.880172:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.880718:0:27165:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273263488 00000100:00100000:1.0:1746065157.880718:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273263744 00000100:00100000:2.0:1746065157.880726:0:27165:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273263488 00000100:00100000:1.0:1746065157.880726:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273263744 00002000:00100000:1.0:1746065157.880758:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1a:0x0] (10485760->11534335) req@ffff8801307ce300 x1830881273263744/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.880759:0:27165:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x19:0x0] (9437184->10485759) req@ffff8801307cdf80 x1830881273263488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.880777:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ce300 with x1830881273263744 ext(10485760->11534335) 00002000:00100000:2.0:1746065157.880780:0:27165:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cdf80 with x1830881273263488 ext(9437184->10485759) 00002000:00010000:1.0:1746065157.880782:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307ce300 00002000:00010000:2.0:1746065157.880786:0:27165:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307cdf80 00000100:00100000:1.0:1746065157.880806:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13920 00000100:00100000:1.0:1746065157.880813:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2005:x1830881273263744:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065157.880815:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13921 00000100:00100000:2.0:1746065157.880821:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2005:x1830881273263488:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:1.0:1746065157.883841:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.883879:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.884006:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2004:x1830881273261952:12345-192.168.202.8@tcp:3:dd.0 Request processed in 27686us (27748us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.884014:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13914 00002000:00100000:1.0:1746065157.884022:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x19:0x0] (6291456->7340031) req@ffff8801307cf480 x1830881273261952/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.884029:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cf480 with x1830881273261952 ext(6291456->7340031) 00002000:00010000:1.0:1746065157.884034:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307cf480 00000100:00100000:1.0:1746065157.884052:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273264000 00000100:00100000:1.0:1746065157.884057:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273264000 00002000:00100000:1.0:1746065157.884078:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x19:0x0] (10485760->11534335) req@ffff88012f6aa680 x1830881273264000/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.884107:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6aa680 with x1830881273264000 ext(10485760->11534335) 00002000:00010000:1.0:1746065157.884109:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f6aa680 00000100:00100000:1.0:1746065157.884118:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273264256 00000100:00100000:1.0:1746065157.884120:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273264256 00002000:00100000:1.0:1746065157.884130:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1a:0x0] (11534336->12582911) req@ffff88012f6aaa00 x1830881273264256/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.884136:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6aaa00 with x1830881273264256 ext(11534336->12582911) 00002000:00010000:1.0:1746065157.884138:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f6aaa00 00000100:00100000:1.0:1746065157.884144:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13922 00000100:00100000:1.0:1746065157.884150:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2005:x1830881273264000:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:0.0:1746065157.893713:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.893932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.893958:0:27165:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:2.0:1746065157.893966:0:27165:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost_io00_012' 00000100:00100000:3.0:1746065157.894009:0:27174:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:3.0:1746065157.894016:0:27174:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273264512 00000100:00100000:3.0:1746065157.894022:0:27174:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273264512 00002000:00100000:3.0:1746065157.894055:0:27174:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x19:0x0] (11534336->12582911) req@ffff8801237bb100 x1830881273264512/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.894063:0:27174:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237bb100 with x1830881273264512 ext(11534336->12582911) 00002000:00010000:3.0:1746065157.894068:0:27174:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237bb100 00000100:00100000:3.0:1746065157.894078:0:27174:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:3.0:1746065157.894097:0:27174:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273264768 00000100:00100000:3.0:1746065157.894100:0:27174:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273264768 00002000:00100000:3.0:1746065157.894115:0:27174:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x1a:0x0] (12582912->13631487) req@ffff8801237b8000 x1830881273264768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.894122:0:27174:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8000 with x1830881273264768 ext(12582912->13631487) 00002000:00010000:3.0:1746065157.894125:0:27174:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b8000 00000100:00100000:1.0:1746065157.896354:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+18:2005:x1830881273262336:12345-192.168.202.8@tcp:3:dd.0 Request processed in 29548us (29675us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.896363:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13915 00002000:00100000:1.0:1746065157.896372:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x19:0x0] (7340032->8388607) req@ffff88009aa41c00 x1830881273262336/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.896380:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aa41c00 with x1830881273262336 ext(7340032->8388607) 00002000:00010000:1.0:1746065157.896384:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aa41c00 00000100:00100000:1.0:1746065157.896405:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13923 00000100:00100000:1.0:1746065157.896413:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+18:2005:x1830881273264256:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:3.0:1746065157.898311:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+18:2005:x1830881273262720:12345-192.168.202.8@tcp:3:dd.0 Request processed in 26403us (28649us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.898321:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13917 00002000:00100000:3.0:1746065157.898328:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1a:0x0] (8388608->9437183) req@ffff8801307cce00 x1830881273262720/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.898336:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cce00 with x1830881273262720 ext(8388608->9437183) 00002000:00010000:3.0:1746065157.898340:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307cce00 00000100:00100000:3.0:1746065157.898359:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13924 00000100:00100000:3.0:1746065157.898365:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2005:x1830881273264512:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:0.0:1746065157.905149:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13925 00000100:00100000:0.0:1746065157.905162:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+19:2005:x1830881273264768:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:0.0:1746065157.907685:0:27164:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+19:2004:x1830881273261184:12345-192.168.202.8@tcp:4:dd.0 Request processed in 67799us (68494us total) trans 4294972165 rc 0/0 00000100:00100000:0.0:1746065157.907695:0:27164:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13911 00002000:00100000:0.0:1746065157.907705:0:27164:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1b:0x0] (0->4194303) req@ffff88009aa40a80 x1830881273261184/t4294972165(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.907715:0:27164:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aa40a80 with x1830881273261184 ext(0->4194303) 00002000:00010000:0.0:1746065157.907719:0:27164:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aa40a80 00000100:00100000:2.0:1746065157.911376:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2004:x1830881273262976:12345-192.168.202.8@tcp:3:dd.0 Request processed in 38804us (38872us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.911385:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13918 00002000:00100000:2.0:1746065157.911394:0:9565:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x19:0x0] (8388608->9437183) req@ffff8801307cd500 x1830881273262976/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.911401:0:9565:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cd500 with x1830881273262976 ext(8388608->9437183) 00002000:00010000:2.0:1746065157.911405:0:9565:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307cd500 00000100:00100000:2.0:1746065157.921591:0:9564:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2005:x1830881273262464:12345-192.168.202.8@tcp:3:dd.0 Request processed in 49893us (54581us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.921601:0:9564:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13916 00002000:00100000:2.0:1746065157.921611:0:9564:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1a:0x0] (7340032->8388607) req@ffff8801307cc700 x1830881273262464/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.921625:0:9564:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cc700 with x1830881273262464 ext(7340032->8388607) 00002000:00010000:2.0:1746065157.921630:0:9564:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307cc700 00000100:00100000:1.0:1746065157.922713:0:9563:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2005:x1830881273263232:12345-192.168.202.8@tcp:3:dd.0 Request processed in 49045us (49113us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.922720:0:9563:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13919 00002000:00100000:1.0:1746065157.922727:0:9563:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1a:0x0] (9437184->10485759) req@ffff8801237b8e00 x1830881273263232/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.922734:0:9563:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8e00 with x1830881273263232 ext(9437184->10485759) 00002000:00010000:1.0:1746065157.922737:0:9563:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b8e00 00000100:00100000:2.0:1746065157.937226:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2005:x1830881273263488:12345-192.168.202.8@tcp:3:dd.0 Request processed in 56395us (57254us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.937238:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13921 00002000:00100000:2.0:1746065157.937249:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x19:0x0] (9437184->10485759) req@ffff8801307cdf80 x1830881273263488/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.937257:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307cdf80 with x1830881273263488 ext(9437184->10485759) 00002000:00010000:2.0:1746065157.937262:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801307cdf80 00000100:00100000:2.0:1746065157.939589:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273263744:12345-192.168.202.8@tcp:3:dd.0 Request processed in 58770us (59410us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.939598:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13920 00002000:00100000:2.0:1746065157.939605:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1a:0x0] (10485760->11534335) req@ffff8801307ce300 x1830881273263744/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.939614:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801307ce300 with x1830881273263744 ext(10485760->11534335) 00002000:00010000:2.0:1746065157.939618:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801307ce300 00000001:00080000:0.0:1746065157.940661:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970749 is committed 00000001:00080000:0.0:1746065157.940671:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970748 is committed 00002000:00010000:1.0:1746065157.941020:0:20722:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 8355840 -> 10444800 00002000:00010000:1.0:1746065157.941024:0:20722:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 16320 -> 20400 00010000:00010000:1.0:1746065157.941034:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b200/0x392ae0376f881150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8355840->10444799] (req 8355840->10444799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.941043:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b200/0x392ae0376f881150 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8355840->10444799] (req 8355840->10444799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.941050:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b200/0x392ae0376f881150 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8355840->10444799] (req 8355840->10444799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.941056:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a8b200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065157.941060:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b200/0x392ae0376f881150 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8355840->10444799] (req 8355840->10444799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.941066:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b200/0x392ae0376f881150 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8355840->10444799] (req 8355840->10444799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.941108:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b200/0x392ae0376f881150 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8355840->10444799] (req 8355840->10444799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.941113:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b200/0x392ae0376f881150 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8355840->10444799] (req 8355840->10444799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.941184:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273261696:12345-192.168.202.8@tcp:4:dd.0 Request processed in 85505us (85677us total) trans 4294970749 rc 0/0 00000100:00100000:1.0:1746065157.941191:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13913 00000100:00100000:2.0:1746065157.942734:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2005:x1830881273264000:12345-192.168.202.8@tcp:3:dd.0 Request processed in 58580us (58896us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.942740:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13922 00002000:00100000:2.0:1746065157.942747:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x19:0x0] (10485760->11534335) req@ffff88012f6aa680 x1830881273264000/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.942753:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6aa680 with x1830881273264000 ext(10485760->11534335) 00002000:00010000:2.0:1746065157.942758:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f6aa680 00000100:00100000:0.0:1746065157.948521:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065157.948555:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.950010:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273265152 00000100:00100000:2.0:1746065157.950020:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273265152 00000100:00100000:2.0:1746065157.950178:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273265280 00000100:00100000:2.0:1746065157.950182:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273265280 00000100:00100000:1.0:1746065157.950190:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13926 00000100:00100000:1.0:1746065157.950198:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273265152:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065157.950201:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13927 00000100:00100000:2.0:1746065157.950205:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273265280:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065157.950226:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f88115e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.950226:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f881157 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.950238:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.950238:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.950239:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.950239:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.950243:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f88115e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.950243:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f881157 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.950253:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f88115e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.950253:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f881157 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.951737:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2005:x1830881273264256:12345-192.168.202.8@tcp:3:dd.0 Request processed in 55316us (67848us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065157.951745:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13923 00002000:00100000:0.0:1746065157.951753:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1a:0x0] (11534336->12582911) req@ffff88012f6aaa00 x1830881273264256/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.951764:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6aaa00 with x1830881273264256 ext(11534336->12582911) 00002000:00010000:0.0:1746065157.951775:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f6aaa00 00000100:00100000:3.0:1746065157.954455:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2005:x1830881273264512:12345-192.168.202.8@tcp:3:dd.0 Request processed in 56082us (60741us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.954465:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13924 00002000:00100000:3.0:1746065157.954475:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x19:0x0] (11534336->12582911) req@ffff8801237bb100 x1830881273264512/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.954484:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237bb100 with x1830881273264512 ext(11534336->12582911) 00002000:00010000:3.0:1746065157.954489:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801237bb100 00000100:00100000:2.0:1746065157.958102:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2005:x1830881273264768:12345-192.168.202.8@tcp:3:dd.0 Request processed in 52912us (64138us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.958113:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13925 00002000:00100000:2.0:1746065157.958123:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1a:0x0] (12582912->13631487) req@ffff8801237b8000 x1830881273264768/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.958132:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801237b8000 with x1830881273264768 ext(12582912->13631487) 00002000:00010000:2.0:1746065157.958138:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801237b8000 00010000:00010000:1.0:1746065157.976357:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f881157 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.976372:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f881157 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.976379:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f881157 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.976386:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a04b8600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065157.976390:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f881157 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.976397:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f881157 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.976411:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f881157 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.976417:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b8600/0x392ae0376f881157 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.976491:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273265152:12345-192.168.202.8@tcp:3:dd.0 Request processed in 26290us (27972us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.976499:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13926 00000100:00100000:0.0:1746065157.977258:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065157.977342:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273265664 00000100:00100000:1.0:1746065157.977349:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273265664 00002000:00100000:1.0:1746065157.977379:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (4194304->8388607) req@ffff8801352c0380 x1830881273265664/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.977387:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352c0380 with x1830881273265664 ext(4194304->8388607) 00002000:00010000:1.0:1746065157.977390:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801352c0380 00000100:00100000:1.0:1746065157.977419:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13928 00000100:00100000:1.0:1746065157.977425:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2002:x1830881273265664:12345-192.168.202.8@tcp:4:dd.0 00010000:00010000:2.0:1746065157.980127:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f88115e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.980146:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f88115e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.980153:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f88115e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.980160:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f846600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065157.980164:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f88115e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.980169:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f88115e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.980184:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f88115e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.980189:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f846600/0x392ae0376f88115e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.980242:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273265280:12345-192.168.202.8@tcp:3:dd.0 Request processed in 30032us (31682us total) trans 0 rc 1040384/1040384 00000100:00100000:2.0:1746065157.980249:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13927 00000100:00100000:0.0:1746065157.990121:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065157.990197:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273265920 00000100:00100000:2.0:1746065157.990205:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273265920 00000100:00100000:2.0:1746065157.990262:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13929 00000100:00100000:2.0:1746065157.990268:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273265920:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:2.0:1746065157.990308:0:27163:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 10444800, mtime: 0x6812d705, atime: 0x0, ctime: 0x6812d705, blocks: 0x4fb0 00010000:00010000:2.0:1746065157.990315:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f881165 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.990325:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.990327:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.990331:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f881165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10444800->12533759] (req 10444800->12533759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.990343:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f881165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10444800->12533759] (req 10444800->12533759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065158.002576:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.002656:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273266176 00000100:00100000:3.0:1746065158.002663:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273266176 00002000:00100000:3.0:1746065158.002698:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1b:0x0] (4194304->8388607) req@ffff8801352c0a80 x1830881273266176/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.002708:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352c0a80 with x1830881273266176 ext(4194304->8388607) 00002000:00010000:3.0:1746065158.002713:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801352c0a80 00000100:00100000:3.0:1746065158.002741:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13930 00000100:00100000:3.0:1746065158.002747:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2004:x1830881273266176:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:1.0:1746065158.030303:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2002:x1830881273265664:12345-192.168.202.8@tcp:4:dd.0 Request processed in 52870us (53038us total) trans 4294970750 rc 0/0 00000100:00100000:1.0:1746065158.030314:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13928 00002000:00100000:1.0:1746065158.030326:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (4194304->8388607) req@ffff8801352c0380 x1830881273265664/t4294970750(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.030334:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352c0380 with x1830881273265664 ext(4194304->8388607) 00002000:00010000:1.0:1746065158.030339:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801352c0380 00000001:00080000:1.0:1746065158.046437:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970751 is committed 00000001:00080000:1.0:1746065158.046451:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970750 is committed 00002000:00010000:3.0:1746065158.051529:0:27163:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 10444800 -> 12533760 00002000:00010000:3.0:1746065158.051535:0:27163:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 20400 -> 24480 00010000:00010000:3.0:1746065158.051546:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f881165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10444800->12533759] (req 10444800->12533759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.051557:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f881165 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10444800->12533759] (req 10444800->12533759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.051564:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f881165 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10444800->12533759] (req 10444800->12533759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.051570:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f847200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065158.051574:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f881165 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10444800->12533759] (req 10444800->12533759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.051581:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f881165 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10444800->12533759] (req 10444800->12533759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.051595:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f881165 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10444800->12533759] (req 10444800->12533759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.051601:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f847200/0x392ae0376f881165 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10444800->12533759] (req 10444800->12533759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.051675:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273265920:12345-192.168.202.8@tcp:4:dd.0 Request processed in 61403us (61592us total) trans 4294970751 rc 0/0 00000100:00100000:3.0:1746065158.051683:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13929 00000100:00100000:0.0:1746065158.054487:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.054531:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.054601:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273266560 00000100:00100000:1.0:1746065158.054608:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273266560 00000100:00100000:1.0:1746065158.054669:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273266816 00000100:00100000:1.0:1746065158.054672:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273266816 00000100:00100000:1.0:1746065158.054690:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13931 00000100:00100000:1.0:1746065158.054696:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273266560:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1746065158.054722:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8400/0x392ae0376f88116c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.054732:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.054734:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.054738:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8400/0x392ae0376f88116c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.054749:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8400/0x392ae0376f88116c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746065158.055494:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746065158.055497:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065158.055520:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13932 00000100:00100000:2.0:1746065158.055527:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273266816:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065158.055543:0:24940:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f847c00/0x392ae0376f881173 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.055549:0:24940:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.055551:0:24940:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.055553:0:24940:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f847c00/0x392ae0376f881173 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.055561:0:24940:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f847c00/0x392ae0376f881173 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.065032:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273266176:12345-192.168.202.8@tcp:4:dd.0 Request processed in 62278us (62457us total) trans 4294972166 rc 0/0 00000100:00100000:2.0:1746065158.065043:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13930 00002000:00100000:2.0:1746065158.065052:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1b:0x0] (4194304->8388607) req@ffff8801352c0a80 x1830881273266176/t4294972166(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:74/0 lens 488/448 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.065060:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352c0a80 with x1830881273266176 ext(4194304->8388607) 00002000:00010000:2.0:1746065158.065065:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801352c0a80 00010000:00010000:2.0:1746065158.069251:0:24940:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f847c00/0x392ae0376f881173 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.069265:0:24940:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f847c00/0x392ae0376f881173 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.069272:0:24940:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f847c00/0x392ae0376f881173 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.069278:0:24940:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f847c00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065158.069282:0:24940:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f847c00/0x392ae0376f881173 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.069289:0:24940:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f847c00/0x392ae0376f881173 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.069304:0:24940:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f847c00/0x392ae0376f881173 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.069309:0:24940:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f847c00/0x392ae0376f881173 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.069394:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273266816:12345-192.168.202.8@tcp:3:dd.0 Request processed in 13864us (14858us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065158.069403:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13932 00010000:00010000:3.0:1746065158.069512:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8400/0x392ae0376f88116c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.069520:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8400/0x392ae0376f88116c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.069526:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8400/0x392ae0376f88116c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.069530:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a04b8400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065158.069532:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8400/0x392ae0376f88116c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.069542:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8400/0x392ae0376f88116c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.069550:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8400/0x392ae0376f88116c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.069556:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8400/0x392ae0376f88116c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.069611:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273266560:12345-192.168.202.8@tcp:3:dd.0 Request processed in 14914us (15129us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746065158.069617:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13931 00000100:00100000:0.0:1746065158.074894:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.075251:0:24940:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273267072 00000100:00100000:0.0:1746065158.075259:0:24940:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273267072 00000100:00100000:3.0:1746065158.075312:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13933 00000100:00100000:3.0:1746065158.075321:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273267072:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:3.0:1746065158.075355:0:20722:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 12533760, mtime: 0x6812d705, atime: 0x0, ctime: 0x6812d705, blocks: 0x5fa0 00010000:00010000:3.0:1746065158.075362:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cee7c00/0x392ae0376f88117a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.075372:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.075374:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.075383:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cee7c00/0x392ae0376f88117a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12533760->14622719] (req 12533760->14622719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.075394:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cee7c00/0x392ae0376f88117a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12533760->14622719] (req 12533760->14622719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065158.100378:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.103025:0:24940:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273267328 00000100:00100000:2.0:1746065158.103036:0:24940:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273267328 00002000:00100000:2.0:1746065158.103073:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x1a:0x0] (8388608->12582911) req@ffff8801352c2680 x1830881273267328/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.103098:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352c2680 with x1830881273267328 ext(8388608->12582911) 00002000:00010000:2.0:1746065158.103103:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801352c2680 00000100:00100000:2.0:1746065158.103131:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13934 00000100:00100000:2.0:1746065158.103138:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2005:x1830881273267328:12345-192.168.202.8@tcp:4:dd.0 00000001:00080000:1.0:1746065158.106596:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970752 is committed 00002000:00010000:3.0:1746065158.107167:0:20722:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 12533760 -> 14622720 00002000:00010000:3.0:1746065158.107171:0:20722:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 24480 -> 28560 00010000:00010000:3.0:1746065158.107182:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cee7c00/0x392ae0376f88117a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12533760->14622719] (req 12533760->14622719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.107193:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cee7c00/0x392ae0376f88117a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12533760->14622719] (req 12533760->14622719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.107200:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cee7c00/0x392ae0376f88117a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12533760->14622719] (req 12533760->14622719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.107206:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cee7c00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065158.107209:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cee7c00/0x392ae0376f88117a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12533760->14622719] (req 12533760->14622719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.107216:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cee7c00/0x392ae0376f88117a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12533760->14622719] (req 12533760->14622719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.107231:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cee7c00/0x392ae0376f88117a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12533760->14622719] (req 12533760->14622719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.107237:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cee7c00/0x392ae0376f88117a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12533760->14622719] (req 12533760->14622719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.109314:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273267072:12345-192.168.202.8@tcp:4:dd.0 Request processed in 33987us (34419us total) trans 4294970752 rc 0/0 00000100:00100000:3.0:1746065158.109329:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13933 00000100:00100000:2.0:1746065158.110752:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.110849:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273267584 00000100:00100000:3.0:1746065158.110856:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273267584 00002000:00100000:3.0:1746065158.110887:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1b:0x0] (8388608->12582911) req@ffff88009aa41880 x1830881273267584/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.110896:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aa41880 with x1830881273267584 ext(8388608->12582911) 00002000:00010000:3.0:1746065158.110900:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aa41880 00000100:00100000:3.0:1746065158.110914:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13935 00000100:00100000:3.0:1746065158.110919:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273267584:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065158.114789:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.114811:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.114834:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273268224 00000100:00100000:0.0:1746065158.114841:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273268224 00000100:00100000:3.0:1746065158.114852:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273267840 00000100:00100000:3.0:1746065158.114856:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273267840 00000100:00080000:2.0:1746065158.114879:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065158.114885:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13936 00000100:00100000:3.0:1746065158.114889:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 203 00000100:00100000:3.0:1746065158.114894:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:3814:x1830881273267840:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:0.0:1746065158.114894:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881273268224:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065158.114920:0:28841:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fb68600/0x392ae0376f881181 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.114930:0:28841:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.114932:0:28841:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.114936:0:28841:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68600/0x392ae0376f881181 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.114946:0:28841:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb68600/0x392ae0376f881181 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.115059:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+16:3814:x1830881273267840:12345-192.168.202.8@tcp:35:dd.0 Request processed in 165us (277us total) trans 4294983620 rc 0/0 00000100:00100000:3.0:1746065158.115065:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 203 00000100:00100000:3.0:1746065158.116624:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.118883:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273268352 00000100:00100000:0.0:1746065158.118893:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273268352 00000100:00100000:0.0:1746065158.119603:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13937 00000100:00100000:0.0:1746065158.119614:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273268352:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065158.119645:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb68000/0x392ae0376f881188 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.119658:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.119659:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.119663:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb68000/0x392ae0376f881188 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.119675:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb68000/0x392ae0376f881188 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.126187:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.126259:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273268736 00000100:00100000:3.0:1746065158.126268:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273268736 00000100:00100000:3.0:1746065158.126302:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 204 00000100:00100000:3.0:1746065158.126308:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+16:3814:x1830881273268736:12345-192.168.202.8@tcp:35:dd.0 00010000:00010000:1.0:1746065158.126324:0:28841:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fb68600/0x392ae0376f881181 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.126334:0:28841:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68600/0x392ae0376f881181 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.126345:0:28841:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb68600/0x392ae0376f881181 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.126350:0:28841:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb68600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065158.126353:0:28841:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb68600/0x392ae0376f881181 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.126358:0:28841:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb68600/0x392ae0376f881181 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.126372:0:28841:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb68600/0x392ae0376f881181 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.126376:0:28841:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68600/0x392ae0376f881181 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746065158.126453:0:7214:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294983621 00000100:00100000:1.0:1746065158.126457:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881273268224:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11565us (11643us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065158.126464:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13936 00000100:00100000:3.0:1746065158.126502:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+18:3814:x1830881273268736:12345-192.168.202.8@tcp:35:dd.0 Request processed in 194us (322us total) trans 4294983622 rc 0/0 00000100:00100000:3.0:1746065158.126511:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 204 00000020:00080000:3.0:1746065158.126514:0:7214:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1746065158.131422:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb68000/0x392ae0376f881188 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.131435:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb68000/0x392ae0376f881188 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.131442:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb68000/0x392ae0376f881188 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.131453:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb68000 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065158.131456:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb68000/0x392ae0376f881188 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.131463:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb68000/0x392ae0376f881188 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.131478:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb68000/0x392ae0376f881188 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.131483:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb68000/0x392ae0376f881188 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065158.131544:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2005:x1830881273268352:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11930us (14920us total) trans 0 rc 1040384/1040384 00000100:00100000:0.0:1746065158.131552:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13937 00000100:00100000:2.0:1746065158.141816:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2005:x1830881273267328:12345-192.168.202.8@tcp:4:dd.0 Request processed in 38671us (41437us total) trans 4294970753 rc 0/0 00000100:00100000:2.0:1746065158.141827:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13934 00002000:00100000:2.0:1746065158.141836:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x1a:0x0] (8388608->12582911) req@ffff8801352c2680 x1830881273267328/t4294970753(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:74/0 lens 488/448 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.141845:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801352c2680 with x1830881273267328 ext(8388608->12582911) 00002000:00010000:2.0:1746065158.141851:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801352c2680 00000100:00100000:0.0:1746065158.145117:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.146192:0:24940:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273268992 00000100:00100000:2.0:1746065158.146201:0:24940:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273268992 00000100:00100000:2.0:1746065158.146252:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13938 00000100:00100000:2.0:1746065158.146260:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273268992:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:2.0:1746065158.146299:0:24940:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 14622720, mtime: 0x6812d705, atime: 0x0, ctime: 0x6812d705, blocks: 0x6f90 00010000:00010000:2.0:1746065158.146306:0:24940:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f88118f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.146316:0:24940:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.146318:0:24940:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.146322:0:24940:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f88118f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14622720->16711679] (req 14622720->16711679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.146333:0:24940:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f88118f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14622720->16711679] (req 14622720->16711679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.157018:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2004:x1830881273267584:12345-192.168.202.8@tcp:4:dd.0 Request processed in 46089us (46262us total) trans 4294972167 rc 0/0 00000100:00100000:3.0:1746065158.157028:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13935 00002000:00100000:3.0:1746065158.157038:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1b:0x0] (8388608->12582911) req@ffff88009aa41880 x1830881273267584/t4294972167(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:74/0 lens 488/448 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.157046:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aa41880 with x1830881273267584 ext(8388608->12582911) 00002000:00010000:3.0:1746065158.157051:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aa41880 00000001:00080000:1.0:1746065158.174778:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970754 is committed 00000001:00080000:1.0:1746065158.174792:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970753 is committed 00002000:00010000:2.0:1746065158.175950:0:24940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 14622720 -> 16711680 00002000:00010000:2.0:1746065158.175955:0:24940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 28560 -> 32640 00010000:00010000:2.0:1746065158.175966:0:24940:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f88118f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14622720->16711679] (req 14622720->16711679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.175975:0:24940:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f88118f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14622720->16711679] (req 14622720->16711679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.175982:0:24940:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f88118f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14622720->16711679] (req 14622720->16711679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.175988:0:24940:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10c00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065158.175991:0:24940:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f88118f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14622720->16711679] (req 14622720->16711679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.176002:0:24940:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f88118f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14622720->16711679] (req 14622720->16711679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.176016:0:24940:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f88118f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14622720->16711679] (req 14622720->16711679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.176021:0:24940:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f88118f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14622720->16711679] (req 14622720->16711679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.176397:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273268992:12345-192.168.202.8@tcp:4:dd.0 Request processed in 30134us (31283us total) trans 4294970754 rc 0/0 00000100:00100000:2.0:1746065158.176406:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13938 00000100:00100000:0.0:1746065158.179944:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.180157:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.180225:0:24940:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273269248 00000100:00100000:2.0:1746065158.180232:0:24940:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273269248 00000100:00100000:3.0:1746065158.180274:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273269504 00000100:00100000:3.0:1746065158.180277:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273269504 00000100:00100000:2.0:1746065158.180279:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13939 00000100:00100000:2.0:1746065158.180285:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273269248:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065158.180316:0:24940:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881196 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.180328:0:24940:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.180329:0:24940:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.180333:0:24940:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881196 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8323072->8388607] (req 8323072->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.180344:0:24940:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881196 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8323072->8388607] (req 8323072->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.180362:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13940 00000100:00100000:3.0:1746065158.180367:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2004:x1830881273269504:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065158.180381:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f88119d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.180387:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.180388:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.180391:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f88119d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.180398:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f88119d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065158.182204:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.183217:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273269760 00000100:00100000:1.0:1746065158.183225:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273269760 00000100:00100000:1.0:1746065158.183275:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13941 00000100:00100000:1.0:1746065158.183282:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273269760:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1746065158.183312:0:28841:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f8811a4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.183322:0:28841:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.183323:0:28841:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.183328:0:28841:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f8811a4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [8388608->9363455] (req 8388608->9363455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.183338:0:28841:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f8811a4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [8388608->9363455] (req 8388608->9363455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.184132:0:24940:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881196 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [8323072->8388607] (req 8323072->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.184149:0:24940:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881196 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [8323072->8388607] (req 8323072->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.184155:0:24940:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881196 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [8323072->8388607] (req 8323072->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.184161:0:24940:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11000 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065158.184164:0:24940:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881196 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [8323072->8388607] (req 8323072->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.184171:0:24940:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881196 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [8323072->8388607] (req 8323072->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.184182:0:24940:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881196 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [8323072->8388607] (req 8323072->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.184187:0:24940:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881196 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [8323072->8388607] (req 8323072->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.184235:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273269248:12345-192.168.202.8@tcp:3:dd.0 Request processed in 3949us (4297us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1746065158.184241:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13939 00010000:00010000:3.0:1746065158.193252:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f88119d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.193267:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f88119d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.193279:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f88119d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.193286:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a8b200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065158.193289:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f88119d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.193296:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f88119d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.193311:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f88119d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.193316:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b200/0x392ae0376f88119d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.193425:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2004:x1830881273269504:12345-192.168.202.8@tcp:3:dd.0 Request processed in 13054us (13264us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065158.193435:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13940 00010000:00010000:1.0:1746065158.195277:0:28841:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f8811a4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9363455] (req 8388608->9363455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.195290:0:28841:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f8811a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9363455] (req 8388608->9363455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.195297:0:28841:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f8811a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9363455] (req 8388608->9363455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.195302:0:28841:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072568800 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065158.195305:0:28841:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f8811a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9363455] (req 8388608->9363455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.195312:0:28841:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f8811a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9363455] (req 8388608->9363455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.195323:0:28841:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f8811a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9363455] (req 8388608->9363455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.195328:0:28841:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f8811a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9363455] (req 8388608->9363455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065158.195387:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273269760:12345-192.168.202.8@tcp:3:dd.0 Request processed in 12103us (13183us total) trans 0 rc 974848/974848 00000100:00100000:1.0:1746065158.195395:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13941 00000100:00100000:0.0:1746065158.199596:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.199673:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273270016 00000100:00100000:1.0:1746065158.199679:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273270016 00000100:00100000:1.0:1746065158.199724:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13942 00000100:00100000:1.0:1746065158.199729:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273270016:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1746065158.199781:0:28841:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 16711680, mtime: 0x6812d705, atime: 0x0, ctime: 0x6812d705, blocks: 0x7f80 00010000:00010000:1.0:1746065158.199794:0:28841:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f8811ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.199806:0:28841:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.199808:0:28841:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.199812:0:28841:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f8811ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16711680->18800639] (req 16711680->18800639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.199823:0:28841:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f8811ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16711680->18800639] (req 16711680->18800639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746065158.221163:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970755 is committed 00002000:00010000:1.0:1746065158.221393:0:28841:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 16711680 -> 18800640 00002000:00010000:1.0:1746065158.221397:0:28841:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 32640 -> 36720 00010000:00010000:1.0:1746065158.221408:0:28841:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f8811ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16711680->18800639] (req 16711680->18800639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.221417:0:28841:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f8811ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16711680->18800639] (req 16711680->18800639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.221427:0:28841:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f8811ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16711680->18800639] (req 16711680->18800639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.221433:0:28841:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072569400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065158.221436:0:28841:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f8811ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16711680->18800639] (req 16711680->18800639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.221442:0:28841:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f8811ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16711680->18800639] (req 16711680->18800639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.221457:0:28841:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f8811ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16711680->18800639] (req 16711680->18800639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.221462:0:28841:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072569400/0x392ae0376f8811ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16711680->18800639] (req 16711680->18800639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065158.221819:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273270016:12345-192.168.202.8@tcp:4:dd.0 Request processed in 22033us (22172us total) trans 4294970755 rc 0/0 00000100:00100000:1.0:1746065158.221828:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13942 00000100:00100000:0.0:1746065158.224393:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.224879:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.225339:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273270272 00000100:00100000:1.0:1746065158.225347:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273270272 00000100:00100000:0.0:1746065158.225371:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.225406:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273270528 00000100:00100000:0.0:1746065158.225410:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273270528 00000100:00100000:0.0:1746065158.225438:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273270784 00000100:00100000:0.0:1746065158.225440:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273270784 00000100:00100000:0.0:1746065158.225454:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13943 00000100:00100000:0.0:1746065158.225460:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273270272:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065158.225487:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb68e00/0x392ae0376f8811b2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.225498:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.225500:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.225504:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb68e00/0x392ae0376f8811b2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.225515:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb68e00/0x392ae0376f8811b2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065158.225630:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13944 00000100:00100000:0.0:1746065158.225635:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881273270528:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065158.225650:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f8811b9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.225657:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.225658:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.225661:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f8811b9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.225668:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f8811b9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065158.226745:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13945 00000100:00100000:1.0:1746065158.226753:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273270784:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1746065158.226785:0:27161:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f8811c0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.226801:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.226803:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.226807:0:27161:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f8811c0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.226815:0:27161:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f8811c0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.231060:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb68e00/0x392ae0376f8811b2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.231073:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb68e00/0x392ae0376f8811b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.231112:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb68e00/0x392ae0376f8811b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.231119:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb68e00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065158.231123:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb68e00/0x392ae0376f8811b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.231130:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb68e00/0x392ae0376f8811b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.231149:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb68e00/0x392ae0376f8811b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.231155:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb68e00/0x392ae0376f8811b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.231231:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273270272:12345-192.168.202.8@tcp:3:dd.0 Request processed in 5766us (6840us total) trans 0 rc 73728/73728 00000100:00100000:2.0:1746065158.231239:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13943 00010000:00010000:2.0:1746065158.237301:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f8811b9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.237314:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f8811b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.237321:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f8811b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.237325:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb69e00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065158.237328:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f8811b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.237334:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f8811b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.237348:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f8811b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.237353:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69e00/0x392ae0376f8811b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.237417:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881273270528:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11778us (12535us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065158.237426:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13944 00010000:00010000:1.0:1746065158.240279:0:27161:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f8811c0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.240292:0:27161:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f8811c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.240298:0:27161:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f8811c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.240302:0:27161:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072569e00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065158.240306:0:27161:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f8811c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.240312:0:27161:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f8811c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.240325:0:27161:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f8811c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.240330:0:27161:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072569e00/0x392ae0376f8811c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065158.240412:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273270784:12345-192.168.202.8@tcp:3:dd.0 Request processed in 13657us (15038us total) trans 0 rc 966656/966656 00000100:00100000:1.0:1746065158.240420:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13945 00000100:00100000:0.0:1746065158.246050:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.246109:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273271040 00000100:00100000:1.0:1746065158.246116:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273271040 00000100:00100000:1.0:1746065158.246175:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13946 00000100:00100000:1.0:1746065158.246182:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273271040:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1746065158.246225:0:27161:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 18800640, mtime: 0x6812d705, atime: 0x0, ctime: 0x6812d705, blocks: 0x8f70 00010000:00010000:1.0:1746065158.246232:0:27161:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f8811c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.246244:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.246245:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.246249:0:27161:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f8811c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18800640->20889599] (req 18800640->20889599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.246259:0:27161:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f8811c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18800640->20889599] (req 18800640->20889599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746065158.267047:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970756 is committed 00002000:00010000:2.0:1746065158.267224:0:27161:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 18800640 -> 20889600 00002000:00010000:2.0:1746065158.267227:0:27161:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 36720 -> 40800 00010000:00010000:2.0:1746065158.267235:0:27161:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f8811c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18800640->20889599] (req 18800640->20889599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.267247:0:27161:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f8811c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18800640->20889599] (req 18800640->20889599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.267252:0:27161:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f8811c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18800640->20889599] (req 18800640->20889599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.267256:0:27161:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130640a00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065158.267259:0:27161:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f8811c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18800640->20889599] (req 18800640->20889599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.267263:0:27161:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f8811c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18800640->20889599] (req 18800640->20889599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.267275:0:27161:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f8811c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18800640->20889599] (req 18800640->20889599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.267278:0:27161:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130640a00/0x392ae0376f8811c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18800640->20889599] (req 18800640->20889599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.267581:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273271040:12345-192.168.202.8@tcp:4:dd.0 Request processed in 21366us (21503us total) trans 4294970756 rc 0/0 00000100:00100000:2.0:1746065158.267615:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13946 00000100:00100000:0.0:1746065158.270592:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.270684:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273271296 00000100:00100000:2.0:1746065158.270692:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273271296 00000100:00100000:2.0:1746065158.270742:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13947 00000100:00100000:2.0:1746065158.270749:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273271296:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065158.270793:0:27161:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f8811ce lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.270805:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.270806:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.270811:0:27161:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f8811ce lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10403840->10485759] (req 10403840->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.270821:0:27161:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f8811ce lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10403840->10485759] (req 10403840->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065158.271581:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.271661:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.271811:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273271680 00000100:00100000:2.0:1746065158.271815:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273271680 00000100:00100000:2.0:1746065158.271837:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273271808 00000100:00100000:2.0:1746065158.271839:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273271808 00000100:00100000:2.0:1746065158.272230:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13948 00000100:00100000:2.0:1746065158.272237:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2002:x1830881273271680:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065158.272255:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800726f1600/0x392ae0376f8811d5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.272263:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.272264:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.272267:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800726f1600/0x392ae0376f8811d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [10485760->11444223] (req 10485760->11444223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.272275:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800726f1600/0x392ae0376f8811d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [10485760->11444223] (req 10485760->11444223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.272601:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13949 00000100:00100000:3.0:1746065158.272608:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273271808:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065158.272625:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b600/0x392ae0376f8811dc lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.272631:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.272633:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.272636:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b600/0x392ae0376f8811dc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.272643:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b600/0x392ae0376f8811dc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.273204:0:27161:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f8811ce lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [10403840->10485759] (req 10403840->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.273211:0:27161:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f8811ce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [10403840->10485759] (req 10403840->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.273217:0:27161:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f8811ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [10403840->10485759] (req 10403840->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.273223:0:27161:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe70a00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065158.273226:0:27161:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f8811ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [10403840->10485759] (req 10403840->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.273231:0:27161:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f8811ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [10403840->10485759] (req 10403840->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.273243:0:27161:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f8811ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [10403840->10485759] (req 10403840->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.273248:0:27161:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe70a00/0x392ae0376f8811ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [10403840->10485759] (req 10403840->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065158.275935:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2002:x1830881273271296:12345-192.168.202.8@tcp:3:dd.0 Request processed in 5178us (5342us total) trans 0 rc 81920/81920 00000100:00100000:1.0:1746065158.275946:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13947 00010000:00010000:3.0:1746065158.282656:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065158.284152:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b600/0x392ae0376f8811dc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.284165:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b600/0x392ae0376f8811dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.284172:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b600/0x392ae0376f8811dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.284179:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a8b600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065158.284182:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b600/0x392ae0376f8811dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.284189:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b600/0x392ae0376f8811dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.284204:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b600/0x392ae0376f8811dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.284210:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8b600/0x392ae0376f8811dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.285035:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2002:x1830881273271808:12345-192.168.202.8@tcp:3:dd.0 Request processed in 12421us (13367us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065158.285045:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13949 00010000:00010000:2.0:1746065158.286851:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800726f1600/0x392ae0376f8811d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11444223] (req 10485760->11444223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.286865:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800726f1600/0x392ae0376f8811d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11444223] (req 10485760->11444223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.286871:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800726f1600/0x392ae0376f8811d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11444223] (req 10485760->11444223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.286877:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800726f1600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065158.286880:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800726f1600/0x392ae0376f8811d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11444223] (req 10485760->11444223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.286886:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800726f1600/0x392ae0376f8811d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11444223] (req 10485760->11444223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.286900:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800726f1600/0x392ae0376f8811d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11444223] (req 10485760->11444223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.286905:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800726f1600/0x392ae0376f8811d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11444223] (req 10485760->11444223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.286985:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273271680:12345-192.168.202.8@tcp:3:dd.0 Request processed in 14745us (15401us total) trans 0 rc 958464/958464 00000100:00100000:2.0:1746065158.286993:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13948 00000100:00100000:1.0:1746065158.293760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.293890:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273272064 00000100:00100000:2.0:1746065158.293898:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273272064 00000100:00100000:2.0:1746065158.293960:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13950 00000100:00100000:2.0:1746065158.293967:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273272064:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:2.0:1746065158.294007:0:27166:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 20889600, mtime: 0x6812d705, atime: 0x0, ctime: 0x6812d705, blocks: 0x9f60 00010000:00010000:2.0:1746065158.294014:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800726f1e00/0x392ae0376f8811e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.294025:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.294027:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.294030:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800726f1e00/0x392ae0376f8811e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20889600->22978559] (req 20889600->22978559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.294041:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800726f1e00/0x392ae0376f8811e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20889600->22978559] (req 20889600->22978559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746065158.316481:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970757 is committed 00002000:00010000:2.0:1746065158.316623:0:27166:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 20889600 -> 22978560 00002000:00010000:2.0:1746065158.316628:0:27166:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 40800 -> 44880 00010000:00010000:2.0:1746065158.316640:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800726f1e00/0x392ae0376f8811e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20889600->22978559] (req 20889600->22978559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.316650:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800726f1e00/0x392ae0376f8811e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20889600->22978559] (req 20889600->22978559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.316657:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800726f1e00/0x392ae0376f8811e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20889600->22978559] (req 20889600->22978559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.316664:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800726f1e00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065158.316668:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800726f1e00/0x392ae0376f8811e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20889600->22978559] (req 20889600->22978559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.316674:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800726f1e00/0x392ae0376f8811e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20889600->22978559] (req 20889600->22978559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.316690:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800726f1e00/0x392ae0376f8811e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20889600->22978559] (req 20889600->22978559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.316695:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800726f1e00/0x392ae0376f8811e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20889600->22978559] (req 20889600->22978559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.316895:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273272064:12345-192.168.202.8@tcp:4:dd.0 Request processed in 22924us (23139us total) trans 4294970757 rc 0/0 00000100:00100000:2.0:1746065158.316905:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13950 00000100:00100000:0.0:1746065158.323452:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.323640:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273272320 00000100:00100000:2.0:1746065158.323647:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273272320 00000100:00100000:0.0:1746065158.324391:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.324970:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273272704 00000100:00100000:2.0:1746065158.324974:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273272704 00000100:00100000:0.0:1746065158.324976:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.324999:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273272832 00000100:00100000:2.0:1746065158.325001:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273272832 00000100:00100000:0.0:1746065158.325008:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13951 00000100:00100000:0.0:1746065158.325021:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273272320:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065158.325054:0:28841:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f8811ea lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.325068:0:28841:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.325070:0:28841:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065158.325074:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13952 00010000:00010000:0.0:1746065158.325074:0:28841:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f8811ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11444224->11534335] (req 11444224->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.325091:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2003:x1830881273272704:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065158.325102:0:28841:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f8811ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11444224->11534335] (req 11444224->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.325107:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f88f400/0x392ae0376f8811f1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.325114:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.325115:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.325118:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f88f400/0x392ae0376f8811f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.325126:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f88f400/0x392ae0376f8811f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065158.325231:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13953 00000100:00100000:0.0:1746065158.325237:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2003:x1830881273272832:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065158.325248:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8811f8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.325255:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.325256:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.325259:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8811f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [11534336->12484607] (req 11534336->12484607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.325265:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8811f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [11534336->12484607] (req 11534336->12484607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.326871:0:28841:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f8811ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [11444224->11534335] (req 11444224->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.326882:0:28841:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f8811ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [11444224->11534335] (req 11444224->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.326889:0:28841:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f8811ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [11444224->11534335] (req 11444224->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.326894:0:28841:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f846800 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065158.326898:0:28841:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f8811ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [11444224->11534335] (req 11444224->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.326904:0:28841:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f8811ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [11444224->11534335] (req 11444224->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.326917:0:28841:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f8811ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [11444224->11534335] (req 11444224->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.326921:0:28841:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f846800/0x392ae0376f8811ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [11444224->11534335] (req 11444224->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065158.326978:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2003:x1830881273272320:12345-192.168.202.8@tcp:3:dd.0 Request processed in 1961us (3532us total) trans 0 rc 90112/90112 00000100:00100000:1.0:1746065158.326984:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13951 00010000:00010000:3.0:1746065158.339747:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8811f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12484607] (req 11534336->12484607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.339761:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8811f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12484607] (req 11534336->12484607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.339777:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8811f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12484607] (req 11534336->12484607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.339783:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f847400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065158.339787:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8811f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12484607] (req 11534336->12484607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.339793:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8811f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12484607] (req 11534336->12484607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.339808:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8811f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12484607] (req 11534336->12484607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.339814:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8811f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12484607] (req 11534336->12484607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.342629:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273272832:12345-192.168.202.8@tcp:3:dd.0 Request processed in 17380us (17642us total) trans 0 rc 950272/950272 00000100:00100000:3.0:1746065158.342641:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13953 00010000:00010000:0.0:1746065158.342675:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f88f400/0x392ae0376f8811f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.342686:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f88f400/0x392ae0376f8811f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.342694:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f88f400/0x392ae0376f8811f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.342700:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f88f400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065158.342703:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f88f400/0x392ae0376f8811f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.342710:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f88f400/0x392ae0376f8811f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.343233:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f88f400/0x392ae0376f8811f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.343240:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f88f400/0x392ae0376f8811f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065158.343445:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2003:x1830881273272704:12345-192.168.202.8@tcp:3:dd.0 Request processed in 18363us (19053us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065158.343452:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13952 00000100:00100000:0.0:1746065158.348136:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.348214:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273273088 00000100:00100000:1.0:1746065158.348222:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273273088 00000100:00100000:1.0:1746065158.349339:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13954 00000100:00100000:1.0:1746065158.349349:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273273088:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1746065158.349388:0:27166:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 22978560, mtime: 0x6812d705, atime: 0x0, ctime: 0x6812d705, blocks: 0xaf50 00010000:00010000:1.0:1746065158.349396:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f8811ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.349407:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.349409:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.349414:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f8811ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [22978560->25067519] (req 22978560->25067519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.349425:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f8811ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [22978560->25067519] (req 22978560->25067519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746065158.380495:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970758 is committed 00002000:00010000:1.0:1746065158.380849:0:27166:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 22978560 -> 25067520 00002000:00010000:1.0:1746065158.380853:0:27166:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 44880 -> 48960 00010000:00010000:1.0:1746065158.380864:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f8811ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [22978560->25067519] (req 22978560->25067519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.380872:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f8811ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [22978560->25067519] (req 22978560->25067519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.380879:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f8811ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [22978560->25067519] (req 22978560->25067519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.380884:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b20400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065158.380887:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f8811ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [22978560->25067519] (req 22978560->25067519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.380893:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f8811ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [22978560->25067519] (req 22978560->25067519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.380906:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f8811ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [22978560->25067519] (req 22978560->25067519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.380911:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f8811ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [22978560->25067519] (req 22978560->25067519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065158.380998:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2002:x1830881273273088:12345-192.168.202.8@tcp:4:dd.0 Request processed in 31648us (32865us total) trans 4294970758 rc 0/0 00000100:00100000:1.0:1746065158.381005:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13954 00000100:00100000:0.0:1746065158.386964:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.387017:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.387119:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273273344 00000100:00100000:1.0:1746065158.387126:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273273344 00000100:00100000:1.0:1746065158.387174:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273273600 00000100:00100000:1.0:1746065158.387176:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273273600 00000100:00100000:1.0:1746065158.387205:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13955 00000100:00100000:1.0:1746065158.387213:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273273344:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1746065158.387241:0:27161:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f881206 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.387252:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.387254:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065158.387258:0:27161:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f881206 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.387268:0:27161:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f881206 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.387308:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13956 00000100:00100000:3.0:1746065158.387317:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2003:x1830881273273600:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065158.387335:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88120d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.387344:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.387345:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.387348:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88120d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.387356:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88120d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.399933:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88120d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.399947:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88120d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.399954:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88120d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.399959:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11e00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065158.399962:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88120d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.399972:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88120d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.399988:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88120d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.399993:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x392ae0376f88120d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.400069:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2003:x1830881273273600:12345-192.168.202.8@tcp:3:dd.0 Request processed in 12749us (13046us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065158.400077:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13956 00010000:00010000:1.0:1746065158.400878:0:27161:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f881206 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.400887:0:27161:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f881206 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.400892:0:27161:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f881206 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.400898:0:27161:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b20400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065158.400900:0:27161:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f881206 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.400906:0:27161:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f881206 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.400916:0:27161:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f881206 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.400922:0:27161:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b20400/0x392ae0376f881206 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065158.400966:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013017ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2003:x1830881273273344:12345-192.168.202.8@tcp:3:dd.0 Request processed in 13753us (14008us total) trans 0 rc 98304/98304 00000100:00100000:1.0:1746065158.400972:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13955 00000100:00100000:0.0:1746065158.404683:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.404836:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273273728 00000100:00100000:2.0:1746065158.404844:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273273728 00000100:00100000:2.0:1746065158.404950:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30874 00000100:00100000:2.0:1746065158.404959:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:3813:x1830881273273728:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065158.404974:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065158.404988:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f881214 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6cae expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065158.405005:0:9560:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 25067520, mtime: 0x6812d705, atime: 0x0, ctime: 0x6812d705, blocks: 0xbf40 00010000:00010000:2.0:1746065158.405023:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.405025:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.405031:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f881214 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cae expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.405043:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f881214 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cae expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.405051:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f88f200, rc 0) 00000100:00100000:2.0:1746065158.406420:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:3813:x1830881273273728:12345-192.168.202.8@tcp:101:dd.0 Request processed in 1456us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065158.406427:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30874 00000100:00100000:0.0:1746065158.418704:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.418812:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273273856 00000100:00100000:1.0:1746065158.418821:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273273856 00002000:00100000:1.0:1746065158.418858:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x1b:0x0] (25067520->26214399) req@ffff88009d6c8000 x1830881273273856/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.418867:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8000 with x1830881273273856 ext(25067520->26214399) 00002000:00010000:1.0:1746065158.418872:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d6c8000 00000100:00100000:1.0:1746065158.418906:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13957 00000100:00100000:1.0:1746065158.418913:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273273856:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:1.0:1746065158.428778:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273273856:12345-192.168.202.8@tcp:4:dd.0 Request processed in 9846us (10062us total) trans 4294970759 rc 0/0 00000100:00100000:1.0:1746065158.428790:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13957 00002000:00100000:1.0:1746065158.428800:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x1b:0x0] (25067520->26214399) req@ffff88009d6c8000 x1830881273273856/t4294970759(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/448 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.428808:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8000 with x1830881273273856 ext(25067520->26214399) 00002000:00010000:1.0:1746065158.428813:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d6c8000 00000100:00100000:0.0:1746065158.432129:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.432205:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273273984 00000100:00100000:1.0:1746065158.432212:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273273984 00000100:00100000:1.0:1746065158.432267:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36576 00000100:00100000:1.0:1746065158.432274:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3813:x1830881273273984:12345-192.168.202.8@tcp:44:dd.0 00000100:00100000:1.0:1746065158.432364:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3813:x1830881273273984:12345-192.168.202.8@tcp:44:dd.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065158.432370:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36576 00000100:00080000:2.0:1746065158.432504:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065158.433884:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.433960:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273274112 00000100:00100000:2.0:1746065158.433966:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273274112 00000100:00100000:2.0:1746065158.434007:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30875 00000100:00100000:2.0:1746065158.434014:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273274112:12345-192.168.202.8@tcp:16:dd.0 00000001:00080000:0.0:1746065158.435317:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970759 is committed 00000100:00100000:2.0:1746065158.435932:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273274112:12345-192.168.202.8@tcp:16:dd.0 Request processed in 1914us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065158.435940:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30875 00000100:00100000:0.0:1746065158.440223:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.440708:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273274368 00000100:00100000:3.0:1746065158.440716:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273274368 00000100:00100000:3.0:1746065158.440773:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 205 00000100:00100000:3.0:1746065158.440780:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3813:x1830881273274368:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:3.0:1746065158.441267:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:3813:x1830881273274368:12345-192.168.202.8@tcp:35:dd.0 Request processed in 486us (1051us total) trans 4294983623 rc 0/0 00000100:00100000:3.0:1746065158.441275:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 205 00000100:00100000:0.0:1746065158.443150:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.443225:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273274624 00000100:00100000:3.0:1746065158.443232:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273274624 00000100:00100000:3.0:1746065158.443352:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 206 00000100:00100000:3.0:1746065158.443358:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:3813:x1830881273274624:12345-192.168.202.8@tcp:35:dd.0 00000001:00080000:3.0:1746065158.443481:0:7214:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294983624 00000100:00100000:3.0:1746065158.443723:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:3813:x1830881273274624:12345-192.168.202.8@tcp:35:dd.0 Request processed in 364us (575us total) trans 4294983625 rc 0/0 00000100:00100000:3.0:1746065158.443729:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 206 00000020:00080000:3.0:1746065158.443732:0:7214:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065158.460924:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.461670:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273274752 00000100:00100000:2.0:1746065158.461678:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273274752 00000100:00100000:2.0:1746065158.462062:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36577 00000100:00100000:2.0:1746065158.462070:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:3816:x1830881273274752:12345-192.168.202.8@tcp:101:checkstat.0 00010000:00010000:2.0:1746065158.462104:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065158.462117:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f88121b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6cb5 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.462163:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881222 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.462174:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881222 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.462183:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881222 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:2.0:1746065158.462218:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1746065158.462221:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065158.462235:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881222 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.462252:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f88121b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cb5 expref: 21 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.463034:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881222 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cb5 expref: 20 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.463046:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065158.463048:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065158.463051:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f88f400, rc 0) 00000100:00100000:2.0:1746065158.463133:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:3816:x1830881273274752:12345-192.168.202.8@tcp:101:checkstat.0 Request processed in 1064us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065158.463138:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36577 00000100:00100000:1.0:1746065158.465239:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.465324:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273274880 00000100:00100000:2.0:1746065158.465331:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273274880 00000100:00100000:2.0:1746065158.465374:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36578 00000100:00100000:2.0:1746065158.465381:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:3816:x1830881273274880:12345-192.168.202.8@tcp:101:checkstat.0 00010000:00010000:2.0:1746065158.465395:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065158.465410:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1e00/0x392ae0376f881229 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6cbc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.465451:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465460:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465468:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465479:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f881237 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465484:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f881237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465488:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f881237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465545:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f88123e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465552:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f88123e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465557:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f88123e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:2.0:1746065158.465585:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x49:0x0]: returning size 26214400 00000004:00200000:2.0:1746065158.465589:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065158.465599:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f88123e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465607:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f88123e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465614:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465619:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465623:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465628:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465633:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800726f1600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065158.465636:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465641:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465650:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065158.465652:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065158.465655:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465659:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1600/0x392ae0376f881230 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465668:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f881237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465673:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f881237 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465677:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f881237 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465681:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a09fa000 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065158.465683:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f881237 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465687:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f881237 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465692:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff880072c20f00) 00010000:00010000:2.0:1746065158.465694:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065158.465696:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f881237 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465700:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f881237 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.465719:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800726f1e00/0x392ae0376f881229 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cbc expref: 22 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.465728:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f88123e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cbc expref: 21 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.465733:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:2.0:1746065158.465735:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065158.465736:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09fb200, rc 0) 00000100:00100000:2.0:1746065158.465790:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:3816:x1830881273274880:12345-192.168.202.8@tcp:101:checkstat.0 Request processed in 409us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065158.465796:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36578 00000100:00100000:0.0:1746065158.467792:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.468322:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.468759:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273275008 00000100:00100000:1.0:1746065158.468775:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273275008 00000100:00100000:1.0:1746065158.468870:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273275136 00000100:00100000:1.0:1746065158.468873:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273275136 00000100:00100000:2.0:1746065158.468915:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30876 00000100:00100000:2.0:1746065158.468924:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273275008:12345-192.168.202.8@tcp:101:checkstat.0 00010000:00010000:2.0:1746065158.468938:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065158.468950:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881245 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6cc3 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065158.468992:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aa40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267830656:192.168.202.8@tcp:106: 00000100:00100000:2.0:1746065158.469061:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065158.469431:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30877 00000100:00100000:1.0:1746065158.469438:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881273275136:12345-192.168.202.8@tcp:101:checkstat.0 00010000:00010000:1.0:1746065158.469444:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065158.469453:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0a17a00/0x392ae0376f88124c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6cca expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065158.469477:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f6ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267830784:192.168.202.8@tcp:106: 00000100:00100000:1.0:1746065158.469502:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f805b40 going to sleep for 11 seconds 00002000:00010000:2.0:1746065158.472944:0:9560:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000401:0x1a:0x0] updating lvb size: 0 -> 13631488 00002000:00010000:2.0:1746065158.472949:0:9560:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x1a:0x0] updating lvb mtime: 0 -> 1746065157 00002000:00010000:2.0:1746065158.472951:0:9560:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x1a:0x0] updating lvb atime: 0 -> 1746065156 00002000:00010000:2.0:1746065158.472953:0:9560:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x1a:0x0] updating lvb ctime: 0 -> 1746065157 00002000:00010000:2.0:1746065158.472954:0:9560:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x280000401:0x1a:0x0] updating lvb blocks: 0 -> 24576 00000100:00100000:2.0:1746065158.472972:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aa40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267830656:192.168.202.8@tcp:106: 00010000:00010000:2.0:1746065158.472996:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881245 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cc3 expref: 8 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065158.473013:0:9560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881245 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cc3 expref: 8 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065158.473034:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09fb000, rc 0) 00000100:00100000:2.0:1746065158.473100:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273275008:12345-192.168.202.8@tcp:101:checkstat.0 Request processed in 4157us (5294us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065158.473108:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30876 00002000:00010000:1.0:1746065158.473346:0:9558:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x2c0000401:0x1b:0x0] updating lvb size: 0 -> 12582912 00002000:00010000:1.0:1746065158.473348:0:9558:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x1b:0x0] updating lvb mtime: 0 -> 1746065157 00002000:00010000:1.0:1746065158.473350:0:9558:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x1b:0x0] updating lvb atime: 0 -> 1746065156 00002000:00010000:1.0:1746065158.473351:0:9558:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x1b:0x0] updating lvb ctime: 0 -> 1746065157 00002000:00010000:1.0:1746065158.473352:0:9558:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x2c0000401:0x1b:0x0] updating lvb blocks: 0 -> 24576 00000100:00100000:1.0:1746065158.473362:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f6ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267830784:192.168.202.8@tcp:106: 00010000:00010000:1.0:1746065158.473375:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a17a00/0x392ae0376f88124c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cca expref: 16 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065158.473384:0:9558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a17a00/0x392ae0376f88124c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cca expref: 16 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065158.473403:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a17a00, rc 0) 00000100:00100000:1.0:1746065158.473423:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881273275136:12345-192.168.202.8@tcp:101:checkstat.0 Request processed in 3986us (5102us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065158.473428:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30877 00000100:00100000:0.0:1746065158.479691:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.479970:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273275264 00000100:00100000:1.0:1746065158.479978:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273275264 00000100:00100000:1.0:1746065158.480575:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36579 00000100:00100000:1.0:1746065158.480584:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+18:3817:x1830881273275264:12345-192.168.202.8@tcp:101:checkstat.0 00010000:00010000:1.0:1746065158.480603:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065158.480617:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17e00/0x392ae0376f881253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6cd1 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.480665:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065158.480676:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065158.480685:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:1.0:1746065158.480721:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1746065158.480723:0:7213:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065158.480737:0:7213:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065158.480754:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17e00/0x392ae0376f881253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd1 expref: 20 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.480794:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd1 expref: 19 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065158.480800:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065158.480803:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065158.480806:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a17a00, rc 0) 00000100:00100000:1.0:1746065158.480842:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+19:3817:x1830881273275264:12345-192.168.202.8@tcp:101:checkstat.0 Request processed in 260us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065158.480847:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36579 00000100:00100000:0.0:1746065158.492246:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.492477:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273275520 00000100:00100000:2.0:1746065158.492485:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273275520 00000100:00100000:2.0:1746065158.492532:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36580 00000100:00100000:2.0:1746065158.492539:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+21:3818:x1830881273275520:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:2.0:1746065158.492555:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065158.492569:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f881261 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6cd8 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.492642:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa800/0x392ae0376f881268 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.492653:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa800/0x392ae0376f881268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x47:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.492661:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa800/0x392ae0376f881268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x47:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:2.0:1746065158.492669:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x47:0x0]: returning size 26214400 00010000:00010000:2.0:1746065158.492742:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f881261 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd8 expref: 24 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.492796:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa800/0x392ae0376f881268 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x47:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd8 expref: 23 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.492802:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:2.0:1746065158.492805:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065158.492807:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09fa800, rc 0) 00000100:00100000:2.0:1746065158.492853:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:3818:x1830881273275520:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 313us (612us total) trans 4294983626 rc 0/0 00000100:00100000:2.0:1746065158.492858:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36580 00000100:00100000:0.0:1746065158.494400:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.494487:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273275776 00000100:00100000:2.0:1746065158.494492:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273275776 00000100:00100000:2.0:1746065158.494531:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36581 00000100:00100000:2.0:1746065158.494537:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:3818:x1830881273275776:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:2.0:1746065158.494551:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065158.494562:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb000/0x392ae0376f881276 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6cdf expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.494617:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f88127d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.494626:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f88127d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065158.494634:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f88127d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:2.0:1746065158.494640:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x49:0x0]: returning size 26214400 00010000:00010000:2.0:1746065158.494696:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb000/0x392ae0376f881276 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cdf expref: 26 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.494707:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f88127d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cdf expref: 25 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.494713:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:2.0:1746065158.494716:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065158.494718:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09fa000, rc 0) 00000100:00100000:2.0:1746065158.494744:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:3818:x1830881273275776:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 207us (347us total) trans 4294983627 rc 0/0 00000100:00100000:2.0:1746065158.494749:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36581 00000100:00100000:1.0:1746065158.498405:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.498438:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.498471:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273275904 00000100:00100000:1.0:1746065158.498471:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.498478:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273275904 00000100:00100000:3.0:1746065158.498504:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273276032 00000100:00100000:3.0:1746065158.498507:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273276032 00000100:00100000:0.0:1746065158.498520:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273276160 00000100:00100000:0.0:1746065158.498522:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273276160 00000100:00100000:3.0:1746065158.498545:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30878 00000100:00100000:0.0:1746065158.498549:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30879 00000100:00100000:3.0:1746065158.498551:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273276032:12345-192.168.202.8@tcp:101:cmp.0 00000100:00100000:0.0:1746065158.498553:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881273276160:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:3.0:1746065158.498564:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065158.498564:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065158.498576:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f881292 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ce6 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.498576:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f88128b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ced expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.498613:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130690000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267831040:192.168.202.8@tcp:106: 00000100:00100000:0.0:1746065158.498613:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d6cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267830912:192.168.202.8@tcp:106: 00000100:00100000:3.0:1746065158.498885:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb84cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065158.498885:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065158.498937:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 511 00000100:00100000:2.0:1746065158.498943:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:2003:x1830881273275904:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065158.498955:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065158.498971:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fa000/0x392ae0376f88127d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cdf expref: 25 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.498982:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:2.0:1746065158.498985:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065158.499002:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:2003:x1830881273275904:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 60us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065158.499007:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 511 00000100:00100000:2.0:1746065158.500104:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d6cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9558:1830881267830912:192.168.202.8@tcp:106: 00010000:00010000:2.0:1746065158.500123:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f88128b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ced expref: 16 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065158.500136:0:9558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072f37200/0x392ae0376f88128b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ced expref: 16 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065158.500144:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072f37200, rc 0) 00000100:00100000:2.0:1746065158.500178:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881273276160:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 1624us (1706us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065158.500184:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30879 00000100:00100000:3.0:1746065158.500306:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130690000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267831040:192.168.202.8@tcp:106: 00010000:00010000:3.0:1746065158.500320:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f881292 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ce6 expref: 8 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065158.500328:0:9560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x392ae0376f881292 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ce6 expref: 8 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065158.500338:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:3.0:1746065158.500354:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273276032:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 1803us (1915us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065158.500359:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30878 00000100:00100000:1.0:1746065158.518649:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.518680:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273276416 00000100:00100000:1.0:1746065158.518687:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273276416 00002000:00100000:1.0:1746065158.518721:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1a:0x0] (0->2097151) req@ffff88012f6aa300 x1830881273276416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.519213:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6aa300 with x1830881273276416 ext(0->2097151) 00002000:00010000:1.0:1746065158.519218:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f6aa300 00000100:00100000:1.0:1746065158.519246:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13958 00000100:00100000:1.0:1746065158.519253:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881273276416:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.520844:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.521181:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273276672 00000100:00100000:3.0:1746065158.521188:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273276672 00002000:00100000:3.0:1746065158.521216:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x19:0x0] (0->2097151) req@ffff88009d6c9180 x1830881273276672/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.521224:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9180 with x1830881273276672 ext(0->2097151) 00002000:00010000:3.0:1746065158.521228:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d6c9180 00000100:00100000:3.0:1746065158.521243:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13959 00000100:00100000:3.0:1746065158.521248:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273276672:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065158.539271:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:2005:x1830881273276416:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 20010us (20620us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065158.539284:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13958 00002000:00100000:2.0:1746065158.539293:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1a:0x0] (0->2097151) req@ffff88012f6aa300 x1830881273276416/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.539302:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6aa300 with x1830881273276416 ext(0->2097151) 00002000:00010000:2.0:1746065158.539306:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f6aa300 00000100:00100000:3.0:1746065158.543269:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273276672:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 22011us (22421us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065158.543280:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13959 00002000:00100000:3.0:1746065158.543290:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x19:0x0] (0->2097151) req@ffff88009d6c9180 x1830881273276672/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.543298:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c9180 with x1830881273276672 ext(0->2097151) 00002000:00010000:3.0:1746065158.543302:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d6c9180 00000100:00100000:2.0:1746065158.554789:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.556027:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273276800 00000100:00100000:3.0:1746065158.556037:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273276800 00000100:00100000:3.0:1746065158.556611:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30880 00000100:00100000:3.0:1746065158.556619:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:3818:x1830881273276800:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:3.0:1746065158.556635:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065158.556648:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6cf4 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.556672:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.556678:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065158.556680:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065158.556683:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.556712:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 8 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.556722:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 8 pid: 9558 timeout: 857 lvb_type: 0 00000100:00100000:3.0:1746065158.556733:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130690000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267831168:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065158.557425:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb84cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065158.560523:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130690000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9560:1830881267831168:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065158.560546:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.560561:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:3.0:1746065158.560913:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:3818:x1830881273276800:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 4293us (6128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065158.560921:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30880 00000100:00100000:1.0:1746065158.561834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.561916:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273276928 00000100:00100000:3.0:1746065158.561922:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273276928 00002000:00100000:3.0:1746065158.561952:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (12582912->13631487) req@ffff88012f6a8380 x1830881273276928/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.561960:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8380 with x1830881273276928 ext(12582912->13631487) 00010000:00010000:3.0:1746065158.561967:0:20722:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 9 pid: 9558 timeout: 857 lvb_type: 0 00010000:00010000:3.0:1746065158.561983:0:20722:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 9 pid: 9558 timeout: 857 lvb_type: 0 00002000:00010000:3.0:1746065158.561988:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f6a8380 00000100:00100000:3.0:1746065158.562110:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3162 00000100:00100000:3.0:1746065158.562117:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2004:x1830881273276928:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:3.0:1746065158.568885:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273276928:12345-192.168.202.8@tcp:4:dd.0 Request processed in 6760us (7044us total) trans 4294970760 rc 0/0 00000100:00100000:3.0:1746065158.568896:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3162 00002000:00100000:3.0:1746065158.568908:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (12582912->13631487) req@ffff88012f6a8380 x1830881273276928/t4294970760(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:74/0 lens 488/448 e 0 to 0 dl 1746065169 ref 1 fl Complete:H/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.568916:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8380 with x1830881273276928 ext(12582912->13631487) 00010000:00010000:3.0:1746065158.568925:0:20722:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 11 pid: 9558 timeout: 857 lvb_type: 0 00010000:00010000:3.0:1746065158.568937:0:20722:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 11 pid: 9558 timeout: 857 lvb_type: 0 00002000:00010000:3.0:1746065158.568943:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f6a8380 00000100:00100000:2.0:1746065158.595392:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.595483:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273277056 00000100:00100000:3.0:1746065158.595490:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273277056 00010000:00010000:3.0:1746065158.595520:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 11 pid: 9558 timeout: 857 lvb_type: 0 00000100:00100000:3.0:1746065158.595563:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14840 00000100:00100000:3.0:1746065158.595571:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2005:x1830881273277056:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065158.595583:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065158.595597:0:7198:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1a:0x0] updating lvb blocks from disk: 24576 -> 26624 00010000:00010000:3.0:1746065158.595602:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 11 pid: 9558 timeout: 857 lvb_type: 0 00010000:00010000:3.0:1746065158.595613:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 11 pid: 9558 timeout: 857 lvb_type: 0 00000001:00080000:0.0:1746065158.595625:0:8350:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967404 is committed 00010000:00010000:3.0:1746065158.595633:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f85c000/0x392ae0376f8810ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca0 expref: 11 pid: 9558 timeout: 857 lvb_type: 0 00000001:00080000:0.0:1746065158.595641:0:8350:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967403 is committed 00010000:00010000:3.0:1746065158.595663:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.595666:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.595672:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.595679:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.595705:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.595715:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130690000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267831296:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065158.595797:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb84cc0 going to sleep for 11 seconds 00000001:00080000:0.0:1746065158.595811:0:8350:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967401 is committed 00010000:00010000:2.0:1746065158.595858:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065158.596281:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065158.596286:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065158.596290:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ddfde00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065158.596294:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065158.596300:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065158.596313:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x2ce3da1 (ffff880072fba600) 00010000:00010000:2.0:1746065158.596316:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065158.596319:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065158.596322:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ddfde00/0x392ae0376f880e24 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0xa:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7212 initiator: MDT1 00010000:00010000:2.0:1746065158.596342:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT1 00010000:00010000:2.0:1746065158.596346:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT1 00010000:00010000:2.0:1746065158.596350:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT1 00010000:00010000:2.0:1746065158.596354:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b6ca00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065158.596356:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT1 00010000:00010000:2.0:1746065158.596360:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT1 00010000:00010000:2.0:1746065158.598375:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff880072fbaf00) 00010000:00010000:2.0:1746065158.598379:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065158.598384:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT1 00010000:00010000:2.0:1746065158.598399:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880072b6ca00/0x392ae0376f880eda lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT1 00000100:00100000:3.0:1746065158.598556:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130690000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267831296:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065158.598570:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065158.598618:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+10:2005:x1830881273277056:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 3047us (3232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065158.598627:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14840 00000100:00100000:1.0:1746065158.600487:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.600539:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273277312 00000100:00100000:3.0:1746065158.600546:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273277312 00002000:00100000:3.0:1746065158.600577:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (0->1048575) req@ffff88012f6a8000 x1830881273277312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.600584:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8000 with x1830881273277312 ext(0->1048575) 00002000:00010000:3.0:1746065158.600588:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f6a8000 00000100:00100000:3.0:1746065158.600616:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13960 00000100:00100000:3.0:1746065158.600622:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273277312:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065158.606286:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273277312:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 5657us (5795us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065158.606297:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13960 00002000:00100000:1.0:1746065158.606306:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (0->1048575) req@ffff88012f6a8000 x1830881273277312/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.606315:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8000 with x1830881273277312 ext(0->1048575) 00002000:00010000:1.0:1746065158.606319:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f6a8000 00000100:00100000:0.0:1746065158.611502:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.611746:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273277440 00000100:00100000:3.0:1746065158.611754:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273277440 00000100:00100000:3.0:1746065158.611813:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30881 00000100:00100000:3.0:1746065158.611820:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+15:3818:x1830881273277440:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:3.0:1746065158.611834:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065158.611848:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6cfb expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.611873:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69a00/0x392ae0376f881103 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca7 expref: 12 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.611880:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065158.611882:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065158.611885:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 16 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.614771:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb69a00/0x392ae0376f881103 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca7 expref: 12 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.614789:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb69a00/0x392ae0376f881103 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca7 expref: 12 pid: 9560 timeout: 857 lvb_type: 0 00000100:00100000:3.0:1746065158.614802:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130690000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267831424:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065158.614935:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb84cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065158.616395:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130690000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267831424:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065158.616415:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 16 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.616429:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10e00, rc 0) 00000100:00100000:3.0:1746065158.616453:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3818:x1830881273277440:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 4634us (4958us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065158.616460:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30881 00000100:00100000:2.0:1746065158.625681:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.625804:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273277568 00000100:00100000:3.0:1746065158.625811:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273277568 00010000:00010000:3.0:1746065158.625838:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb69a00/0x392ae0376f881103 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca7 expref: 13 pid: 9560 timeout: 857 lvb_type: 0 00000100:00100000:3.0:1746065158.625881:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14841 00000100:00100000:3.0:1746065158.625888:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2004:x1830881273277568:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065158.625899:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065158.625916:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb69a00/0x392ae0376f881103 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca7 expref: 13 pid: 9560 timeout: 857 lvb_type: 0 00010000:00010000:3.0:1746065158.625926:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb69a00/0x392ae0376f881103 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca7 expref: 13 pid: 9560 timeout: 857 lvb_type: 0 00010000:00010000:3.0:1746065158.625943:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb69a00/0x392ae0376f881103 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ca7 expref: 13 pid: 9560 timeout: 857 lvb_type: 0 00010000:00010000:3.0:1746065158.626048:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.626051:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065158.626056:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 15 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.626063:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 15 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065158.626123:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 15 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065158.626132:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130690000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267831552:192.168.202.8@tcp:105: 00000100:00100000:3.0:1746065158.626543:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb84cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065158.628244:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130690000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267831552:192.168.202.8@tcp:105: 00010000:00010000:3.0:1746065158.628258:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065158.628343:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2004:x1830881273277568:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2455us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065158.628351:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14841 00000100:00100000:1.0:1746065158.632228:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.632584:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.632758:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273277824 00000100:00100000:2.0:1746065158.632777:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273277824 00002000:00100000:2.0:1746065158.632816:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1b:0x0] (0->2097151) req@ffff88012f6a8a80 x1830881273277824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.632826:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8a80 with x1830881273277824 ext(0->2097151) 00002000:00010000:2.0:1746065158.632830:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f6a8a80 00000100:00100000:2.0:1746065158.632857:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273278080 00000100:00100000:2.0:1746065158.632860:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273278080 00002000:00100000:2.0:1746065158.632874:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (1048576->2097151) req@ffff88012f6a8e00 x1830881273278080/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.632881:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8e00 with x1830881273278080 ext(1048576->2097151) 00002000:00010000:2.0:1746065158.632884:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f6a8e00 00000100:00100000:2.0:1746065158.633443:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13961 00000100:00100000:2.0:1746065158.633451:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273277824:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065158.634021:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13962 00000100:00100000:3.0:1746065158.634029:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273278080:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065158.646316:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273278080:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 12279us (13723us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065158.646326:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13962 00002000:00100000:3.0:1746065158.646336:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x1a:0x0] (1048576->2097151) req@ffff88012f6a8e00 x1830881273278080/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.646344:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8e00 with x1830881273278080 ext(1048576->2097151) 00002000:00010000:3.0:1746065158.646349:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f6a8e00 00000100:00100000:0.0:1746065158.656228:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273277824:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 22769us (23997us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065158.656238:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13961 00002000:00100000:0.0:1746065158.656246:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1b:0x0] (0->2097151) req@ffff88012f6a8a80 x1830881273277824/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.656255:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f6a8a80 with x1830881273277824 ext(0->2097151) 00002000:00010000:0.0:1746065158.656260:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f6a8a80 00000100:00100000:2.0:1746065158.676392:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.676442:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.676506:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273278464 00000100:00100000:3.0:1746065158.676515:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273278464 00002000:00100000:3.0:1746065158.676552:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x19:0x0] (2097152->4194303) req@ffff88009f939500 x1830881273278464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.676561:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939500 with x1830881273278464 ext(2097152->4194303) 00002000:00010000:3.0:1746065158.676566:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f939500 00000100:00100000:0.0:1746065158.676568:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273278592 00000100:00100000:0.0:1746065158.676572:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273278592 00002000:00100000:0.0:1746065158.676589:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1a:0x0] (2097152->4194303) req@ffff88009f93a680 x1830881273278592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.676597:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93a680 with x1830881273278592 ext(2097152->4194303) 00002000:00010000:0.0:1746065158.676600:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93a680 00000100:00100000:3.0:1746065158.676601:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13963 00000100:00100000:3.0:1746065158.676609:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273278464:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.676614:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13964 00000100:00100000:0.0:1746065158.676618:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273278592:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065158.689687:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273278464:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 13071us (13294us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065158.689698:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13963 00002000:00100000:3.0:1746065158.689707:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x19:0x0] (2097152->4194303) req@ffff88009f939500 x1830881273278464/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.689716:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939500 with x1830881273278464 ext(2097152->4194303) 00002000:00010000:3.0:1746065158.689722:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f939500 00000100:00100000:1.0:1746065158.694045:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273278592:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 17418us (17595us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065158.694055:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13964 00002000:00100000:1.0:1746065158.694067:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1a:0x0] (2097152->4194303) req@ffff88009f93a680 x1830881273278592/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.694150:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93a680 with x1830881273278592 ext(2097152->4194303) 00002000:00010000:1.0:1746065158.694156:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93a680 00000100:00100000:2.0:1746065158.709263:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.709313:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.709584:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273278848 00000100:00100000:1.0:1746065158.709592:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273278848 00002000:00100000:1.0:1746065158.709631:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (2097152->4194303) req@ffff88009f939180 x1830881273278848/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.709641:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939180 with x1830881273278848 ext(2097152->4194303) 00002000:00010000:1.0:1746065158.709645:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f939180 00000100:00100000:1.0:1746065158.709752:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273279104 00000100:00100000:1.0:1746065158.709755:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273279104 00002000:00100000:1.0:1746065158.709778:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1b:0x0] (2097152->4194303) req@ffff88009f93b100 x1830881273279104/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.709785:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b100 with x1830881273279104 ext(2097152->4194303) 00002000:00010000:1.0:1746065158.709788:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93b100 00000100:00100000:1.0:1746065158.709808:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13965 00000100:00100000:1.0:1746065158.709815:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273278848:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.711020:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13966 00000100:00100000:0.0:1746065158.711031:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273279104:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.736831:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273279104:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 25797us (27511us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065158.736841:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13966 00002000:00100000:0.0:1746065158.736850:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1b:0x0] (2097152->4194303) req@ffff88009f93b100 x1830881273279104/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.736865:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f93b100 with x1830881273279104 ext(2097152->4194303) 00002000:00010000:0.0:1746065158.736869:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f93b100 00000100:00100000:1.0:1746065158.743459:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273278848:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 33637us (34196us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065158.743468:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13965 00002000:00100000:1.0:1746065158.743478:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x1a:0x0] (2097152->4194303) req@ffff88009f939180 x1830881273278848/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.743485:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939180 with x1830881273278848 ext(2097152->4194303) 00002000:00010000:1.0:1746065158.743490:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f939180 00000100:00100000:2.0:1746065158.777134:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.777172:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.777199:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273279488 00000100:00100000:1.0:1746065158.777207:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273279488 00000100:00100000:0.0:1746065158.777214:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273279616 00000100:00100000:0.0:1746065158.777218:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273279616 00002000:00100000:0.0:1746065158.777239:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x19:0x0] (4194304->6291455) req@ffff88009f938380 x1830881273279616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.777240:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1a:0x0] (4194304->6291455) req@ffff88009f939c00 x1830881273279488/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.777248:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881273279488 ext(4194304->6291455) 00002000:00100000:0.0:1746065158.777248:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938380 with x1830881273279616 ext(4194304->6291455) 00002000:00010000:1.0:1746065158.777252:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f939c00 00002000:00010000:0.0:1746065158.777252:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f938380 00000100:00100000:0.0:1746065158.777281:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13967 00000100:00100000:1.0:1746065158.777286:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13968 00000100:00100000:0.0:1746065158.777288:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273279616:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065158.777303:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273279488:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.798030:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273279616:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 20735us (20849us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065158.798040:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13967 00002000:00100000:0.0:1746065158.798050:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x19:0x0] (4194304->6291455) req@ffff88009f938380 x1830881273279616/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.798059:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938380 with x1830881273279616 ext(4194304->6291455) 00002000:00010000:0.0:1746065158.798064:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f938380 00000100:00100000:1.0:1746065158.803428:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273279488:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 26127us (26292us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065158.803438:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13968 00002000:00100000:1.0:1746065158.803447:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1a:0x0] (4194304->6291455) req@ffff88009f939c00 x1830881273279488/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.803456:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939c00 with x1830881273279488 ext(4194304->6291455) 00002000:00010000:1.0:1746065158.803461:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f939c00 00000100:00100000:3.0:1746065158.814157:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.814303:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273279872 00000100:00100000:1.0:1746065158.814311:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273279872 00002000:00100000:1.0:1746065158.814345:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1a:0x0] (6291456->7340031) req@ffff880130690000 x1830881273279872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.814353:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130690000 with x1830881273279872 ext(6291456->7340031) 00002000:00010000:1.0:1746065158.814358:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130690000 00000100:00100000:1.0:1746065158.815803:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13969 00000100:00100000:1.0:1746065158.815815:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273279872:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065158.817298:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.818879:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273280128 00000100:00100000:0.0:1746065158.818889:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273280128 00002000:00100000:0.0:1746065158.818926:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x19:0x0] (6291456->7340031) req@ffff880130693800 x1830881273280128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.818936:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130693800 with x1830881273280128 ext(6291456->7340031) 00002000:00010000:0.0:1746065158.818940:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130693800 00000100:00100000:0.0:1746065158.818958:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13970 00000100:00100000:0.0:1746065158.818964:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2003:x1830881273280128:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065158.819541:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.819559:0:24940:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273280384 00000100:00100000:3.0:1746065158.819562:0:24940:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273280384 00002000:00100000:3.0:1746065158.819579:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1a:0x0] (7340032->8388607) req@ffff880130692d80 x1830881273280384/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.819587:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130692d80 with x1830881273280384 ext(7340032->8388607) 00002000:00010000:3.0:1746065158.819590:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130692d80 00000100:00100000:3.0:1746065158.819602:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13971 00000100:00100000:3.0:1746065158.819607:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2002:x1830881273280384:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065158.820753:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.820780:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273280640 00000100:00100000:3.0:1746065158.820783:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273280640 00002000:00100000:3.0:1746065158.820801:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x19:0x0] (7340032->8388607) req@ffff880130690380 x1830881273280640/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.820807:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130690380 with x1830881273280640 ext(7340032->8388607) 00002000:00010000:3.0:1746065158.820810:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130690380 00000100:00100000:3.0:1746065158.820820:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13972 00000100:00100000:3.0:1746065158.820824:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2002:x1830881273280640:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065158.826724:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2003:x1830881273279872:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 10904us (12568us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065158.826734:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13969 00002000:00100000:1.0:1746065158.826743:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1a:0x0] (6291456->7340031) req@ffff880130690000 x1830881273279872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.826757:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130690000 with x1830881273279872 ext(6291456->7340031) 00002000:00010000:1.0:1746065158.826771:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130690000 00000100:00100000:2.0:1746065158.832355:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2003:x1830881273280128:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 13382us (15053us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065158.832369:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13970 00002000:00100000:2.0:1746065158.832378:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x19:0x0] (6291456->7340031) req@ffff880130693800 x1830881273280128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.832387:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130693800 with x1830881273280128 ext(6291456->7340031) 00002000:00010000:2.0:1746065158.832391:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130693800 00000100:00100000:3.0:1746065158.833209:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.833243:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.834331:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273280896 00000100:00100000:2.0:1746065158.834339:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273280896 00002000:00100000:2.0:1746065158.834367:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1a:0x0] (4194304->6291455) req@ffff880130693b80 x1830881273280896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.834375:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130693b80 with x1830881273280896 ext(4194304->6291455) 00002000:00010000:2.0:1746065158.834378:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130693b80 00000100:00100000:2.0:1746065158.834394:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273281152 00000100:00100000:2.0:1746065158.834396:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273281152 00002000:00100000:2.0:1746065158.834405:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1b:0x0] (4194304->6291455) req@ffff88007297a680 x1830881273281152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.834411:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297a680 with x1830881273281152 ext(4194304->6291455) 00002000:00010000:2.0:1746065158.834413:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007297a680 00000100:00100000:2.0:1746065158.834421:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13973 00000100:00100000:2.0:1746065158.834426:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273280896:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065158.834726:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13974 00000100:00100000:1.0:1746065158.834733:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273281152:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.842946:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2002:x1830881273280640:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 22113us (22188us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065158.842955:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13972 00002000:00100000:0.0:1746065158.842964:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x19:0x0] (7340032->8388607) req@ffff880130690380 x1830881273280640/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.842971:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130690380 with x1830881273280640 ext(7340032->8388607) 00002000:00010000:0.0:1746065158.842976:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130690380 00000100:00100000:2.0:1746065158.843232:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2002:x1830881273280384:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 23624us (23690us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065158.843238:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13971 00002000:00100000:2.0:1746065158.843242:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1a:0x0] (7340032->8388607) req@ffff880130692d80 x1830881273280384/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.843253:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130692d80 with x1830881273280384 ext(7340032->8388607) 00002000:00010000:2.0:1746065158.843256:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130692d80 00000100:00100000:1.0:1746065158.858472:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273281152:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 23733us (25221us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065158.858481:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13974 00002000:00100000:1.0:1746065158.858490:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1b:0x0] (4194304->6291455) req@ffff88007297a680 x1830881273281152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.858499:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007297a680 with x1830881273281152 ext(4194304->6291455) 00002000:00010000:1.0:1746065158.858504:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007297a680 00000100:00100000:2.0:1746065158.869257:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273280896:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 34823us (36043us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065158.869267:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13973 00002000:00100000:2.0:1746065158.869277:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1a:0x0] (4194304->6291455) req@ffff880130693b80 x1830881273280896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.869285:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130693b80 with x1830881273280896 ext(4194304->6291455) 00002000:00010000:2.0:1746065158.869289:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130693b80 00000100:00100000:0.0:1746065158.877227:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.877612:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273281408 00000100:00100000:2.0:1746065158.877619:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273281408 00002000:00100000:2.0:1746065158.877657:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1a:0x0] (6291456->7340031) req@ffff88009d6c8a80 x1830881273281408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.877903:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8a80 with x1830881273281408 ext(6291456->7340031) 00002000:00010000:2.0:1746065158.877908:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d6c8a80 00000100:00100000:2.0:1746065158.877976:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13975 00000100:00100000:2.0:1746065158.877982:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2003:x1830881273281408:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.884051:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.885619:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065158.885898:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273281792 00000100:00100000:1.0:1746065158.885906:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273281792 00002000:00100000:1.0:1746065158.885941:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x1a:0x0] (7340032->8388607) req@ffff88009d6cb100 x1830881273281792/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.885952:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb100 with x1830881273281792 ext(7340032->8388607) 00002000:00010000:1.0:1746065158.885956:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d6cb100 00000100:00100000:1.0:1746065158.885982:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13976 00000100:00100000:1.0:1746065158.885989:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2003:x1830881273281792:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.886826:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273281920 00000100:00100000:0.0:1746065158.886830:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273281920 00002000:00100000:0.0:1746065158.886850:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1b:0x0] (6291456->7340031) req@ffff88008b788a80 x1830881273281920/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.886858:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788a80 with x1830881273281920 ext(6291456->7340031) 00002000:00010000:0.0:1746065158.886861:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788a80 00000100:00100000:0.0:1746065158.886891:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13977 00000100:00100000:0.0:1746065158.886897:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273281920:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.887441:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.887457:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273282176 00000100:00100000:0.0:1746065158.887460:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273282176 00002000:00100000:0.0:1746065158.887475:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1b:0x0] (7340032->8388607) req@ffff88008b788700 x1830881273282176/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.887487:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788700 with x1830881273282176 ext(7340032->8388607) 00002000:00010000:0.0:1746065158.887490:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788700 00000100:00100000:0.0:1746065158.887502:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13978 00000100:00100000:0.0:1746065158.887506:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2002:x1830881273282176:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.888039:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2003:x1830881273281408:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 10056us (10818us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065158.888045:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13975 00002000:00100000:0.0:1746065158.888051:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1a:0x0] (6291456->7340031) req@ffff88009d6c8a80 x1830881273281408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.888057:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6c8a80 with x1830881273281408 ext(6291456->7340031) 00002000:00010000:0.0:1746065158.888061:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d6c8a80 00000100:00100000:1.0:1746065158.900071:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2003:x1830881273281792:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 14074us (16020us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065158.900105:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13976 00002000:00100000:1.0:1746065158.900117:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x1a:0x0] (7340032->8388607) req@ffff88009d6cb100 x1830881273281792/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.900126:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d6cb100 with x1830881273281792 ext(7340032->8388607) 00002000:00010000:1.0:1746065158.900132:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d6cb100 00000100:00100000:2.0:1746065158.901530:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2002:x1830881273281920:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 14628us (15909us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065158.901539:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13977 00002000:00100000:2.0:1746065158.901545:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1b:0x0] (6291456->7340031) req@ffff88008b788a80 x1830881273281920/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.901553:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788a80 with x1830881273281920 ext(6291456->7340031) 00002000:00010000:2.0:1746065158.901558:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788a80 00000100:00100000:2.0:1746065158.902405:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273282176:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 14894us (14961us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065158.902412:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13978 00002000:00100000:2.0:1746065158.902417:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1b:0x0] (7340032->8388607) req@ffff88008b788700 x1830881273282176/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.902428:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788700 with x1830881273282176 ext(7340032->8388607) 00002000:00010000:2.0:1746065158.902431:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788700 00000100:00100000:0.0:1746065158.921156:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.921203:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.922603:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273282560 00000100:00100000:2.0:1746065158.922613:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273282560 00002000:00100000:2.0:1746065158.922653:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x19:0x0] (8388608->10485759) req@ffff88008b789180 x1830881273282560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.922662:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789180 with x1830881273282560 ext(8388608->10485759) 00002000:00010000:2.0:1746065158.922666:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b789180 00000100:00100000:2.0:1746065158.922687:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273282688 00000100:00100000:2.0:1746065158.922690:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273282688 00002000:00100000:2.0:1746065158.922702:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1a:0x0] (8388608->10485759) req@ffff88008b789f80 x1830881273282688/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.922708:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789f80 with x1830881273282688 ext(8388608->10485759) 00002000:00010000:2.0:1746065158.922711:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789f80 00000100:00100000:2.0:1746065158.922729:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13979 00000100:00100000:2.0:1746065158.922735:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273282560:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.923566:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13980 00000100:00100000:0.0:1746065158.923573:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273282688:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065158.945984:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273282560:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 23241us (24826us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065158.945994:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13979 00002000:00100000:2.0:1746065158.946005:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x19:0x0] (8388608->10485759) req@ffff88008b789180 x1830881273282560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.946013:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789180 with x1830881273282560 ext(8388608->10485759) 00002000:00010000:2.0:1746065158.946018:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b789180 00000100:00100000:2.0:1746065158.954565:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273282688:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 30982us (33351us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065158.954574:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13980 00002000:00100000:2.0:1746065158.954584:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1a:0x0] (8388608->10485759) req@ffff88008b789f80 x1830881273282688/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.954592:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789f80 with x1830881273282688 ext(8388608->10485759) 00002000:00010000:2.0:1746065158.954597:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789f80 00000100:00100000:0.0:1746065158.960748:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.962123:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273282944 00000100:00100000:2.0:1746065158.962133:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273282944 00002000:00100000:2.0:1746065158.962181:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1a:0x0] (10485760->11534335) req@ffff88008b78a680 x1830881273282944/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.962190:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a680 with x1830881273282944 ext(10485760->11534335) 00002000:00010000:2.0:1746065158.962195:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78a680 00000100:00100000:2.0:1746065158.962217:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13981 00000100:00100000:2.0:1746065158.962224:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273282944:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065158.964022:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.964065:0:24940:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273283200 00000100:00100000:0.0:1746065158.964071:0:24940:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273283200 00002000:00100000:0.0:1746065158.964113:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x19:0x0] (10485760->11534335) req@ffff880079c37800 x1830881273283200/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.964121:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880079c37800 with x1830881273283200 ext(10485760->11534335) 00002000:00010000:0.0:1746065158.964125:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880079c37800 00000100:00100000:0.0:1746065158.964152:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13982 00000100:00100000:0.0:1746065158.964160:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273283200:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.965713:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065158.965805:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273283456 00000100:00100000:3.0:1746065158.965811:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273283456 00002000:00100000:3.0:1746065158.965841:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1a:0x0] (11534336->12582911) req@ffff88008b78ad80 x1830881273283456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.965854:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78ad80 with x1830881273283456 ext(11534336->12582911) 00002000:00010000:3.0:1746065158.965858:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78ad80 00000100:00100000:0.0:1746065158.966109:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.966139:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273283712 00000100:00100000:0.0:1746065158.966143:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273283712 00002000:00100000:0.0:1746065158.966159:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x19:0x0] (11534336->12582911) req@ffff88008b78bb80 x1830881273283712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.966166:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78bb80 with x1830881273283712 ext(11534336->12582911) 00002000:00010000:0.0:1746065158.966169:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b78bb80 00000100:00100000:3.0:1746065158.966232:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13983 00000100:00100000:3.0:1746065158.966241:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2004:x1830881273283456:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.966894:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13984 00000100:00100000:0.0:1746065158.966902:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881273283712:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.971194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.971267:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273283968 00000100:00100000:2.0:1746065158.971275:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273283968 00002000:00100000:2.0:1746065158.971313:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1a:0x0] (12582912->13631487) req@ffff88008b788380 x1830881273283968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.971323:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788380 with x1830881273283968 ext(12582912->13631487) 00002000:00010000:2.0:1746065158.971329:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788380 00000100:00100000:2.0:1746065158.971359:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13985 00000100:00100000:2.0:1746065158.971367:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273283968:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065158.972251:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273282944:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 10024us (11508us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065158.972259:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13981 00002000:00100000:3.0:1746065158.972266:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1a:0x0] (10485760->11534335) req@ffff88008b78a680 x1830881273282944/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065158.972273:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a680 with x1830881273282944 ext(10485760->11534335) 00002000:00010000:3.0:1746065158.972277:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78a680 00000100:00100000:0.0:1746065158.980921:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065158.980962:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065158.981120:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273284224 00000100:00100000:2.0:1746065158.981128:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273284224 00000100:00100000:1.0:1746065158.981149:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2005:x1830881273283200:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 16988us (17130us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065158.981157:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13982 00002000:00100000:2.0:1746065158.981162:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1a:0x0] (8388608->10485759) req@ffff88008b78a300 x1830881273284224/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.981163:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x19:0x0] (10485760->11534335) req@ffff880079c37800 x1830881273283200/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.981170:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a300 with x1830881273284224 ext(8388608->10485759) 00002000:00100000:1.0:1746065158.981170:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880079c37800 with x1830881273283200 ext(10485760->11534335) 00002000:00010000:1.0:1746065158.981174:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880079c37800 00002000:00010000:2.0:1746065158.981175:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b78a300 00000100:00100000:2.0:1746065158.981189:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273284480 00000100:00100000:2.0:1746065158.981191:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273284480 00000100:00100000:1.0:1746065158.981192:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13986 00000100:00100000:1.0:1746065158.981200:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273284224:12345-192.168.202.8@tcp:3:cmp.0 00002000:00100000:2.0:1746065158.981204:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1b:0x0] (8388608->10485759) req@ffff88008b789880 x1830881273284480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/0 e 0 to 0 dl 1746065169 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.981211:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789880 with x1830881273284480 ext(8388608->10485759) 00002000:00010000:2.0:1746065158.981214:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789880 00000100:00100000:2.0:1746065158.981238:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13987 00000100:00100000:2.0:1746065158.981244:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273284480:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065158.983229:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273283456:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 16982us (17512us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065158.983237:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13983 00002000:00100000:0.0:1746065158.983246:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1a:0x0] (11534336->12582911) req@ffff88008b78ad80 x1830881273283456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.983254:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78ad80 with x1830881273283456 ext(11534336->12582911) 00002000:00010000:0.0:1746065158.983258:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b78ad80 00000100:00100000:0.0:1746065158.983361:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881273283712:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 16459us (17251us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065158.983366:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13984 00002000:00100000:0.0:1746065158.983371:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x19:0x0] (11534336->12582911) req@ffff88008b78bb80 x1830881273283712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065158.983377:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78bb80 with x1830881273283712 ext(11534336->12582911) 00002000:00010000:0.0:1746065158.983379:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b78bb80 00000100:00100000:2.0:1746065158.986307:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2004:x1830881273283968:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 14931us (15113us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065158.986317:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13985 00002000:00100000:2.0:1746065158.986325:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1a:0x0] (12582912->13631487) req@ffff88008b788380 x1830881273283968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065158.986334:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788380 with x1830881273283968 ext(12582912->13631487) 00002000:00010000:2.0:1746065158.986339:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788380 00000100:00100000:1.0:1746065158.999168:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273284224:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 17961us (18247us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065158.999178:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13986 00002000:00100000:1.0:1746065158.999188:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x1a:0x0] (8388608->10485759) req@ffff88008b78a300 x1830881273284224/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065158.999197:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78a300 with x1830881273284224 ext(8388608->10485759) 00002000:00010000:1.0:1746065158.999202:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b78a300 00000100:00100000:2.0:1746065159.001872:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273284480:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 20621us (20903us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065159.001882:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13987 00002000:00100000:2.0:1746065159.001891:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1b:0x0] (8388608->10485759) req@ffff88008b789880 x1830881273284480/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:74/0 lens 488/440 e 0 to 0 dl 1746065169 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.001899:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789880 with x1830881273284480 ext(8388608->10485759) 00002000:00010000:2.0:1746065159.001904:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789880 00000100:00100000:0.0:1746065159.008144:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.008298:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273284736 00000100:00100000:2.0:1746065159.008305:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273284736 00002000:00100000:2.0:1746065159.008339:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1a:0x0] (10485760->11534335) req@ffff88008b78b480 x1830881273284736/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.008349:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b480 with x1830881273284736 ext(10485760->11534335) 00002000:00010000:2.0:1746065159.008353:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b78b480 00000100:00100000:2.0:1746065159.008381:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13988 00000100:00100000:2.0:1746065159.008388:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273284736:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065159.008730:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.010272:0:24940:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273284992 00000100:00100000:0.0:1746065159.010279:0:24940:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273284992 00002000:00100000:0.0:1746065159.010313:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1b:0x0] (10485760->11534335) req@ffff880079c34700 x1830881273284992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.010321:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880079c34700 with x1830881273284992 ext(10485760->11534335) 00002000:00010000:0.0:1746065159.010325:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880079c34700 00000100:00100000:0.0:1746065159.010349:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13989 00000100:00100000:0.0:1746065159.010354:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273284992:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065159.013745:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.014490:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273285248 00000100:00100000:2.0:1746065159.014498:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273285248 00002000:00100000:2.0:1746065159.014535:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1a:0x0] (11534336->12582911) req@ffff88008b788e00 x1830881273285248/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.014544:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788e00 with x1830881273285248 ext(11534336->12582911) 00002000:00010000:2.0:1746065159.014548:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b788e00 00000100:00100000:2.0:1746065159.014565:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13990 00000100:00100000:2.0:1746065159.014572:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273285248:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065159.018281:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.018814:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273285504 00000100:00100000:2.0:1746065159.018824:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273285504 00002000:00100000:2.0:1746065159.018863:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1b:0x0] (11534336->12582911) req@ffff88008b788000 x1830881273285504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.018873:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788000 with x1830881273285504 ext(11534336->12582911) 00002000:00010000:2.0:1746065159.018878:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788000 00000100:00100000:2.0:1746065159.018910:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13991 00000100:00100000:2.0:1746065159.018917:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273285504:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065159.020217:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.020376:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273285760 00000100:00100000:1.0:1746065159.020380:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273285760 00002000:00100000:1.0:1746065159.020402:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (12582912->13631487) req@ffff88008b78b100 x1830881273285760/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.020410:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b100 with x1830881273285760 ext(12582912->13631487) 00002000:00010000:1.0:1746065159.020413:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b78b100 00000100:00100000:3.0:1746065159.020642:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2005:x1830881273284736:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 12253us (12503us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.020650:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13988 00002000:00100000:3.0:1746065159.020655:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1a:0x0] (10485760->11534335) req@ffff88008b78b480 x1830881273284736/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.020661:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b480 with x1830881273284736 ext(10485760->11534335) 00002000:00010000:3.0:1746065159.020664:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b78b480 00000100:00100000:3.0:1746065159.020679:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13992 00000100:00100000:3.0:1746065159.020685:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273285760:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065159.021923:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273284992:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 11566us (13190us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065159.021930:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13989 00002000:00100000:0.0:1746065159.021937:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1b:0x0] (10485760->11534335) req@ffff880079c34700 x1830881273284992/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.021944:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880079c34700 with x1830881273284992 ext(10485760->11534335) 00002000:00010000:0.0:1746065159.021948:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880079c34700 00000100:00100000:0.0:1746065159.023291:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267831680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065159.023334:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065159.023415:0:8373:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267831680 00000100:00100000:3.0:1746065159.023424:0:8373:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267831680 00000100:00100000:3.0:1746065159.023451:0:8373:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1746065159.023457:0:8373:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267831680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1746065159.023488:0:8373:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446170624 avail 1316708352 00000100:00100000:3.0:1746065159.023516:0:8373:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267831680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.023522:0:8373:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1746065159.023531:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967404 gen 2 00000004:00080000:0.0:1746065159.023536:0:3765:0:(osp_trans.c:1031:osp_request_commit_cb()) trans no 4294967404 committed transno 4294967404 00000100:00100000:0.0:1746065159.023555:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267831680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065159.030251:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273285504:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 11328us (11972us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065159.030260:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13991 00002000:00100000:0.0:1746065159.030269:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1b:0x0] (11534336->12582911) req@ffff88008b788000 x1830881273285504/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.030276:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788000 with x1830881273285504 ext(11534336->12582911) 00002000:00010000:0.0:1746065159.030281:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b788000 00000100:00100000:3.0:1746065159.030572:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273285248:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 16000us (16832us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.030577:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13990 00002000:00100000:3.0:1746065159.030582:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1a:0x0] (11534336->12582911) req@ffff88008b788e00 x1830881273285248/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.030587:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b788e00 with x1830881273285248 ext(11534336->12582911) 00002000:00010000:3.0:1746065159.030590:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b788e00 00000100:00100000:3.0:1746065159.038988:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273285760:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 18293us (18763us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.038998:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13992 00002000:00100000:3.0:1746065159.039008:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1a:0x0] (12582912->13631487) req@ffff88008b78b100 x1830881273285760/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.039017:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b78b100 with x1830881273285760 ext(12582912->13631487) 00002000:00010000:3.0:1746065159.039022:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b78b100 00000100:00100000:0.0:1746065159.044062:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.044237:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273286016 00000100:00100000:3.0:1746065159.044245:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273286016 00000100:00100000:3.0:1746065159.044392:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 207 00000100:00100000:3.0:1746065159.044399:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801307ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:3818:x1830881273286016:12345-192.168.202.8@tcp:35:cmp.0 00000100:00100000:3.0:1746065159.044963:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801307ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:3818:x1830881273286016:12345-192.168.202.8@tcp:35:cmp.0 Request processed in 563us (907us total) trans 4294983628 rc 0/0 00000100:00100000:3.0:1746065159.044970:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 207 00000100:00100000:0.0:1746065159.055514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.055741:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273286272 00000100:00100000:1.0:1746065159.055749:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273286272 00000100:00100000:1.0:1746065159.055805:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36582 00000100:00100000:1.0:1746065159.055811:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+19:3819:x1830881273286272:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:1.0:1746065159.055827:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.055840:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x392ae0376f8812a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d02 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.055916:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x392ae0376f8812ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065159.055928:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x392ae0376f8812ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065159.055938:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x392ae0376f8812ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:1.0:1746065159.055946:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x47:0x0]: returning size 26214400 00010000:00010000:1.0:1746065159.056024:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x392ae0376f8812a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d02 expref: 22 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.056051:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x392ae0376f8812ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d02 expref: 21 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.056058:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:1.0:1746065159.056061:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065159.056064:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06600, rc 0) 00000100:00100000:1.0:1746065159.056127:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+21:3819:x1830881273286272:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 316us (620us total) trans 4294983629 rc 0/0 00000100:00100000:1.0:1746065159.056133:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36582 00000100:00100000:0.0:1746065159.058830:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.059015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.059096:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273286400 00000100:00100000:2.0:1746065159.059098:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273286656 00000100:00100000:3.0:1746065159.059103:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273286400 00000100:00100000:2.0:1746065159.059103:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273286656 00000100:00100000:3.0:1746065159.059136:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 512 00000100:00100000:2.0:1746065159.059141:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36583 00000100:00100000:3.0:1746065159.059142:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:2005:x1830881273286400:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065159.059147:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:3819:x1830881273286656:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:3.0:1746065159.059153:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065159.059162:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.059170:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x392ae0376f8812ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d02 expref: 22 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.059176:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846600/0x392ae0376f8812bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d09 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.059184:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:3.0:1746065159.059187:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.059212:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:2005:x1830881273286400:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 71us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.059218:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 512 00010000:00010000:2.0:1746065159.059238:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f8812c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065159.059247:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f8812c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065159.059255:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f8812c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000004:00200000:2.0:1746065159.059263:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x49:0x0]: returning size 26214400 00010000:00010000:2.0:1746065159.059402:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846600/0x392ae0376f8812bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d09 expref: 23 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.059429:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f8812c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d09 expref: 22 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.059435:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:2.0:1746065159.059437:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065159.059440:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f847200, rc 0) 00000100:00100000:2.0:1746065159.059586:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:3819:x1830881273286656:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 437us (569us total) trans 4294983630 rc 0/0 00000100:00100000:2.0:1746065159.059591:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36583 00000100:00100000:1.0:1746065159.062468:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.062549:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273286784 00000100:00100000:3.0:1746065159.062556:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273286784 00000100:00100000:1.0:1746065159.062556:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.062603:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 513 00000100:00100000:1.0:1746065159.062603:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.062610:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:2002:x1830881273286784:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065159.062615:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273286912 00000100:00100000:2.0:1746065159.062619:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273286912 00010000:00010000:3.0:1746065159.062621:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065159.062623:0:9558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273287040 00000100:00100000:1.0:1746065159.062625:0:9558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273287040 00000100:00100000:2.0:1746065159.062646:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30882 00000100:00100000:2.0:1746065159.062652:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+10:2003:x1830881273286912:12345-192.168.202.8@tcp:101:cmp.0 00000100:00100000:1.0:1746065159.062654:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30883 00000100:00100000:1.0:1746065159.062658:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2002:x1830881273287040:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:2.0:1746065159.062662:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.062663:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.062672:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8812d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d10 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.062672:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x392ae0376f8812d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d17 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.062686:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.062686:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.062687:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.062687:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.062692:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8812d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d10 expref: 11 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.062692:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x392ae0376f8812d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d17 expref: 13 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.062704:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8812d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d10 expref: 11 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.062704:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x392ae0376f8812d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d17 expref: 13 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.062712:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f847400, rc 0) 00010000:00010000:1.0:1746065159.062712:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07e00, rc 0) 00000100:00100000:2.0:1746065159.062751:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2003:x1830881273286912:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 100us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.062751:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2002:x1830881273287040:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 92us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.062769:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30883 00000100:00100000:2.0:1746065159.062775:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30882 00000100:00080000:2.0:1746065159.062787:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746065159.062790:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746065159.062997:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f8812c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d09 expref: 22 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.063017:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:3.0:1746065159.063020:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.063054:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130778700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+21:2002:x1830881273286784:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 444us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.063062:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 513 00000100:00100000:0.0:1746065159.072570:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267831808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065159.072620:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.072710:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267831808 00000100:00100000:2.0:1746065159.072716:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267831808 00000100:00100000:2.0:1746065159.072750:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1746065159.072768:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267831808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746065159.072785:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 519691072 pending 1073152 free 3893997568 avail 3638046720 00000100:00100000:2.0:1746065159.072812:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267831808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.072817:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1746065159.073339:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267831808:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1746065159.074458:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065159.081510:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.081563:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.081596:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273287296 00000100:00100000:1.0:1746065159.081604:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273287296 00002000:00100000:1.0:1746065159.081643:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1a:0x0] (0->2097151) req@ffff880072f98380 x1830881273287296/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.081651:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98380 with x1830881273287296 ext(0->2097151) 00002000:00010000:1.0:1746065159.081656:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f98380 00000100:00100000:1.0:1746065159.081670:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273287552 00000100:00100000:1.0:1746065159.081671:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273287552 00002000:00100000:1.0:1746065159.081680:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1b:0x0] (0->2097151) req@ffff880072f98e00 x1830881273287552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.081686:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98e00 with x1830881273287552 ext(0->2097151) 00002000:00010000:1.0:1746065159.081688:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98e00 00000100:00100000:1.0:1746065159.081702:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13993 00000100:00100000:1.0:1746065159.081707:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273287296:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065159.081795:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13994 00000100:00100000:3.0:1746065159.081801:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2004:x1830881273287552:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065159.100065:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2004:x1830881273287552:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 18256us (18494us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065159.100075:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13994 00002000:00100000:3.0:1746065159.100112:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1b:0x0] (0->2097151) req@ffff880072f98e00 x1830881273287552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.100122:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98e00 with x1830881273287552 ext(0->2097151) 00002000:00010000:3.0:1746065159.100127:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f98e00 00000100:00100000:1.0:1746065159.102386:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273287296:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 20672us (20876us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065159.102395:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13993 00002000:00100000:1.0:1746065159.102404:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x1a:0x0] (0->2097151) req@ffff880072f98380 x1830881273287296/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.102413:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98380 with x1830881273287296 ext(0->2097151) 00002000:00010000:1.0:1746065159.102417:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f98380 00000100:00100000:0.0:1746065159.122510:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.122555:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.122616:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273287936 00000100:00100000:3.0:1746065159.122624:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273287936 00000100:00100000:1.0:1746065159.122636:0:24940:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273288064 00000100:00100000:1.0:1746065159.122640:0:24940:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273288064 00002000:00100000:1.0:1746065159.122660:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1b:0x0] (2097152->4194303) req@ffff88009d548a80 x1830881273288064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.122661:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1a:0x0] (2097152->4194303) req@ffff88009d548380 x1830881273287936/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.122669:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548380 with x1830881273287936 ext(2097152->4194303) 00002000:00010000:3.0:1746065159.122673:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d548380 00002000:00100000:1.0:1746065159.122674:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548a80 with x1830881273288064 ext(2097152->4194303) 00002000:00010000:1.0:1746065159.122677:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548a80 00000100:00100000:3.0:1746065159.122703:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13995 00000100:00100000:3.0:1746065159.122710:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2003:x1830881273287936:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065159.122859:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13996 00000100:00100000:1.0:1746065159.122864:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2003:x1830881273288064:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065159.137877:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267831936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065159.137957:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065159.138589:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267831936 00000100:00100000:3.0:1746065159.138597:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267831936 00000100:00100000:3.0:1746065159.138636:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1746065159.138642:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267831936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746065159.138662:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 519691072 pending 1073152 free 3893997568 avail 3638046720 00000100:00100000:3.0:1746065159.138698:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267831936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.138703:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1746065159.138732:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267831936:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1746065159.138806:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065159.146821:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2003:x1830881273287936:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 24104us (24311us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065159.146832:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13995 00002000:00100000:3.0:1746065159.146841:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1a:0x0] (2097152->4194303) req@ffff88009d548380 x1830881273287936/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.146850:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548380 with x1830881273287936 ext(2097152->4194303) 00002000:00010000:3.0:1746065159.146855:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d548380 00000100:00100000:2.0:1746065159.148234:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2003:x1830881273288064:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 25365us (25673us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065159.148241:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13996 00002000:00100000:2.0:1746065159.148247:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1b:0x0] (2097152->4194303) req@ffff88009d548a80 x1830881273288064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.148254:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548a80 with x1830881273288064 ext(2097152->4194303) 00002000:00010000:2.0:1746065159.148258:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548a80 00000100:00100000:0.0:1746065159.167590:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.171145:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.171402:0:24940:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273288320 00000100:00100000:2.0:1746065159.171410:0:24940:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273288320 00002000:00100000:2.0:1746065159.171446:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x1a:0x0] (4194304->6291455) req@ffff88009d54b480 x1830881273288320/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.171454:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b480 with x1830881273288320 ext(4194304->6291455) 00002000:00010000:2.0:1746065159.171459:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d54b480 00000100:00100000:2.0:1746065159.171473:0:24940:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273288576 00000100:00100000:2.0:1746065159.171475:0:24940:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273288576 00002000:00100000:2.0:1746065159.171486:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1b:0x0] (4194304->6291455) req@ffff880072f99c00 x1830881273288576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.171493:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99c00 with x1830881273288576 ext(4194304->6291455) 00002000:00010000:2.0:1746065159.171496:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f99c00 00000100:00100000:2.0:1746065159.171508:0:24940:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13997 00000100:00100000:2.0:1746065159.171515:0:24940:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273288320:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065159.171579:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13998 00000100:00100000:3.0:1746065159.171587:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2004:x1830881273288576:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065159.192333:0:24940:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273288320:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 20811us (24742us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065159.192343:0:24940:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13997 00002000:00100000:2.0:1746065159.192352:0:24940:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x1a:0x0] (4194304->6291455) req@ffff88009d54b480 x1830881273288320/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.192360:0:24940:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b480 with x1830881273288320 ext(4194304->6291455) 00002000:00010000:2.0:1746065159.192365:0:24940:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d54b480 00000100:00100000:3.0:1746065159.205016:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2004:x1830881273288576:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 33421us (33868us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065159.205027:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13998 00002000:00100000:3.0:1746065159.205037:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1b:0x0] (4194304->6291455) req@ffff880072f99c00 x1830881273288576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.205046:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99c00 with x1830881273288576 ext(4194304->6291455) 00002000:00010000:3.0:1746065159.205050:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f99c00 00000100:00100000:0.0:1746065159.210777:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.210828:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.211112:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273288960 00000100:00100000:3.0:1746065159.211120:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273288960 00002000:00100000:3.0:1746065159.211156:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1a:0x0] (6291456->7340031) req@ffff88009d548e00 x1830881273288960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.211170:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548e00 with x1830881273288960 ext(6291456->7340031) 00002000:00010000:3.0:1746065159.211174:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d548e00 00000100:00100000:3.0:1746065159.211199:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273289088 00000100:00100000:3.0:1746065159.211202:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273289088 00002000:00100000:3.0:1746065159.211214:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1b:0x0] (6291456->7340031) req@ffff88009d549180 x1830881273289088/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.211219:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549180 with x1830881273289088 ext(6291456->7340031) 00002000:00010000:3.0:1746065159.211221:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d549180 00000100:00100000:3.0:1746065159.211233:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 13999 00000100:00100000:3.0:1746065159.211238:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2005:x1830881273288960:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065159.211747:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14000 00000100:00100000:3.0:1746065159.211753:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273289088:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065159.218442:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.218489:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.218572:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273289344 00000100:00100000:2.0:1746065159.218579:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273289344 00002000:00100000:2.0:1746065159.218614:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1a:0x0] (7340032->8388607) req@ffff88009d549c00 x1830881273289344/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.218622:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549c00 with x1830881273289344 ext(7340032->8388607) 00002000:00010000:2.0:1746065159.218628:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d549c00 00000100:00100000:2.0:1746065159.218807:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273289600 00000100:00100000:2.0:1746065159.218811:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273289600 00002000:00100000:2.0:1746065159.218825:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1b:0x0] (7340032->8388607) req@ffff88009d54b800 x1830881273289600/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.218838:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b800 with x1830881273289600 ext(7340032->8388607) 00002000:00010000:2.0:1746065159.218841:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54b800 00000100:00100000:2.0:1746065159.218869:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14001 00000100:00100000:2.0:1746065159.218876:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273289344:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065159.219430:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14002 00000100:00100000:0.0:1746065159.219436:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2005:x1830881273289600:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065159.223653:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2005:x1830881273289088:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 11891us (12814us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.223662:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14000 00002000:00100000:1.0:1746065159.223672:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1b:0x0] (6291456->7340031) req@ffff88009d549180 x1830881273289088/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.223680:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549180 with x1830881273289088 ext(6291456->7340031) 00002000:00010000:1.0:1746065159.223684:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d549180 00000100:00100000:1.0:1746065159.227916:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273288960:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 16667us (17151us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.227927:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 13999 00002000:00100000:1.0:1746065159.227938:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1a:0x0] (6291456->7340031) req@ffff88009d548e00 x1830881273288960/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.227948:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548e00 with x1830881273288960 ext(6291456->7340031) 00002000:00010000:1.0:1746065159.227953:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d548e00 00000100:00100000:2.0:1746065159.230988:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2005:x1830881273289344:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 12106us (12548us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.230998:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14001 00002000:00100000:2.0:1746065159.231008:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1a:0x0] (7340032->8388607) req@ffff88009d549c00 x1830881273289344/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.231017:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d549c00 with x1830881273289344 ext(7340032->8388607) 00002000:00010000:2.0:1746065159.231022:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d549c00 00000100:00100000:3.0:1746065159.233623:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273289600:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 14180us (15127us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.233632:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14002 00002000:00100000:3.0:1746065159.233640:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1b:0x0] (7340032->8388607) req@ffff88009d54b800 x1830881273289600/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.233649:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b800 with x1830881273289600 ext(7340032->8388607) 00002000:00010000:3.0:1746065159.233653:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54b800 00000100:00100000:0.0:1746065159.247369:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.247417:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.247553:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273289856 00000100:00100000:3.0:1746065159.247557:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273290112 00000100:00100000:2.0:1746065159.247560:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273289856 00000100:00100000:3.0:1746065159.247562:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273290112 00002000:00100000:3.0:1746065159.247598:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1b:0x0] (8388608->10485759) req@ffff88009d54ad80 x1830881273290112/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.247598:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1a:0x0] (8388608->10485759) req@ffff88009d54b100 x1830881273289856/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.247607:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b100 with x1830881273289856 ext(8388608->10485759) 00002000:00100000:3.0:1746065159.247612:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54ad80 with x1830881273290112 ext(8388608->10485759) 00002000:00010000:2.0:1746065159.247612:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d54b100 00002000:00010000:3.0:1746065159.247615:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54ad80 00000100:00100000:3.0:1746065159.248678:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14003 00000100:00100000:3.0:1746065159.248687:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273289856:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065159.248864:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14004 00000100:00100000:0.0:1746065159.248871:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273290112:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065159.266852:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273290112:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 17973us (19426us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065159.266862:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14004 00002000:00100000:1.0:1746065159.266873:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1b:0x0] (8388608->10485759) req@ffff88009d54ad80 x1830881273290112/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.266881:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54ad80 with x1830881273290112 ext(8388608->10485759) 00002000:00010000:1.0:1746065159.266891:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54ad80 00000100:00100000:3.0:1746065159.269681:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273289856:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 20989us (22313us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065159.269690:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14003 00002000:00100000:3.0:1746065159.269698:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1a:0x0] (8388608->10485759) req@ffff88009d54b100 x1830881273289856/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.269707:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54b100 with x1830881273289856 ext(8388608->10485759) 00002000:00010000:3.0:1746065159.269711:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d54b100 00010000:00010000:2.0:1746065159.283294:0:8891:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065159.286526:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.286565:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.286605:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.286693:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273290368 00000100:00100000:1.0:1746065159.286693:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273290624 00000100:00100000:3.0:1746065159.286700:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273290368 00000100:00100000:1.0:1746065159.286700:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273290624 00002000:00100000:1.0:1746065159.286734:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1b:0x0] (10485760->11534335) req@ffff88009d54a300 x1830881273290624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.286735:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1a:0x0] (10485760->11534335) req@ffff88009d54a680 x1830881273290368/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.286743:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a680 with x1830881273290368 ext(10485760->11534335) 00002000:00100000:1.0:1746065159.286743:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a300 with x1830881273290624 ext(10485760->11534335) 00002000:00010000:3.0:1746065159.286747:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d54a680 00002000:00010000:1.0:1746065159.286747:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54a300 00000100:00100000:1.0:1746065159.286773:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273291008 00000100:00100000:1.0:1746065159.286776:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273291008 00002000:00100000:1.0:1746065159.286785:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1b:0x0] (11534336->12582911) req@ffff88009d548000 x1830881273291008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.286790:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548000 with x1830881273291008 ext(11534336->12582911) 00002000:00010000:1.0:1746065159.286792:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548000 00000100:00100000:3.0:1746065159.286855:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14005 00000100:00100000:3.0:1746065159.286862:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2002:x1830881273290624:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065159.288575:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14006 00000100:00100000:1.0:1746065159.288585:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2003:x1830881273290368:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065159.288637:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14007 00000100:00100000:2.0:1746065159.288649:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2002:x1830881273291008:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065159.290566:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.290627:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273291136 00000100:00100000:3.0:1746065159.290633:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273291136 00002000:00100000:3.0:1746065159.290667:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (11534336->13631487) req@ffff88009f7c2a00 x1830881273291136/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.290679:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2a00 with x1830881273291136 ext(11534336->13631487) 00002000:00010000:3.0:1746065159.290684:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7c2a00 00000100:00100000:3.0:1746065159.290698:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14008 00000100:00100000:3.0:1746065159.290703:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2002:x1830881273291136:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065159.297585:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2002:x1830881273290624:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 10716us (11011us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.297596:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14005 00002000:00100000:3.0:1746065159.297606:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1b:0x0] (10485760->11534335) req@ffff88009d54a300 x1830881273290624/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.297615:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a300 with x1830881273290624 ext(10485760->11534335) 00002000:00010000:3.0:1746065159.297620:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d54a300 00000100:00100000:1.0:1746065159.304812:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2003:x1830881273290368:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 16221us (18285us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.304825:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14006 00002000:00100000:1.0:1746065159.304835:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x1a:0x0] (10485760->11534335) req@ffff88009d54a680 x1830881273290368/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.304844:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d54a680 with x1830881273290368 ext(10485760->11534335) 00002000:00010000:1.0:1746065159.304856:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d54a680 00000100:00100000:2.0:1746065159.307814:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2002:x1830881273291008:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 19158us (21200us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.307823:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14007 00002000:00100000:2.0:1746065159.307834:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1b:0x0] (11534336->12582911) req@ffff88009d548000 x1830881273291008/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.307842:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d548000 with x1830881273291008 ext(11534336->12582911) 00002000:00010000:2.0:1746065159.307847:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d548000 00000100:00100000:3.0:1746065159.312503:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2002:x1830881273291136:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 21792us (21934us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065159.312513:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14008 00002000:00100000:3.0:1746065159.312523:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1a:0x0] (11534336->13631487) req@ffff88009f7c2a00 x1830881273291136/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.312532:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2a00 with x1830881273291136 ext(11534336->13631487) 00002000:00010000:3.0:1746065159.312537:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7c2a00 00000100:00100000:0.0:1746065159.322158:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.322376:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273291520 00000100:00100000:3.0:1746065159.322384:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273291520 00000100:00100000:3.0:1746065159.322421:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 208 00000100:00100000:3.0:1746065159.322426:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+21:3819:x1830881273291520:12345-192.168.202.8@tcp:35:cmp.0 00000100:00100000:3.0:1746065159.322601:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:3819:x1830881273291520:12345-192.168.202.8@tcp:35:cmp.0 Request processed in 174us (449us total) trans 4294983631 rc 0/0 00000100:00100000:3.0:1746065159.322607:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 208 00000100:00100000:0.0:1746065159.323902:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.324019:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273291776 00000100:00100000:3.0:1746065159.324023:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273291776 00000100:00100000:3.0:1746065159.324050:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 209 00000100:00100000:3.0:1746065159.324055:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:3819:x1830881273291776:12345-192.168.202.8@tcp:35:cmp.0 00000100:00100000:3.0:1746065159.324170:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+23:3819:x1830881273291776:12345-192.168.202.8@tcp:35:cmp.0 Request processed in 114us (269us total) trans 4294983632 rc 0/0 00000100:00100000:3.0:1746065159.324175:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 209 00000100:00100000:0.0:1746065159.333334:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.333373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.333403:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273292160 00000100:00100000:0.0:1746065159.333409:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273292160 00000100:00100000:0.0:1746065159.333457:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36584 00000100:00100000:0.0:1746065159.333463:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:3821:x1830881273292160:12345-192.168.202.8@tcp:36:rm.0 00010000:00010000:1.0:1746065159.333522:0:7211:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065159.333543:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f88123e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cbc expref: 25 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.333563:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b30800/0x392ae0376f88100e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c53 expref: 24 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.333571:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:1.0:1746065159.333579:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881222 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cb5 expref: 23 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.333585:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065159.333587:0:7211:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065159.333601:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00000100:00100000:3.0:1746065159.333606:0:8373:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273291904 00000100:00100000:3.0:1746065159.333610:0:8373:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273291904 00010000:00010000:1.0:1746065159.333610:0:7211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd1 expref: 22 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.333616:0:7211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00000100:00100000:3.0:1746065159.333630:0:8373:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 682 00000100:00100000:3.0:1746065159.333634:0:8373:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2003:x1830881273291904:12345-192.168.202.8@tcp:63:ll_sa.0 00010000:00010000:1.0:1746065159.333639:0:7211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd1 expref: 22 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.333648:0:8373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.333648:0:7211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd1 expref: 22 pid: 7213 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746065159.333654:0:8373:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072f37000/0x392ae0376f8812e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d1e expref: -99 pid: 8373 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.333658:0:7211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7211:1830881267832064:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065159.333689:0:8373:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f8812ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333696:0:8373:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f8812ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333703:0:8373:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f8812ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333712:0:8373:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f8812f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333717:0:8373:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f8812f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8373 initiator: MDT0 00000100:00100000:1.0:1746065159.333720:0:7211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f805e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746065159.333722:0:8373:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f8812f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333752:0:8373:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f8812ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333769:0:8373:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f8812ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333774:0:8373:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f8812ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333779:0:8373:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f88ee00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065159.333782:0:8373:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f8812ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333787:0:8373:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f8812ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333794:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065159.333797:0:8373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065159.333799:0:8373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065159.333805:0:8373:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f8812ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333809:0:8373:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88ee00/0x392ae0376f8812ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333817:0:8373:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f8812f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333822:0:8373:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f8812f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333827:0:8373:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f8812f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333830:0:8373:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0b7ce00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065159.333833:0:8373:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f8812f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333837:0:8373:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f8812f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333842:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff880072c11100) 00010000:00010000:3.0:1746065159.333844:0:8373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065159.333846:0:8373:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f8812f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333850:0:8373:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f8812f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8373 initiator: MDT0 00010000:00010000:3.0:1746065159.333872:0:8373:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff880072f37000/0x392ae0376f8812e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d1e expref: 24 pid: 8373 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.333878:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065159.333880:0:8373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065159.333882:0:8373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065159.333887:0:8373:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072f37000/0x392ae0376f8812e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d1e expref: 24 pid: 8373 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.333898:0:8373:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072f37000, rc -2) 00000100:00100000:3.0:1746065159.333927:0:8373:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+23:2003:x1830881273291904:12345-192.168.202.8@tcp:63:ll_sa.0 Request processed in 292us (599us total) trans 0 rc -2/-2 00000100:00100000:3.0:1746065159.333933:0:8373:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 682 00000100:00100000:0.0:1746065159.336991:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.337104:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273292288 00000100:00100000:3.0:1746065159.337111:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273292288 00010000:00010000:3.0:1746065159.337138:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd1 expref: 23 pid: 7213 timeout: 858 lvb_type: 0 00000100:00100000:3.0:1746065159.337159:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14842 00000100:00100000:3.0:1746065159.337164:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+23:2004:x1830881273292288:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065159.337171:0:7211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7211:1830881267832064:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065159.337175:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065159.337179:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd1 expref: 23 pid: 7213 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746065159.337187:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd1 expref: 23 pid: 7213 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746065159.337194:0:7211:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065159.337201:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a17a00/0x392ae0376f88125a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cd1 expref: 23 pid: 7213 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746065159.337212:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065159.337216:0:7198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065159.337222:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065159.337231:0:7198:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065159.337252:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065159.337271:0:7211:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.337276:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.337291:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.337298:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.337303:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.337365:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.337372:0:7211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c76 expref: 22 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.337377:0:7211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.337395:0:7211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c76 expref: 22 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.337443:0:7211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c76 expref: 22 pid: 7213 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746065159.337452:0:7211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7211:1830881267832192:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065159.337887:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:2004:x1830881273292288:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 720us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.337894:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14842 00000100:00100000:1.0:1746065159.338188:0:7211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f805e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065159.340676:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.340752:0:7211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7211:1830881267832192:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065159.340785:0:7211:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000100:00100000:3.0:1746065159.340846:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273292416 00000100:00100000:3.0:1746065159.340852:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273292416 00010000:00010000:3.0:1746065159.340874:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c76 expref: 22 pid: 7213 timeout: 858 lvb_type: 0 00000100:00100000:3.0:1746065159.340916:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14843 00000100:00100000:3.0:1746065159.340922:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:2004:x1830881273292416:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065159.340931:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065159.340936:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c76 expref: 22 pid: 7213 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746065159.340944:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c76 expref: 22 pid: 7213 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746065159.340959:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f88108c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6c76 expref: 22 pid: 7213 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746065159.340969:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:3.0:1746065159.340972:0:7198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065159.340979:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065159.340985:0:7198:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 00010000:00010000:3.0:1746065159.340998:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.341024:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+21:2004:x1830881273292416:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 103us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.341030:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14843 00010000:00010000:1.0:1746065159.342203:0:7211:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342212:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000040:00080000:1.0:1746065159.342402:0:7211:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9152 00000004:00080000:1.0:1746065159.342410:0:7211:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 758462327507ns, next at 759462326297ns, rc = 0 00000040:00080000:1.0:1746065159.342426:0:7211:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 64 off9088 00000004:00080000:1.0:1746065159.342429:0:7211:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 758462348051ns, next at 759462347357ns, rc = 0 00010000:00010000:1.0:1746065159.342462:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342470:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342477:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342481:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342485:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342493:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342519:0:7211:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065159.342534:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342538:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342542:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342546:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091065400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065159.342549:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342554:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342561:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:1.0:1746065159.342563:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065159.342567:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342571:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065400/0x392ae0376f881302 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342650:0:7211:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342655:0:7211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342662:0:7211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342666:0:7211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342670:0:7211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091064800 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065159.342672:0:7211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342676:0:7211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342682:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065159.342684:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065159.342686:0:7211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342690:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064800/0x392ae0376f8812df lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00000004:00010000:1.0:1746065159.342697:0:7211:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f7c2d80 reply state ffff88009fa80000 transno 4294983633 ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342703:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.342708:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:1.0:1746065159.342709:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065159.342711:0:7211:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065159.342768:0:7202:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1746065159.342770:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:3821:x1830881273292160:12345-192.168.202.8@tcp:36:rm.0 Request processed in 9293us (9381us total) trans 4294983633 rc 0/0 00010000:00010000:2.0:1746065159.342773:0:7202:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065159.342777:0:7202:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ddfde00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065159.342780:0:7202:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7211 initiator: MDT0 00000100:00100000:1.0:1746065159.342780:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36584 00010000:00010000:2.0:1746065159.342784:0:7202:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065159.342790:0:7202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8800b535df00) 00010000:00010000:2.0:1746065159.342792:0:7202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065159.342794:0:7202:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065159.342798:0:7202:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881309 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065159.342808:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065159.342810:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065159.342811:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065159.398436:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.398498:0:7211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273292544 00000100:00100000:1.0:1746065159.398506:0:7211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273292544 00000100:00100000:1.0:1746065159.398558:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36585 00000100:00100000:1.0:1746065159.398564:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+24:3824:x1830881273292544:12345-192.168.202.8@tcp:101:lfs.0 00000100:00100000:0.0:1746065159.398578:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065159.398584:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065159.398595:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065159.398599:0:7211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881310 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d56 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.398611:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.398638:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065159.398645:0:7211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881317 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 00010000:00010000:1.0:1746065159.398655:0:7211:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00000100:00100000:0.0:1746065159.398658:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065159.398663:0:7211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000100:00100000:0.0:1746065159.398685:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273292800 00000100:00100000:0.0:1746065159.398689:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273292800 00000004:00200000:1.0:1746065159.398693:0:7211:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1746065159.398695:0:7211:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065159.398707:0:7211:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 00000100:00100000:0.0:1746065159.398711:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273293184 00000100:00100000:0.0:1746065159.398712:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273293184 00000100:00100000:0.0:1746065159.398723:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1217 00010000:00010000:1.0:1746065159.398724:0:7211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfc400/0x392ae0376f881310 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d56 expref: 26 pid: 7211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.398728:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273292800:12345-192.168.202.8@tcp:400:kworker.0 00010000:00010000:1.0:1746065159.398741:0:7211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d56 expref: 25 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.398746:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065159.398749:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065159.398752:0:7211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ddfde00, rc 0) 00000100:00100000:1.0:1746065159.398781:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:3824:x1830881273292544:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 217us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.398781:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273292800:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 53us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.398787:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36585 00000100:00100000:3.0:1746065159.398981:0:7208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273292672 00000100:00100000:3.0:1746065159.398985:0:7208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273292672 00000100:00100000:3.0:1746065159.399005:0:7208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 569 00000100:00100000:3.0:1746065159.399008:0:7208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70506d4b-f74d-460b-a2d0-0f9fd3b6e38b+12:2004:x1830881273292672:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:3.0:1746065159.399027:0:7208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70506d4b-f74d-460b-a2d0-0f9fd3b6e38b+12:2004:x1830881273292672:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 18us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.399031:0:7208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 569 00000100:00100000:2.0:1746065159.399103:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273293056 00000100:00100000:2.0:1746065159.399106:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273293056 00000100:00100000:2.0:1746065159.399128:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273292928 00000100:00100000:2.0:1746065159.399130:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273292928 00000100:00100000:2.0:1746065159.399141:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 844 00000100:00100000:2.0:1746065159.399145:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273293056:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1746065159.399164:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273293056:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 19us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.399168:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 844 00000100:00100000:2.0:1746065159.399176:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 845 00000100:00100000:2.0:1746065159.399179:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273292928:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:2.0:1746065159.399190:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273292928:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 11us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.399194:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 845 00000100:00100000:0.0:1746065159.399543:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1217 00000100:00100000:1.0:1746065159.399567:0:7211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 1218 00000100:00100000:1.0:1746065159.399593:0:7211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:2004:x1830881273293184:12345-192.168.202.8@tcp:400:kworker.0 00000100:00100000:1.0:1746065159.399613:0:7211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+8:2004:x1830881273293184:12345-192.168.202.8@tcp:400:kworker.0 Request processed in 41us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.399617:0:7211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 1218 00000100:00080000:1.0:1746065159.399737:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065159.403228:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.403379:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273293440 00000100:00100000:2.0:1746065159.403387:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273293440 00000100:00100000:2.0:1746065159.403434:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36586 00000100:00100000:2.0:1746065159.403440:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+25:3824:x1830881273293440:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:2.0:1746065159.403455:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.403458:0:21520:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065159.403477:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ddfde00/0x392ae0376f881317 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d56 expref: 25 pid: 7211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.404438:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065159.404444:0:21520:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065159.404455:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f88131e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d5d expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.404529:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881325 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404539:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881325 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404549:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881325 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404556:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404561:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404565:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404831:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404837:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404841:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:2.0:1746065159.404847:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4b:0x0]: returning size 0 00010000:00010000:2.0:1746065159.404863:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881325 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404869:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881325 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404873:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881325 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404877:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f846a00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065159.404880:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881325 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404887:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881325 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404894:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065159.404896:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065159.404898:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881325 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404902:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881325 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00000004:00010000:2.0:1746065159.404911:0:21520:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f7c0000 reply state ffff880072eb0000 transno 4294983634 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404917:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.404921:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:2.0:1746065159.404923:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065159.404925:0:21520:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065159.404944:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f88131e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d5d expref: 27 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.404954:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d5d expref: 26 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.404959:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff88012b66cd00) 00010000:00010000:2.0:1746065159.404960:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065159.404962:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079da5400, rc 0) 00000100:00100000:2.0:1746065159.406158:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:3824:x1830881273293440:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 2712us (2931us total) trans 4294983634 rc 0/0 00000100:00100000:2.0:1746065159.406319:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36586 00000100:00100000:0.0:1746065159.408376:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.408450:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273293696 00000100:00100000:2.0:1746065159.408458:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273293696 00000100:00100000:2.0:1746065159.408502:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36587 00000100:00100000:2.0:1746065159.408508:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:3824:x1830881273293696:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:2.0:1746065159.408526:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.408539:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881341 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d64 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.408610:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.408621:0:21520:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d5d expref: 28 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.408627:0:21520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.408650:0:21520:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d5d expref: 28 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.408659:0:21520:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d5d expref: 28 pid: 21520 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746065159.408669:0:21520:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21520:1830881267832320:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065159.408751:0:21520:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065159.411869:0:21520:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21520:1830881267832320:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065159.411893:0:21520:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000100:00100000:0.0:1746065159.412649:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.412750:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273293824 00000100:00100000:2.0:1746065159.412764:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273293824 00010000:00010000:2.0:1746065159.412788:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d5d expref: 29 pid: 21520 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746065159.412823:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14844 00000100:00100000:2.0:1746065159.412829:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:2005:x1830881273293824:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065159.412839:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065159.412843:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d5d expref: 29 pid: 21520 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746065159.412851:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d5d expref: 29 pid: 21520 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746065159.412867:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f881333 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d5d expref: 29 pid: 21520 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746065159.412973:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff88012b66cd00) 00010000:00010000:2.0:1746065159.412981:0:8359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.412988:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.412993:0:8359:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065159.413008:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065159.413018:0:21520:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.413024:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:3.0:1746065159.413036:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4b:0x0]: returning size 0 00000100:00100000:2.0:1746065159.413050:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:2005:x1830881273293824:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 221us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.413056:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14844 00000004:00080000:3.0:1746065159.413169:0:21520:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1c:0x0], index 0: 0 00000004:00080000:3.0:1746065159.413174:0:21520:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1c:0x0], index 1: 0 00010000:00010000:3.0:1746065159.413247:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.413254:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.413259:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.413264:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f847c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065159.413268:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.413272:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.413452:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff88012b66cd00) 00010000:00010000:3.0:1746065159.413455:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065159.413457:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.413461:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f881348 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.413502:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881341 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d64 expref: 28 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.413508:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f881341 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d64 expref: 28 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.413515:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f846a00, rc 0) 00000100:00100000:3.0:1746065159.413550:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:3824:x1830881273293696:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 5041us (5179us total) trans 4294983635 rc 301/301 00000100:00100000:3.0:1746065159.413555:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36587 00000100:00100000:0.0:1746065159.415572:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.415630:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273294080 00000100:00100000:1.0:1746065159.415637:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273294080 00000100:00100000:1.0:1746065159.415765:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 210 00000100:00100000:1.0:1746065159.415772:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+27:3824:x1830881273294080:12345-192.168.202.8@tcp:35:lfs.0 00000100:00100000:1.0:1746065159.415958:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:3824:x1830881273294080:12345-192.168.202.8@tcp:35:lfs.0 Request processed in 185us (390us total) trans 4294983636 rc 0/0 00000100:00100000:1.0:1746065159.415964:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 210 00000100:00100000:0.0:1746065159.417809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.417979:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273294208 00000100:00100000:3.0:1746065159.417985:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273294208 00000100:00100000:3.0:1746065159.420179:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36588 00000100:00100000:3.0:1746065159.420192:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+28:3824:x1830881273294208:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:3.0:1746065159.420211:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.420229:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f881356 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d6b expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.420271:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f881356 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d6b expref: 29 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.420282:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f881356 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d6b expref: 29 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.420294:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:3.0:1746065159.420297:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065159.420299:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f847200, rc 0) 00000100:00100000:3.0:1746065159.421323:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:3824:x1830881273294208:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 1132us (3513us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.421330:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36588 00000100:00100000:0.0:1746065159.422989:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.423068:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273294464 00000100:00100000:3.0:1746065159.423076:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273294464 00000100:00100000:3.0:1746065159.423427:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 211 00000100:00100000:3.0:1746065159.423435:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+29:3824:x1830881273294464:12345-192.168.202.8@tcp:35:lfs.0 00000100:00100000:3.0:1746065159.423592:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:3824:x1830881273294464:12345-192.168.202.8@tcp:35:lfs.0 Request processed in 157us (606us total) trans 4294983637 rc 0/0 00000100:00100000:3.0:1746065159.423597:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 211 00000100:00100000:0.0:1746065159.432358:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.432597:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273294720 00000100:00100000:3.0:1746065159.432605:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273294720 00000100:00100000:3.0:1746065159.432645:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36589 00000100:00100000:3.0:1746065159.432651:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+21:3826:x1830881273294720:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1746065159.432671:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.432685:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072539400/0x392ae0376f88135d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d79 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.432726:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881364 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.432735:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.432743:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:3.0:1746065159.432782:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1746065159.432784:0:21520:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065159.432797:0:21520:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.432811:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072539400/0x392ae0376f88135d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d79 expref: 23 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.432838:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881364 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d79 expref: 22 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.432844:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065159.432846:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065159.432849:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f88f400, rc 0) 00000100:00100000:3.0:1746065159.432879:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:3826:x1830881273294720:12345-192.168.202.8@tcp:101:dd.0 Request processed in 229us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.432884:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36589 00000100:00100000:0.0:1746065159.433574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.433687:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273294592 00000100:00100000:2.0:1746065159.433691:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273294592 00000100:00100000:2.0:1746065159.433723:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36590 00000100:00100000:2.0:1746065159.433733:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+30:3825:x1830881273294592:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065159.433742:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.433750:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800728f8200/0x392ae0376f88136b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d72 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.433785:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7c4a00/0x392ae0376f881372 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065159.433791:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7c4a00/0x392ae0376f881372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065159.433798:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7c4a00/0x392ae0376f881372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:2.0:1746065159.434113:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1746065159.434116:0:7213:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065159.434127:0:7213:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7c4a00/0x392ae0376f881372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065159.434141:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800728f8200/0x392ae0376f88136b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d72 expref: 32 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.434158:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7c4a00/0x392ae0376f881372 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d72 expref: 31 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.434164:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065159.434167:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065159.434170:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7c4a00, rc 0) 00000100:00100000:2.0:1746065159.434206:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:3825:x1830881273294592:12345-192.168.202.8@tcp:101:dd.0 Request processed in 476us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.434211:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36590 00000100:00100000:0.0:1746065159.435553:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.435790:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273294976 00000100:00100000:2.0:1746065159.435796:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273294976 00000100:00100000:2.0:1746065159.435833:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36591 00000100:00100000:2.0:1746065159.435838:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:3826:x1830881273294976:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065159.435850:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.435863:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072a5cc00/0x392ae0376f881379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d80 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.435924:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727b7800/0x392ae0376f881380 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065159.435933:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727b7800/0x392ae0376f881380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065159.435940:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727b7800/0x392ae0376f881380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:2.0:1746065159.435947:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x47:0x0]: returning size 26214400 00010000:00010000:2.0:1746065159.436011:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072a5cc00/0x392ae0376f881379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d80 expref: 25 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.436021:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727b7800/0x392ae0376f881380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d80 expref: 24 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.436027:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:2.0:1746065159.436030:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065159.436032:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727b7800, rc 0) 00000100:00100000:2.0:1746065159.436057:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+24:3826:x1830881273294976:12345-192.168.202.8@tcp:101:dd.0 Request processed in 219us (507us total) trans 4294983638 rc 0/0 00000100:00100000:2.0:1746065159.436062:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36591 00000100:00100000:0.0:1746065159.438826:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.439862:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273295232 00000100:00100000:3.0:1746065159.439870:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273295232 00000100:00100000:3.0:1746065159.439919:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36592 00000100:00100000:3.0:1746065159.439926:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+24:3826:x1830881273295232:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1746065159.439945:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.439948:0:21520:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065159.439970:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f88f400/0x392ae0376f881364 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d79 expref: 24 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.439986:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065159.439989:0:21520:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065159.439997:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072539a00/0x392ae0376f88138e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d87 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.440103:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f881395 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440112:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f881395 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440118:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f881395 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440125:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f88139c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440130:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f88139c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440133:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f88139c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440167:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440174:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440179:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:3.0:1746065159.440185:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4b:0x0]: returning size 0 00010000:00010000:3.0:1746065159.440238:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f881395 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440249:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f881395 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440254:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f881395 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440259:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a09fb200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065159.440262:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f881395 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440267:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f881395 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440274:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065159.440276:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065159.440278:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f881395 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440281:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fb200/0x392ae0376f881395 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440288:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f88139c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440294:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f88139c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440297:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f88139c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440301:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a09fac00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065159.440302:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f88139c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440305:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f88139c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440309:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:3.0:1746065159.440310:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065159.440312:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f88139c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440316:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fac00/0x392ae0376f88139c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065159.440338:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072539a00/0x392ae0376f88138e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d87 expref: 26 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.440345:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d87 expref: 25 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.440350:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:3.0:1746065159.440352:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065159.440354:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09fae00, rc 0) 00000100:00100000:3.0:1746065159.440389:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+25:3826:x1830881273295232:12345-192.168.202.8@tcp:101:dd.0 Request processed in 464us (1570us total) trans 4294983639 rc 0/0 00000100:00100000:3.0:1746065159.440395:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36592 00000100:00100000:0.0:1746065159.440847:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.440896:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273295744 00000100:00100000:0.0:1746065159.440899:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273295744 00000100:00100000:0.0:1746065159.440923:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 683 00000100:00100000:0.0:1746065159.440928:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a42d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+31:2004:x1830881273295744:12345-192.168.202.8@tcp:63:ll_sa.0 00010000:00010000:0.0:1746065159.440944:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065159.440950:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a16e00/0x392ae0376f8813b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d95 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.440976:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f8813b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.440982:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f8813b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.440988:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f8813b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.440994:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f8813bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00000100:00100000:1.0:1746065159.441353:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.441388:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.441417:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273295360 00000100:00100000:1.0:1746065159.441420:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273295360 00000100:00100000:1.0:1746065159.441443:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 514 00000100:00100000:1.0:1746065159.441447:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+25:2003:x1830881273295360:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065159.441454:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065159.441464:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727b7800/0x392ae0376f881380 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d80 expref: 25 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.441477:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:1.0:1746065159.441479:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065159.441498:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+24:2003:x1830881273295360:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 51us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.441503:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 514 00000100:00100000:2.0:1746065159.441766:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273295616 00000100:00100000:2.0:1746065159.441770:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273295616 00000100:00100000:2.0:1746065159.441799:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36593 00000100:00100000:2.0:1746065159.441804:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:3825:x1830881273295616:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065159.441811:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.441813:0:7213:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065159.441821:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7c4a00/0x392ae0376f881372 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d72 expref: 33 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.441830:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065159.441833:0:7213:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065159.441838:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800728f9600/0x392ae0376f8813c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d8e expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.441850:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f8813bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.441857:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f8813bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:2.0:1746065159.441888:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072615600/0x392ae0376f8813cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065159.441894:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072615600/0x392ae0376f8813cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065159.441900:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072615600/0x392ae0376f8813cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:2.0:1746065159.441906:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4a:0x0]: returning size 26214400 00010000:00010000:0.0:1746065159.441914:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f8813d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.441920:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f8813d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.441924:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f8813d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00000004:00200000:0.0:1746065159.441935:0:7216:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4b:0x0]: returning size 0 00000004:00200000:0.0:1746065159.441939:0:7216:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065159.441949:0:7216:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f8813d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.441954:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f8813d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:2.0:1746065159.441955:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800728f9600/0x392ae0376f8813c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d8e expref: 35 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.441960:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f8813b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:2.0:1746065159.441964:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072615600/0x392ae0376f8813cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d8e expref: 34 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.441964:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f8813b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:2.0:1746065159.441970:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4a:0x0].0x0 (ffff88009ffabb00) 00010000:00010000:0.0:1746065159.441970:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f8813b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:2.0:1746065159.441972:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065159.441974:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072615600, rc 0) 00010000:00010000:0.0:1746065159.441974:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f846a00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065159.441976:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f8813b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.441981:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f8813b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.441987:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065159.441989:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065159.441991:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f8813b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00000100:00100000:2.0:1746065159.441992:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:3825:x1830881273295616:12345-192.168.202.8@tcp:101:dd.0 Request processed in 189us (604us total) trans 4294983640 rc 0/0 00010000:00010000:0.0:1746065159.441995:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846a00/0x392ae0376f8813b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00000100:00100000:2.0:1746065159.441997:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36593 00010000:00010000:0.0:1746065159.442004:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f8813bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442008:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f8813bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442012:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f8813bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442016:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f847c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065159.442019:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f8813bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442023:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f8813bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442028:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:0.0:1746065159.442030:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065159.442032:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f8813bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442036:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847c00/0x392ae0376f8813bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442050:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a16e00/0x392ae0376f8813b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d95 expref: 34 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.442058:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f8813d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d95 expref: 33 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.442062:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:0.0:1746065159.442064:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065159.442066:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079da5400, rc 0) 00010000:00010000:0.0:1746065159.442069:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065159.442075:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072f37000/0x392ae0376f8813e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6d9c expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.442112:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072f36400/0x392ae0376f8813e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442118:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072f36400/0x392ae0376f8813e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442127:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072f36400/0x392ae0376f8813e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442135:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f8813f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442139:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f8813f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442143:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f8813f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442152:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072f36400/0x392ae0376f8813e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442157:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072f36400/0x392ae0376f8813e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442161:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072f36400/0x392ae0376f8813e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442164:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072f36400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065159.442166:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072f36400/0x392ae0376f8813e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442170:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072f36400/0x392ae0376f8813e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442175:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065159.442177:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065159.442179:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072f36400/0x392ae0376f8813e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442182:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072f36400/0x392ae0376f8813e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442189:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f8813f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442193:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f8813f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442197:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f8813f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442200:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a8ae00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065159.442202:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f8813f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442206:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f8813f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442210:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff88006df47100) 00010000:00010000:0.0:1746065159.442211:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065159.442213:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f8813f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442216:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0x392ae0376f8813f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065159.442232:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff880072f37000/0x392ae0376f8813e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d9c expref: 34 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.442237:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065159.442239:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065159.442241:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072f37000/0x392ae0376f8813e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d9c expref: 34 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.442251:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072f37000, rc -2) 00000100:00100000:0.0:1746065159.442273:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a42d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2004:x1830881273295744:12345-192.168.202.8@tcp:63:ll_sa.0 Request processed in 1346us (1428us total) trans 0 rc -2/-2 00000100:00100000:0.0:1746065159.442279:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 683 00000100:00100000:1.0:1746065159.448015:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.448933:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273295872 00000100:00100000:2.0:1746065159.448941:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273295872 00000100:00100000:2.0:1746065159.448983:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 515 00000100:00100000:2.0:1746065159.448990:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:2002:x1830881273295872:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065159.449003:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065159.449022:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072615600/0x392ae0376f8813cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d8e expref: 33 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.449033:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4a:0x0].0x0 (ffff88009ffabb00) 00010000:00010000:2.0:1746065159.449036:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065159.449109:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:2002:x1830881273295872:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 120us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.449115:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 515 00000100:00100000:0.0:1746065159.453199:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.453232:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.453257:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.453288:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.453327:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273296000 00000100:00100000:0.0:1746065159.453333:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273296000 00000100:00100000:0.0:1746065159.453363:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273296128 00000100:00100000:0.0:1746065159.453365:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273296128 00000100:00100000:0.0:1746065159.453373:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273296256 00000100:00100000:0.0:1746065159.453374:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273296256 00000100:00100000:0.0:1746065159.453386:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30884 00000100:00100000:0.0:1746065159.453391:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2002:x1830881273296000:12345-192.168.202.8@tcp:101:ll_agl.0 00010000:00010000:0.0:1746065159.453405:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065159.453421:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b400/0x392ae0376f8813f7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6dcd expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065159.453438:0:9642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065159.453452:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.453454:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.453460:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b400/0x392ae0376f8813f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dcd expref: 9 pid: 9642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.453472:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b400/0x392ae0376f8813f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dcd expref: 9 pid: 9642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.453481:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a8b400, rc 0) 00000100:00100000:1.0:1746065159.453498:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30885 00000100:00100000:1.0:1746065159.453504:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273296128:12345-192.168.202.8@tcp:101:ll_agl.0 00010000:00010000:1.0:1746065159.453511:0:9558:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065159.453513:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2002:x1830881273296000:12345-192.168.202.8@tcp:101:ll_agl.0 Request processed in 123us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.453518:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30884 00010000:00010000:1.0:1746065159.453520:0:9558:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0b7ce00/0x392ae0376f8813fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6dd4 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065159.453530:0:9558:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1746065159.453531:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30886 00000100:00100000:0.0:1746065159.453535:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:3826:x1830881273296256:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065159.453538:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.453539:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.453540:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.453542:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0b7ce00/0x392ae0376f8813fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dd4 expref: 17 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.453544:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ddb expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.453550:0:9558:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0b7ce00/0x392ae0376f8813fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dd4 expref: 17 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.453556:0:9558:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0b7ce00, rc 0) 00010000:00010000:0.0:1746065159.453556:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b400/0x392ae0376f8813f7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dcd expref: 8 pid: 9642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.453561:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.453563:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.453565:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 12 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.453570:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2002:x1830881273296128:12345-192.168.202.8@tcp:101:ll_agl.0 Request processed in 67us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.453573:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30885 00010000:00010000:0.0:1746065159.453584:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b400/0x392ae0376f8813f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dcd expref: 8 pid: 9642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.453594:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b400/0x392ae0376f8813f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dcd expref: 8 pid: 9642 timeout: 858 lvb_type: 1 00000100:00100000:0.0:1746065159.453603:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267832448:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065159.453654:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065159.454829:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273296512 00000100:00100000:2.0:1746065159.454835:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273296512 00000100:00100000:2.0:1746065159.454869:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14009 00000100:00100000:2.0:1746065159.454874:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2004:x1830881273296512:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065159.454903:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88140c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.454911:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.454912:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.454915:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88140c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.454924:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88140c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.459444:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.459495:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273296768 00000100:00100000:3.0:1746065159.459503:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273296768 00000100:00100000:3.0:1746065159.459547:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14010 00000100:00100000:3.0:1746065159.459554:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273296768:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065159.459583:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881413 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.459593:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.459594:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.459599:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881413 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.459609:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881413 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.460171:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267832448:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065159.460190:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 12 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.460200:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a8a200, rc 0) 00000100:00100000:1.0:1746065159.460238:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:3826:x1830881273296256:12345-192.168.202.8@tcp:101:dd.0 Request processed in 6701us (6978us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.460245:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30886 00000100:00100000:2.0:1746065159.460881:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.460939:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273296896 00000100:00100000:0.0:1746065159.460944:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273296896 00010000:00010000:0.0:1746065159.460962:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b400/0x392ae0376f8813f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dcd expref: 11 pid: 9642 timeout: 858 lvb_type: 1 00000100:00100000:0.0:1746065159.460988:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14845 00000100:00100000:0.0:1746065159.460993:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2005:x1830881273296896:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065159.461002:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065159.461015:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b400/0x392ae0376f8813f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dcd expref: 11 pid: 9642 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746065159.461023:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b400/0x392ae0376f8813f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dcd expref: 11 pid: 9642 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746065159.461037:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8b400/0x392ae0376f8813f7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dcd expref: 11 pid: 9642 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746065159.461059:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.461061:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.461066:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 11 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.461072:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 11 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.461113:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 11 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.461122:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267832576:192.168.202.8@tcp:105: 00000100:00100000:0.0:1746065159.461168:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00010000:00010000:2.0:1746065159.469702:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881413 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.469717:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881413 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.469724:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881413 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.469730:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a09fac00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065159.469733:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881413 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.469739:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881413 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.469771:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881413 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.469777:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881413 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.469833:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273296768:12345-192.168.202.8@tcp:3:dd.0 Request processed in 10276us (10393us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.469841:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14010 00000100:00100000:1.0:1746065159.470097:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267832576:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065159.470112:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065159.470133:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273296896:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 9139us (9253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.470140:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14845 00010000:00010000:0.0:1746065159.470304:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88140c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.470311:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88140c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.470315:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88140c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.470320:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072614200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065159.470321:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88140c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.470326:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88140c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.470334:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88140c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.470338:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88140c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.470371:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2004:x1830881273296512:12345-192.168.202.8@tcp:3:dd.0 Request processed in 15496us (17082us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065159.470376:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14009 00000100:00100000:0.0:1746065159.476889:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.478393:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273297024 00000100:00100000:2.0:1746065159.478402:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273297024 00000100:00100000:2.0:1746065159.479364:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36594 00000100:00100000:2.0:1746065159.479374:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+32:3825:x1830881273297024:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065159.479393:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.479407:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072615e00/0x392ae0376f88141a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6de2 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.479433:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072614400/0x392ae0376f881421 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065159.479441:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072614400/0x392ae0376f881421 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065159.479449:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072614400/0x392ae0376f881421 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065159.479525:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072615e00/0x392ae0376f88141a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de2 expref: 34 pid: 7213 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.480279:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065159.480656:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072614400/0x392ae0376f881421 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de2 expref: 33 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.480669:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4a:0x0].0x0 (ffff88009ffabb00) 00010000:00010000:2.0:1746065159.480671:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065159.480673:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072614400, rc 0) 00000100:00100000:2.0:1746065159.480720:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:3825:x1830881273297024:12345-192.168.202.8@tcp:101:dd.0 Request processed in 1348us (3837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.480725:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36594 00000100:00100000:1.0:1746065159.481145:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273297152 00000100:00100000:1.0:1746065159.481151:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273297152 00000100:00100000:1.0:1746065159.481185:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30887 00000100:00100000:1.0:1746065159.481190:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:3826:x1830881273297152:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065159.481200:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.481210:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6de9 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.481229:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0b7ce00/0x392ae0376f8813fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dd4 expref: 16 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.481236:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.481238:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.481241:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 14 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.481262:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0b7ce00/0x392ae0376f8813fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dd4 expref: 16 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.481272:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0b7ce00/0x392ae0376f8813fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dd4 expref: 16 pid: 9558 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746065159.481281:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267832704:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065159.481339:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f805840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065159.483124:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267832704:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065159.483146:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 14 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.483157:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6c000, rc 0) 00000100:00100000:1.0:1746065159.483188:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:3826:x1830881273297152:12345-192.168.202.8@tcp:101:dd.0 Request processed in 1996us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.483194:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30887 00000100:00100000:0.0:1746065159.483346:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.483455:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273297280 00000100:00100000:1.0:1746065159.483459:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273297280 00010000:00010000:1.0:1746065159.483476:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0b7ce00/0x392ae0376f8813fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dd4 expref: 17 pid: 9558 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746065159.483502:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14846 00000100:00100000:1.0:1746065159.483507:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2004:x1830881273297280:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065159.483520:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065159.483535:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0b7ce00/0x392ae0376f8813fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dd4 expref: 17 pid: 9558 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746065159.483544:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0b7ce00/0x392ae0376f8813fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dd4 expref: 17 pid: 9558 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746065159.483560:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0b7ce00/0x392ae0376f8813fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dd4 expref: 17 pid: 9558 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746065159.483572:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.483574:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.483579:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 13 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.483585:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 13 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.483604:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 13 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.483613:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267832832:192.168.202.8@tcp:105: 00000100:00100000:1.0:1746065159.483664:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f805840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065159.486741:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267832832:192.168.202.8@tcp:105: 00010000:00010000:1.0:1746065159.486769:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065159.487749:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273297280:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4236us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.487766:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14846 00000100:00100000:0.0:1746065159.489931:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.489987:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273297536 00000100:00100000:2.0:1746065159.489994:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273297536 00000100:00100000:2.0:1746065159.490040:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14011 00000100:00100000:2.0:1746065159.490048:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273297536:12345-192.168.202.8@tcp:4:dd.0 00010000:00010000:2.0:1746065159.490074:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.490119:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f881214 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cae expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.490126:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065159.490127:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065159.490130:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.490158:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f881214 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cae expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.490170:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f881214 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cae expref: 8 pid: 9560 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746065159.490187:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:20722:1830881267832960:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065159.491389:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065159.494779:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:20722:1830881267832960:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065159.494799:0:20722:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.495675:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.495884:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273297664 00000100:00100000:1.0:1746065159.495890:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273297664 00010000:00010000:1.0:1746065159.495917:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f881214 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cae expref: 9 pid: 9560 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746065159.495948:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14847 00000100:00100000:1.0:1746065159.495954:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273297664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065159.495964:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065159.495976:0:8359:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb size from disk: 25067520 -> 26214400 00002000:00010000:1.0:1746065159.495979:0:8359:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb blocks from disk: 48960 -> 51200 00010000:00010000:1.0:1746065159.495984:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f881214 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cae expref: 9 pid: 9560 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746065159.495993:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f881214 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cae expref: 9 pid: 9560 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746065159.496011:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f88f200/0x392ae0376f881214 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cae expref: 9 pid: 9560 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746065159.496027:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.496028:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.496032:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.496038:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.496071:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065159.496129:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273297664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 174us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.496135:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14847 00010000:00010000:3.0:1746065159.497343:0:20722:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.497355:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746065159.521979:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970761 is committed 00000001:00080000:0.0:1746065159.521990:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970760 is committed 00002000:00010000:3.0:1746065159.522295:0:20722:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb mtime from disk: 1746065157 -> 1746065158 00002000:00010000:3.0:1746065159.522299:0:20722:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb ctime from disk: 1746065157 -> 1746065158 00010000:00010000:3.0:1746065159.522310:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.522318:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.522326:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.522332:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072614a00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065159.522336:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.522342:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.522357:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.522363:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072614a00/0x392ae0376f88142f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.524420:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273297536:12345-192.168.202.8@tcp:4:dd.0 Request processed in 34363us (34485us total) trans 4294970761 rc 0/0 00000100:00100000:3.0:1746065159.524431:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14011 00000100:00100000:0.0:1746065159.528782:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.529054:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273297920 00000100:00100000:3.0:1746065159.529062:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273297920 00000100:00100000:3.0:1746065159.529135:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14012 00000100:00100000:3.0:1746065159.529143:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273297920:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065159.529170:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f881436 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.529182:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.529185:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.529189:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f881436 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.529200:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f881436 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.530229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.531007:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273298176 00000100:00100000:0.0:1746065159.531013:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273298176 00000100:00100000:0.0:1746065159.531058:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14013 00000100:00100000:0.0:1746065159.531065:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273298176:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065159.531104:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f88143d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.531115:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.531116:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.531120:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f88143d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.531129:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f88143d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.540335:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f881436 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.540349:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f881436 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.540357:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f881436 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.540363:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a09fb200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065159.540366:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f881436 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.540373:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f881436 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.540388:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f881436 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.540395:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09fb200/0x392ae0376f881436 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.541023:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f88143d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.541031:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f88143d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.541036:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f88143d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.541040:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091064800 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065159.541042:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f88143d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.541047:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f88143d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.541057:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f88143d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.541061:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091064800/0x392ae0376f88143d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.541941:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273298176:12345-192.168.202.8@tcp:3:dd.0 Request processed in 10873us (11710us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065159.541950:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14013 00000100:00100000:3.0:1746065159.542405:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273297920:12345-192.168.202.8@tcp:3:dd.0 Request processed in 13262us (13628us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.542413:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14012 00000100:00100000:2.0:1746065159.546545:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.546618:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273298560 00000100:00100000:3.0:1746065159.546625:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273298560 00000100:00100000:3.0:1746065159.546727:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14014 00000100:00100000:3.0:1746065159.546734:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273298560:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:3.0:1746065159.546779:0:20722:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d706, atime: 0x0, ctime: 0x6812d706, blocks: 0xc800 00010000:00010000:3.0:1746065159.546787:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881444 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.546797:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.546799:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.546803:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.546922:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.547427:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.547813:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273298688 00000100:00100000:1.0:1746065159.547817:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273298688 00002000:00100000:1.0:1746065159.547838:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (0->4194303) req@ffff88009f9f8e00 x1830881273298688/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.547846:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f8e00 with x1830881273298688 ext(0->4194303) 00002000:00010000:1.0:1746065159.547850:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9f8e00 00000100:00100000:1.0:1746065159.547870:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14015 00000100:00100000:1.0:1746065159.547874:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+10:2005:x1830881273298688:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065159.559205:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.560666:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273298944 00000100:00100000:3.0:1746065159.560675:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273298944 00002000:00100000:3.0:1746065159.560713:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1c:0x0] (0->4194303) req@ffff88009f9f8000 x1830881273298944/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.560722:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f8000 with x1830881273298944 ext(0->4194303) 00002000:00010000:3.0:1746065159.560726:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9f8000 00000100:00100000:3.0:1746065159.560744:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14016 00000100:00100000:3.0:1746065159.560762:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2004:x1830881273298944:12345-192.168.202.8@tcp:4:dd.0 00000001:00080000:1.0:1746065159.582794:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970762 is committed 00010000:00010000:3.0:1746065159.583944:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.583956:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881444 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.583963:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881444 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.583969:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a09fac00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065159.583972:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881444 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.583979:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881444 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.583993:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881444 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.583999:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09fac00/0x392ae0376f881444 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.584116:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273298560:12345-192.168.202.8@tcp:4:dd.0 Request processed in 37378us (37573us total) trans 4294970762 rc 0/0 00000100:00100000:3.0:1746065159.584125:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14014 00000100:00100000:1.0:1746065159.600827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.600894:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273299328 00000100:00100000:3.0:1746065159.600901:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273299328 00000100:00100000:3.0:1746065159.600951:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14017 00000100:00100000:3.0:1746065159.600958:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273299328:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065159.600989:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f88144b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.601000:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.601002:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.601006:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f88144b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.601017:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f88144b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.601734:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.602435:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273299456 00000100:00100000:3.0:1746065159.602440:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273299456 00000100:00100000:3.0:1746065159.602475:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14018 00000100:00100000:3.0:1746065159.602481:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801237b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273299456:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065159.602500:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881452 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.602508:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.602515:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.602519:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881452 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.602528:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881452 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.603257:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273298688:12345-192.168.202.8@tcp:4:dd.0 Request processed in 55379us (55827us total) trans 4294970763 rc 0/0 00000100:00100000:1.0:1746065159.603267:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14015 00002000:00100000:1.0:1746065159.603276:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (0->4194303) req@ffff88009f9f8e00 x1830881273298688/t4294970763(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/448 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.603284:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f8e00 with x1830881273298688 ext(0->4194303) 00002000:00010000:1.0:1746065159.603288:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9f8e00 00000100:00100000:3.0:1746065159.615323:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065159.622117:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f88144b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.622135:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f88144b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.622142:0:20722:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f88144b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.622148:0:20722:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727dec00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065159.622152:0:20722:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f88144b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.622159:0:20722:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f88144b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.622174:0:20722:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f88144b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.622180:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727dec00/0x392ae0376f88144b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.622241:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273299328:12345-192.168.202.8@tcp:3:dd.0 Request processed in 21280us (21417us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.622249:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14017 00000100:00100000:3.0:1746065159.622267:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273299712 00000100:00100000:3.0:1746065159.622273:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273299712 00002000:00100000:3.0:1746065159.622297:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (4194304->8388607) req@ffff880072979f80 x1830881273299712/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.622311:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072979f80 with x1830881273299712 ext(4194304->8388607) 00002000:00010000:3.0:1746065159.622315:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072979f80 00000100:00100000:3.0:1746065159.622329:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14019 00000100:00100000:3.0:1746065159.622335:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273299712:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065159.631657:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+16:2004:x1830881273298944:12345-192.168.202.8@tcp:4:dd.0 Request processed in 70899us (72451us total) trans 4294972168 rc 0/0 00000100:00100000:0.0:1746065159.631669:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14016 00002000:00100000:0.0:1746065159.631678:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1c:0x0] (0->4194303) req@ffff88009f9f8000 x1830881273298944/t4294972168(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/448 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.631687:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9f8000 with x1830881273298944 ext(0->4194303) 00002000:00010000:0.0:1746065159.631692:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9f8000 00000100:00100000:0.0:1746065159.631770:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.631789:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273299968 00000100:00100000:0.0:1746065159.631795:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273299968 00002000:00100000:0.0:1746065159.631823:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1c:0x0] (4194304->8388607) req@ffff88008b789c00 x1830881273299968/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.631830:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789c00 with x1830881273299968 ext(4194304->8388607) 00002000:00010000:0.0:1746065159.631833:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789c00 00000100:00100000:0.0:1746065159.631845:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14020 00000100:00100000:0.0:1746065159.631851:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+16:2004:x1830881273299968:12345-192.168.202.8@tcp:4:dd.0 00010000:00010000:0.0:1746065159.635165:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881452 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.635178:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881452 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.635185:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881452 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.635191:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a09fb000 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065159.635194:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881452 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.635202:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881452 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.635217:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881452 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.635222:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09fb000/0x392ae0376f881452 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.635266:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801237b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273299456:12345-192.168.202.8@tcp:3:dd.0 Request processed in 32781us (33529us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065159.635274:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14018 00000100:00100000:3.0:1746065159.649655:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.650040:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273300224 00000100:00100000:0.0:1746065159.650048:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273300224 00000100:00100000:1.0:1746065159.651242:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14021 00000100:00100000:1.0:1746065159.651253:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273300224:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1746065159.651295:0:27162:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d706, atime: 0x0, ctime: 0x6812d706, blocks: 0xc800 00010000:00010000:1.0:1746065159.651302:0:27162:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881459 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.651312:0:27162:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.651314:0:27162:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.651317:0:27162:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.651328:0:27162:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.658696:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.658774:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273300480 00000100:00100000:0.0:1746065159.658782:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273300480 00002000:00100000:0.0:1746065159.658813:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1c:0x0] (8388608->12582911) req@ffff880072f9ad80 x1830881273300480/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.658822:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9ad80 with x1830881273300480 ext(8388608->12582911) 00002000:00010000:0.0:1746065159.658827:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f9ad80 00000100:00100000:0.0:1746065159.658843:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14022 00000100:00100000:0.0:1746065159.658848:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2005:x1830881273300480:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:2.0:1746065159.669019:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.669120:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273300736 00000100:00100000:1.0:1746065159.669128:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273300736 00002000:00100000:1.0:1746065159.669192:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (8388608->12582911) req@ffff88009f938a80 x1830881273300736/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.669201:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938a80 with x1830881273300736 ext(8388608->12582911) 00002000:00010000:1.0:1746065159.669217:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938a80 00000100:00100000:1.0:1746065159.669260:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14023 00000100:00100000:1.0:1746065159.669271:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+18:2004:x1830881273300736:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:3.0:1746065159.676727:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.681933:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273300992 00000100:00100000:1.0:1746065159.681943:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273300992 00000100:00100000:1.0:1746065159.681999:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 212 00000100:00100000:1.0:1746065159.682004:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+24:3826:x1830881273300992:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:1.0:1746065159.682176:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+25:3826:x1830881273300992:12345-192.168.202.8@tcp:35:dd.0 Request processed in 172us (5457us total) trans 4294983641 rc 0/0 00000100:00100000:1.0:1746065159.682181:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 212 00000100:00100000:2.0:1746065159.693847:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+16:2005:x1830881273299712:12345-192.168.202.8@tcp:4:dd.0 Request processed in 71504us (78523us total) trans 4294970764 rc 0/0 00000100:00100000:2.0:1746065159.693859:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14019 00002000:00100000:2.0:1746065159.693871:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (4194304->8388607) req@ffff880072979f80 x1830881273299712/t4294970764(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/448 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.693881:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072979f80 with x1830881273299712 ext(4194304->8388607) 00002000:00010000:2.0:1746065159.693887:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072979f80 00000100:00100000:2.0:1746065159.703242:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.703329:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273301248 00000100:00100000:0.0:1746065159.703336:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273301248 00000100:00100000:0.0:1746065159.703663:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 213 00000100:00100000:0.0:1746065159.703671:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+25:3826:x1830881273301248:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:0.0:1746065159.704213:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+26:3826:x1830881273301248:12345-192.168.202.8@tcp:35:dd.0 Request processed in 542us (977us total) trans 4294983642 rc 0/0 00000100:00100000:0.0:1746065159.704219:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 213 00000100:00100000:2.0:1746065159.713633:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2004:x1830881273299968:12345-192.168.202.8@tcp:4:dd.0 Request processed in 81772us (81853us total) trans 4294972169 rc 0/0 00000100:00100000:2.0:1746065159.713646:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14020 00002000:00100000:2.0:1746065159.713657:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1c:0x0] (4194304->8388607) req@ffff88008b789c00 x1830881273299968/t4294972169(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/448 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.713666:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b789c00 with x1830881273299968 ext(4194304->8388607) 00002000:00010000:2.0:1746065159.713672:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b789c00 00000001:00080000:1.0:1746065159.720633:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970765 is committed 00000001:00080000:1.0:1746065159.720645:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970764 is committed 00010000:00010000:0.0:1746065159.720830:0:27162:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.720842:0:27162:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881459 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.720850:0:27162:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881459 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.720855:0:27162:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b6ca00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065159.720860:0:27162:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881459 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.720867:0:27162:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881459 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.720882:0:27162:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881459 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.720888:0:27162:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881459 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.720969:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273300224:12345-192.168.202.8@tcp:4:dd.0 Request processed in 69715us (71317us total) trans 4294970765 rc 0/0 00000100:00100000:0.0:1746065159.720980:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14021 00000100:00100000:2.0:1746065159.732746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.732790:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.732801:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273301632 00000100:00100000:1.0:1746065159.732808:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273301632 00000100:00100000:1.0:1746065159.732861:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273301760 00000100:00100000:1.0:1746065159.732865:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273301760 00000100:00100000:1.0:1746065159.732896:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14024 00000100:00100000:1.0:1746065159.732902:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273301632:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1746065159.732930:0:27162:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881460 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.732942:0:27162:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.732944:0:27162:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.732948:0:27162:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881460 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.732958:0:27162:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881460 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.733107:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14025 00000100:00100000:2.0:1746065159.733115:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273301760:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065159.733135:0:27161:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88007c0a0c00/0x392ae0376f881467 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.733143:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.733145:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.733147:0:27161:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0a0c00/0x392ae0376f881467 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.733156:0:27161:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c0a0c00/0x392ae0376f881467 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.754834:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273300480:12345-192.168.202.8@tcp:4:dd.0 Request processed in 95977us (96137us total) trans 4294970766 rc 0/0 00000100:00100000:0.0:1746065159.754845:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14022 00002000:00100000:0.0:1746065159.754856:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1c:0x0] (8388608->12582911) req@ffff880072f9ad80 x1830881273300480/t4294970766(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/448 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.754865:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9ad80 with x1830881273300480 ext(8388608->12582911) 00002000:00010000:0.0:1746065159.754869:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f9ad80 00010000:00010000:3.0:1746065159.755771:0:27161:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88007c0a0c00/0x392ae0376f881467 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.755781:0:27161:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0a0c00/0x392ae0376f881467 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.755788:0:27161:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c0a0c00/0x392ae0376f881467 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.755794:0:27161:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007c0a0c00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065159.755798:0:27161:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c0a0c00/0x392ae0376f881467 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.755803:0:27161:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c0a0c00/0x392ae0376f881467 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.755820:0:27161:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c0a0c00/0x392ae0376f881467 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.755825:0:27161:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c0a0c00/0x392ae0376f881467 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.755883:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273301760:12345-192.168.202.8@tcp:3:dd.0 Request processed in 22769us (23091us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.755890:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14025 00010000:00010000:1.0:1746065159.765866:0:27162:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881460 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.765879:0:27162:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881460 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.765886:0:27162:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881460 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.765897:0:27162:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b6ca00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065159.765899:0:27162:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881460 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.765905:0:27162:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881460 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.765920:0:27162:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881460 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.765926:0:27162:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b6ca00/0x392ae0376f881460 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.765999:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273301632:12345-192.168.202.8@tcp:3:dd.0 Request processed in 33093us (33257us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.766008:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14024 00000100:00100000:3.0:1746065159.775046:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.775129:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273302016 00000100:00100000:1.0:1746065159.775137:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273302016 00000100:00100000:1.0:1746065159.775188:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14026 00000100:00100000:1.0:1746065159.775194:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273302016:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1746065159.775230:0:27162:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d706, atime: 0x0, ctime: 0x6812d706, blocks: 0xc800 00010000:00010000:1.0:1746065159.775237:0:27162:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f88146e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.775247:0:27162:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.775248:0:27162:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.775253:0:27162:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f88146e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.775263:0:27162:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f88146e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.775397:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2004:x1830881273300736:12345-192.168.202.8@tcp:4:dd.0 Request processed in 106128us (106383us total) trans 4294972170 rc 0/0 00000100:00100000:0.0:1746065159.775405:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14023 00002000:00100000:0.0:1746065159.775413:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (8388608->12582911) req@ffff88009f938a80 x1830881273300736/t4294972170(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:75/0 lens 488/448 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.775420:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938a80 with x1830881273300736 ext(8388608->12582911) 00002000:00010000:0.0:1746065159.775424:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938a80 00000001:00080000:2.0:1746065159.789808:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970767 is committed 00000001:00080000:2.0:1746065159.789821:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970766 is committed 00002000:00010000:1.0:1746065159.789996:0:27162:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb mtime from disk: 1746065158 -> 1746065159 00002000:00010000:1.0:1746065159.790000:0:27162:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x1b:0x0] updating lvb ctime from disk: 1746065158 -> 1746065159 00010000:00010000:1.0:1746065159.790009:0:27162:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f88146e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.790020:0:27162:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f88146e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.790026:0:27162:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f88146e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.790031:0:27162:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0b7ce00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065159.790034:0:27162:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f88146e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.790040:0:27162:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f88146e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.790053:0:27162:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f88146e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.790057:0:27162:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0b7ce00/0x392ae0376f88146e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.790152:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273302016:12345-192.168.202.8@tcp:4:dd.0 Request processed in 14954us (15109us total) trans 4294970767 rc 0/0 00000100:00100000:1.0:1746065159.790160:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14026 00000100:00100000:3.0:1746065159.793256:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.793397:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.793444:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273302400 00000100:00100000:1.0:1746065159.793452:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273302400 00000100:00100000:1.0:1746065159.793505:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273302528 00000100:00100000:1.0:1746065159.793508:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273302528 00000100:00100000:1.0:1746065159.793525:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14027 00000100:00100000:1.0:1746065159.793531:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273302400:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1746065159.793561:0:27162:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881475 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.793572:0:27162:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.793573:0:27162:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.793578:0:27162:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881475 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.793589:0:27162:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881475 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.794130:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14028 00000100:00100000:1.0:1746065159.794136:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273302528:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1746065159.794155:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f88f200/0x392ae0376f88147c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.794162:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.794164:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.794166:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f88f200/0x392ae0376f88147c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.794174:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f88f200/0x392ae0376f88147c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.804347:0:27162:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881475 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.804362:0:27162:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881475 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.804369:0:27162:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881475 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.804380:0:27162:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007c0a0c00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065159.804384:0:27162:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881475 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.804391:0:27162:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881475 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.804406:0:27162:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881475 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.804411:0:27162:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c0a0c00/0x392ae0376f881475 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27162 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.804488:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273302400:12345-192.168.202.8@tcp:3:dd.0 Request processed in 10952us (11411us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.804498:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14027 00010000:00010000:1.0:1746065159.805532:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f88f200/0x392ae0376f88147c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.805541:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f88f200/0x392ae0376f88147c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.805547:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f88f200/0x392ae0376f88147c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.805552:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f88f200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065159.805555:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f88f200/0x392ae0376f88147c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.805561:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f88f200/0x392ae0376f88147c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.805572:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f88f200/0x392ae0376f88147c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.805577:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f88f200/0x392ae0376f88147c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.805626:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273302528:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11487us (12227us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.805633:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14028 00000100:00100000:3.0:1746065159.809819:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.809922:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273302784 00000100:00100000:1.0:1746065159.809931:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273302784 00000100:00100000:1.0:1746065159.809996:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14029 00000100:00100000:1.0:1746065159.810003:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273302784:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1746065159.810041:0:27166:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d707, atime: 0x0, ctime: 0x6812d707, blocks: 0xc800 00010000:00010000:1.0:1746065159.810048:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f881483 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.810058:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.810060:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.810063:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f881483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.810074:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f881483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746065159.828063:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970768 is committed 00010000:00010000:1.0:1746065159.828199:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f881483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.828208:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f881483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.828213:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f881483 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.828217:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ddfc400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065159.828220:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f881483 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.828224:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f881483 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.828239:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f881483 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.828245:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ddfc400/0x392ae0376f881483 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.828344:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273302784:12345-192.168.202.8@tcp:4:dd.0 Request processed in 18338us (18528us total) trans 4294970768 rc 0/0 00000100:00100000:1.0:1746065159.828353:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14029 00000100:00100000:3.0:1746065159.832059:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.832216:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.832464:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273303168 00000100:00100000:1.0:1746065159.832471:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273303168 00000100:00100000:1.0:1746065159.832514:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273303296 00000100:00100000:1.0:1746065159.832516:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273303296 00000100:00100000:1.0:1746065159.832813:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14030 00000100:00100000:1.0:1746065159.832820:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273303168:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1746065159.832848:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072a5cc00/0x392ae0376f88148a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.832860:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.832862:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.832866:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072a5cc00/0x392ae0376f88148a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.832876:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072a5cc00/0x392ae0376f88148a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.833406:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14031 00000100:00100000:3.0:1746065159.833413:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273303296:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065159.833429:0:27161:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f881491 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.833435:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.833436:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.833438:0:27161:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f881491 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.833445:0:27161:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f881491 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.846159:0:27161:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f881491 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.846173:0:27161:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f881491 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.846179:0:27161:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f881491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.846186:0:27161:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072efa400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065159.846190:0:27161:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f881491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.846196:0:27161:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f881491 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.846210:0:27161:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f881491 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.846215:0:27161:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f881491 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.846271:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273303296:12345-192.168.202.8@tcp:3:dd.0 Request processed in 12855us (14051us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.846279:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14031 00010000:00010000:1.0:1746065159.846660:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072a5cc00/0x392ae0376f88148a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.846667:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072a5cc00/0x392ae0376f88148a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.846672:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072a5cc00/0x392ae0376f88148a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.846676:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072a5cc00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065159.846678:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072a5cc00/0x392ae0376f88148a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.846682:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072a5cc00/0x392ae0376f88148a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.846691:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072a5cc00/0x392ae0376f88148a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.846695:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072a5cc00/0x392ae0376f88148a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.846949:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273303168:12345-192.168.202.8@tcp:3:dd.0 Request processed in 14128us (14896us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.846963:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14030 00000100:00100000:3.0:1746065159.851799:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.851944:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273303552 00000100:00100000:1.0:1746065159.851953:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273303552 00000100:00100000:1.0:1746065159.852077:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14032 00000100:00100000:1.0:1746065159.852179:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273303552:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1746065159.852220:0:27166:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d707, atime: 0x0, ctime: 0x6812d707, blocks: 0xc800 00010000:00010000:1.0:1746065159.852227:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f881498 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.852237:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.852238:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.852243:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f881498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.852253:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f881498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746065159.868144:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970769 is committed 00010000:00010000:2.0:1746065159.868334:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f881498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.868348:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f881498 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.868356:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f881498 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.868363:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072615200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065159.868367:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f881498 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.868378:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f881498 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.868395:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f881498 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.868401:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072615200/0x392ae0376f881498 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.868499:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273303552:12345-192.168.202.8@tcp:4:dd.0 Request processed in 16319us (16703us total) trans 4294970769 rc 0/0 00000100:00100000:2.0:1746065159.868509:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14032 00000100:00100000:1.0:1746065159.871536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.871579:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.871614:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273303936 00000100:00100000:1.0:1746065159.871623:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273303936 00000100:00100000:1.0:1746065159.871669:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273304064 00000100:00100000:1.0:1746065159.871671:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273304064 00000100:00100000:1.0:1746065159.871916:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14033 00000100:00100000:1.0:1746065159.871925:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273303936:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1746065159.871959:0:27161:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072615600/0x392ae0376f88149f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.871973:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.871976:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.871980:0:27161:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072615600/0x392ae0376f88149f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.871983:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14034 00010000:00010000:1.0:1746065159.871993:0:27161:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072615600/0x392ae0376f88149f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.872000:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273304064:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065159.872043:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f8814a6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.872055:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.872056:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.872061:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f8814a6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.872072:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f8814a6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.891612:0:27161:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072615600/0x392ae0376f88149f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.891630:0:27161:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072615600/0x392ae0376f88149f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.891638:0:27161:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072615600/0x392ae0376f88149f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.891645:0:27161:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072615600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065159.891649:0:27161:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072615600/0x392ae0376f88149f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.891656:0:27161:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072615600/0x392ae0376f88149f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.891675:0:27161:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072615600/0x392ae0376f88149f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.891682:0:27161:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072615600/0x392ae0376f88149f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.892334:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273303936:12345-192.168.202.8@tcp:3:dd.0 Request processed in 19850us (20247us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.892346:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14033 00010000:00010000:2.0:1746065159.893069:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f8814a6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.893112:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f8814a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.893120:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f8814a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.893126:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072efa400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065159.893129:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f8814a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.893136:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f8814a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.893152:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f8814a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.893158:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072efa400/0x392ae0376f8814a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.893226:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273304064:12345-192.168.202.8@tcp:3:dd.0 Request processed in 21233us (21645us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.893232:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14034 00000100:00100000:0.0:1746065159.896506:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.896564:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273304320 00000100:00100000:2.0:1746065159.896573:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273304320 00000100:00100000:2.0:1746065159.896625:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14035 00000100:00100000:2.0:1746065159.896630:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273304320:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:2.0:1746065159.896662:0:27166:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d707, atime: 0x0, ctime: 0x6812d707, blocks: 0xc800 00010000:00010000:2.0:1746065159.896668:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072825a00/0x392ae0376f8814ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.896677:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.896678:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.896681:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072825a00/0x392ae0376f8814ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.896689:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072825a00/0x392ae0376f8814ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746065159.912970:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970770 is committed 00010000:00010000:0.0:1746065159.913124:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072825a00/0x392ae0376f8814ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.913135:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072825a00/0x392ae0376f8814ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.913142:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072825a00/0x392ae0376f8814ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.913154:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072825a00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065159.913158:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072825a00/0x392ae0376f8814ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.913165:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072825a00/0x392ae0376f8814ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.913181:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072825a00/0x392ae0376f8814ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.913186:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072825a00/0x392ae0376f8814ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.913355:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273304320:12345-192.168.202.8@tcp:4:dd.0 Request processed in 16720us (16853us total) trans 4294970770 rc 0/0 00000100:00100000:2.0:1746065159.913364:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14035 00000100:00100000:0.0:1746065159.916248:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065159.916309:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065159.916676:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273304576 00000100:00100000:2.0:1746065159.916684:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273304576 00000100:00100000:1.0:1746065159.916726:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273304832 00000100:00100000:1.0:1746065159.916731:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273304832 00000100:00100000:2.0:1746065159.916747:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14036 00000100:00100000:2.0:1746065159.916767:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273304576:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:1.0:1746065159.916788:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14037 00000100:00100000:1.0:1746065159.916794:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273304832:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065159.916797:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f8814b4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.916809:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.916810:0:27161:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012bd75c00/0x392ae0376f8814bb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.916811:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.916815:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f8814b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.916818:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.916819:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.916822:0:27161:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd75c00/0x392ae0376f8814bb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.916826:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f8814b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.916830:0:27161:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd75c00/0x392ae0376f8814bb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.926981:0:27161:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012bd75c00/0x392ae0376f8814bb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.926995:0:27161:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd75c00/0x392ae0376f8814bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.927002:0:27161:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012bd75c00/0x392ae0376f8814bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.927289:0:27161:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bd75c00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065159.927292:0:27161:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bd75c00/0x392ae0376f8814bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.927300:0:27161:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bd75c00/0x392ae0376f8814bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.927319:0:27161:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012bd75c00/0x392ae0376f8814bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.927324:0:27161:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd75c00/0x392ae0376f8814bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.927772:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273304832:12345-192.168.202.8@tcp:3:dd.0 Request processed in 10972us (11457us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.927782:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14037 00010000:00010000:3.0:1746065159.927788:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f8814b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.927797:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f8814b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.927803:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f8814b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.927808:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072824a00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065159.927810:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f8814b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.927815:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f8814b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.927824:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f8814b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.927833:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072824a00/0x392ae0376f8814b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.927868:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273304576:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11101us (11626us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.927874:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14036 00000100:00100000:0.0:1746065159.932328:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.932543:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273305088 00000100:00100000:3.0:1746065159.932552:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273305088 00000100:00100000:3.0:1746065159.932612:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14038 00000100:00100000:3.0:1746065159.932620:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273305088:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:3.0:1746065159.932659:0:27166:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d707, atime: 0x0, ctime: 0x6812d707, blocks: 0xc800 00010000:00010000:3.0:1746065159.932665:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072efa400/0x392ae0376f8814c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.932677:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.932678:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.932682:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072efa400/0x392ae0376f8814c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.932692:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072efa400/0x392ae0376f8814c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746065159.951457:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970771 is committed 00010000:00010000:3.0:1746065159.951722:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072efa400/0x392ae0376f8814c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.951733:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072efa400/0x392ae0376f8814c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.951741:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072efa400/0x392ae0376f8814c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.951746:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072efa400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065159.951760:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072efa400/0x392ae0376f8814c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.951767:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072efa400/0x392ae0376f8814c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.951781:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072efa400/0x392ae0376f8814c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.951786:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072efa400/0x392ae0376f8814c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.951877:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273305088:12345-192.168.202.8@tcp:4:dd.0 Request processed in 19255us (19553us total) trans 4294970771 rc 0/0 00000100:00100000:3.0:1746065159.951886:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14038 00000100:00100000:0.0:1746065159.955837:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065159.955956:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273305344 00000100:00100000:3.0:1746065159.955965:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273305344 00000100:00100000:3.0:1746065159.956019:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14039 00000100:00100000:3.0:1746065159.956026:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273305344:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065159.956053:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8814c9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.956238:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.956240:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.956244:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8814c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.956255:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8814c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.958676:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.958732:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273305600 00000100:00100000:1.0:1746065159.958740:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273305600 00000100:00100000:1.0:1746065159.958794:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14040 00000100:00100000:1.0:1746065159.958801:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273305600:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:1.0:1746065159.958828:0:27161:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.958839:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.958840:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.958843:0:27161:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.958853:0:27161:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.964231:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8814c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.964245:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8814c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.964252:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8814c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.964258:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd11600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065159.964261:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8814c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.964267:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8814c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.964282:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8814c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.964287:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f8814c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.964359:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2002:x1830881273305344:12345-192.168.202.8@tcp:3:dd.0 Request processed in 8329us (8531us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.964366:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14039 00010000:00010000:1.0:1746065159.969913:0:27161:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.969932:0:27161:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.969938:0:27161:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.969944:0:27161:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a89a00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065159.969947:0:27161:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.969953:0:27161:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.969965:0:27161:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.969970:0:27161:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.970042:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273305600:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11239us (11368us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.970050:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14040 00000100:00100000:0.0:1746065159.976865:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065159.977002:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273305856 00000100:00100000:1.0:1746065159.977010:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273305856 00000100:00100000:1.0:1746065159.977734:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14041 00000100:00100000:1.0:1746065159.977743:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273305856:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1746065159.977793:0:27161:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d707, atime: 0x0, ctime: 0x6812d707, blocks: 0xc800 00010000:00010000:1.0:1746065159.977800:0:27161:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.977810:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.977812:0:27161:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.977815:0:27161:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.977826:0:27161:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746065159.994376:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970772 is committed 00010000:00010000:1.0:1746065159.995580:0:27161:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.995592:0:27161:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.995599:0:27161:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.995604:0:27161:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a89a00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065159.995607:0:27161:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.995614:0:27161:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.995633:0:27161:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.995639:0:27161:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a89a00/0x392ae0376f8814d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27161 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.995733:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2005:x1830881273305856:12345-192.168.202.8@tcp:4:dd.0 Request processed in 17987us (18871us total) trans 4294970772 rc 0/0 00000100:00100000:1.0:1746065159.995742:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14041 00000100:00100000:0.0:1746065160.000281:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.000325:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.000603:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273306240 00000100:00100000:3.0:1746065160.000611:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273306240 00000100:00100000:3.0:1746065160.000658:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273306368 00000100:00100000:3.0:1746065160.000659:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273306368 00000100:00100000:3.0:1746065160.000695:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14042 00000100:00100000:3.0:1746065160.000701:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273306240:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065160.000726:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f8814de lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.000736:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.000738:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.000742:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f8814de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.000763:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f8814de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746065160.001478:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065160.001482:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065160.001497:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14043 00000100:00100000:0.0:1746065160.001505:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273306368:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:0.0:1746065160.001523:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f8814e5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.001531:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.001532:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.001535:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f8814e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.001544:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f8814e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.008928:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f8814de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.008944:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f8814de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.008950:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f8814de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.008957:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd11800 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065160.008961:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f8814de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.008968:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f8814de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.008984:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f8814de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.008989:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd11800/0x392ae0376f8814de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.009248:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273306240:12345-192.168.202.8@tcp:3:dd.0 Request processed in 8543us (8969us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746065160.009254:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f8814e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.009256:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14042 00010000:00010000:1.0:1746065160.009261:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f8814e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.009266:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f8814e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.009270:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d184c00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065160.009272:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f8814e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.009278:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f8814e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.009287:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f8814e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.009296:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d184c00/0x392ae0376f8814e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.009323:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2004:x1830881273306368:12345-192.168.202.8@tcp:3:dd.0 Request processed in 7820us (8997us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065160.009329:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14043 00000100:00100000:0.0:1746065160.012130:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.012215:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273306624 00000100:00100000:1.0:1746065160.012223:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273306624 00000100:00100000:1.0:1746065160.012284:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14044 00000100:00100000:1.0:1746065160.012290:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273306624:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:1.0:1746065160.012326:0:27163:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d707, atime: 0x0, ctime: 0x6812d707, blocks: 0xc800 00010000:00010000:1.0:1746065160.012333:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f8814ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.012342:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.012344:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.012348:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f8814ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.012359:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f8814ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746065160.025949:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970773 is committed 00010000:00010000:1.0:1746065160.026381:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f8814ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.026393:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f8814ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.026402:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f8814ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.026409:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98f200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:1.0:1746065160.026412:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f8814ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.026419:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f8814ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.026436:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f8814ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.026442:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x392ae0376f8814ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.026553:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273306624:12345-192.168.202.8@tcp:4:dd.0 Request processed in 14258us (14423us total) trans 4294970773 rc 0/0 00000100:00100000:1.0:1746065160.026562:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14044 00000100:00100000:1.0:1746065160.030336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.030591:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273307008 00000100:00100000:2.0:1746065160.030600:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273307008 00000100:00100000:1.0:1746065160.030610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.030715:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273307136 00000100:00100000:2.0:1746065160.030718:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273307136 00000100:00100000:3.0:1746065160.030722:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14045 00000100:00100000:3.0:1746065160.030730:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273307008:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065160.030771:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f835600/0x392ae0376f8814f3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.030784:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.030785:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.030789:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f835600/0x392ae0376f8814f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.030803:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14046 00010000:00010000:3.0:1746065160.030806:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f835600/0x392ae0376f8814f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.030808:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273307136:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065160.030823:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f02c400/0x392ae0376f8814fa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.030829:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.030830:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.030832:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f02c400/0x392ae0376f8814fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.030840:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f02c400/0x392ae0376f8814fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.038966:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f02c400/0x392ae0376f8814fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.038982:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f02c400/0x392ae0376f8814fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.038990:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f02c400/0x392ae0376f8814fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.038995:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f02c400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065160.038998:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f02c400/0x392ae0376f8814fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.039005:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f02c400/0x392ae0376f8814fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.039021:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f02c400/0x392ae0376f8814fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.039026:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f02c400/0x392ae0376f8814fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.040489:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273307136:12345-192.168.202.8@tcp:3:dd.0 Request processed in 9673us (9870us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.040499:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14046 00010000:00010000:3.0:1746065160.043280:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f835600/0x392ae0376f8814f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.043295:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f835600/0x392ae0376f8814f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.043303:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f835600/0x392ae0376f8814f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.043308:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f835600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065160.043312:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f835600/0x392ae0376f8814f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.043318:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f835600/0x392ae0376f8814f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.043331:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f835600/0x392ae0376f8814f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.043336:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f835600/0x392ae0376f8814f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.043403:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273307008:12345-192.168.202.8@tcp:3:dd.0 Request processed in 12670us (13071us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065160.043416:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14045 00000100:00100000:0.0:1746065160.048204:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.048776:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273307392 00000100:00100000:3.0:1746065160.048785:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273307392 00000100:00100000:3.0:1746065160.048839:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14047 00000100:00100000:3.0:1746065160.048845:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273307392:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:3.0:1746065160.048881:0:27166:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d707, atime: 0x0, ctime: 0x6812d707, blocks: 0xc800 00010000:00010000:3.0:1746065160.048888:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f881501 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.048898:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.048900:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.048904:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f881501 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.048915:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f881501 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746065160.075367:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970774 is committed 00010000:00010000:3.0:1746065160.075610:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f881501 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.075622:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f881501 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.075628:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f881501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.075634:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072568800 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065160.075637:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f881501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.075644:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f881501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.075658:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f881501 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.075662:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072568800/0x392ae0376f881501 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.078977:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273307392:12345-192.168.202.8@tcp:4:dd.0 Request processed in 30122us (30770us total) trans 4294970774 rc 0/0 00000100:00100000:3.0:1746065160.078989:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14047 00000100:00100000:0.0:1746065160.083266:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.083316:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.084432:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273307776 00000100:00100000:3.0:1746065160.084441:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273307776 00000100:00100000:3.0:1746065160.084485:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273307904 00000100:00100000:3.0:1746065160.084487:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273307904 00000100:00100000:3.0:1746065160.084505:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14048 00000100:00100000:3.0:1746065160.084512:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273307776:12345-192.168.202.8@tcp:3:dd.0 00000100:00100000:2.0:1746065160.084782:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14049 00000100:00100000:2.0:1746065160.084791:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273307904:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065160.084810:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072615e00/0x392ae0376f881508 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.084822:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.084823:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.084827:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072615e00/0x392ae0376f881508 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.084838:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072615e00/0x392ae0376f881508 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.085933:0:27166:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072569e00/0x392ae0376f88150f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.085944:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.085945:0:27166:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.085948:0:27166:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072569e00/0x392ae0376f88150f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.085961:0:27166:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072569e00/0x392ae0376f88150f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.094839:0:27166:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072569e00/0x392ae0376f88150f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.094852:0:27166:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880072569e00/0x392ae0376f88150f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.094860:0:27166:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880072569e00/0x392ae0376f88150f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.094867:0:27166:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072569e00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065160.094870:0:27166:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880072569e00/0x392ae0376f88150f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.094877:0:27166:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880072569e00/0x392ae0376f88150f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.094894:0:27166:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880072569e00/0x392ae0376f88150f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.094899:0:27166:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072569e00/0x392ae0376f88150f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27166 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.095275:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273307776:12345-192.168.202.8@tcp:3:dd.0 Request processed in 10758us (12011us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065160.095287:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14048 00010000:00010000:2.0:1746065160.095740:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880072615e00/0x392ae0376f881508 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.095757:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072615e00/0x392ae0376f881508 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.095762:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072615e00/0x392ae0376f881508 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.095767:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072615e00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065160.095771:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072615e00/0x392ae0376f881508 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.095776:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072615e00/0x392ae0376f881508 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.095786:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072615e00/0x392ae0376f881508 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.095790:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072615e00/0x392ae0376f881508 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.095828:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2003:x1830881273307904:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11039us (12511us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.095833:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14049 00000100:00100000:2.0:1746065160.101944:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.102018:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273308160 00000100:00100000:0.0:1746065160.102026:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273308160 00000100:00100000:0.0:1746065160.102109:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14050 00000100:00100000:0.0:1746065160.102116:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273308160:12345-192.168.202.8@tcp:4:dd.0 00002000:00010000:0.0:1746065160.102154:0:27163:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d707, atime: 0x0, ctime: 0x6812d707, blocks: 0xc800 00010000:00010000:0.0:1746065160.102161:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f881516 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.102171:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.102173:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.102176:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f881516 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.102186:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f881516 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746065160.123710:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970775 is committed 00010000:00010000:0.0:1746065160.124151:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f881516 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.124163:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f881516 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.124171:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f881516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.124176:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b21200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065160.124179:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f881516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.124185:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f881516 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.124198:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f881516 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.124203:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f881516 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.124863:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2002:x1830881273308160:12345-192.168.202.8@tcp:4:dd.0 Request processed in 22742us (22920us total) trans 4294970775 rc 0/0 00000100:00100000:0.0:1746065160.124872:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14050 00000100:00100000:0.0:1746065160.130644:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.131049:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273308416 00000100:00100000:2.0:1746065160.131057:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273308416 00000100:00100000:2.0:1746065160.131201:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14051 00000100:00100000:2.0:1746065160.131209:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273308416:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065160.131239:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88151d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.131250:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.131252:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.131256:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88151d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.131270:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88151d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.138408:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88151d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.138424:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88151d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.138432:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88151d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.138439:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072614200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065160.138442:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88151d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.138449:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88151d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.138465:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88151d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.138471:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072614200/0x392ae0376f88151d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.138841:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273308416:12345-192.168.202.8@tcp:3:dd.0 Request processed in 7629us (8198us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.138853:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14051 00000100:00100000:0.0:1746065160.141356:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.141476:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273308544 00000100:00100000:1.0:1746065160.141484:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273308544 00000100:00100000:1.0:1746065160.141524:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30888 00000100:00100000:1.0:1746065160.141529:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:3825:x1830881273308544:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065160.141542:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.141558:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fecf400/0x392ae0376f881524 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6df0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065160.141575:0:9642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 26214400, mtime: 0x6812d707, atime: 0x0, ctime: 0x6812d707, blocks: 0xc800 00010000:00010000:1.0:1746065160.141592:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.141594:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.141600:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fecf400/0x392ae0376f881524 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 25165824->26214399) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6df0 expref: 8 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.141616:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fecf400/0x392ae0376f881524 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 25165824->26214399) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6df0 expref: 8 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.141624:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fecf400, rc 0) 00000100:00100000:1.0:1746065160.141656:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:3825:x1830881273308544:12345-192.168.202.8@tcp:101:dd.0 Request processed in 126us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.141661:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30888 00000100:00100000:0.0:1746065160.156278:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.156340:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273308672 00000100:00100000:2.0:1746065160.156348:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273308672 00002000:00100000:2.0:1746065160.156383:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1b:0x0] (25165824->26214399) req@ffff88009f4e8e00 x1830881273308672/t0(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.156391:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8e00 with x1830881273308672 ext(25165824->26214399) 00002000:00010000:2.0:1746065160.156396:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4e8e00 00000100:00100000:2.0:1746065160.156847:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14052 00000100:00100000:2.0:1746065160.156855:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273308672:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065160.168073:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273308672:12345-192.168.202.8@tcp:4:dd.0 Request processed in 11210us (11794us total) trans 4294970776 rc 0/0 00000100:00100000:0.0:1746065160.168100:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14052 00002000:00100000:0.0:1746065160.168111:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1b:0x0] (25165824->26214399) req@ffff88009f4e8e00 x1830881273308672/t4294970776(0) o4->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/448 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.168120:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e8e00 with x1830881273308672 ext(25165824->26214399) 00002000:00010000:0.0:1746065160.168125:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4e8e00 00000100:00100000:0.0:1746065160.170462:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.170517:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273308800 00000100:00100000:1.0:1746065160.170525:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273308800 00000100:00100000:1.0:1746065160.170564:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30889 00000100:00100000:1.0:1746065160.170571:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881273308800:12345-192.168.202.8@tcp:16:dd.0 00000001:00080000:2.0:1746065160.174615:0:9556:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294970776 is committed 00000100:00100000:1.0:1746065160.175911:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273308800:12345-192.168.202.8@tcp:16:dd.0 Request processed in 5333us (5447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.175922:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30889 00000100:00100000:0.0:1746065160.178130:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.178232:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273309056 00000100:00100000:2.0:1746065160.178239:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273309056 00000100:00100000:2.0:1746065160.178284:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 214 00000100:00100000:2.0:1746065160.178291:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+33:3825:x1830881273309056:12345-192.168.202.8@tcp:35:dd.0 00000100:00080000:0.0:1746065160.178481:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065160.179203:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:3825:x1830881273309056:12345-192.168.202.8@tcp:35:dd.0 Request processed in 912us (1076us total) trans 4294983643 rc 0/0 00000100:00100000:2.0:1746065160.179210:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 214 00000100:00100000:0.0:1746065160.192173:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.192361:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273309184 00000100:00100000:2.0:1746065160.192368:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273309184 00000100:00100000:2.0:1746065160.192548:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36595 00000100:00100000:2.0:1746065160.192555:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+34:3829:x1830881273309184:12345-192.168.202.8@tcp:101:checkstat.0 00010000:00010000:2.0:1746065160.192574:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.192586:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072614a00/0x392ae0376f88152b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6df7 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.192635:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072615e00/0x392ae0376f881532 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065160.192646:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072615e00/0x392ae0376f881532 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065160.192655:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072615e00/0x392ae0376f881532 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:2.0:1746065160.192689:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1746065160.192692:0:7213:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065160.192705:0:7213:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880072615e00/0x392ae0376f881532 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065160.192721:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072614a00/0x392ae0376f88152b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6df7 expref: 36 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.192756:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072615e00/0x392ae0376f881532 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6df7 expref: 35 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.192763:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065160.192766:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065160.192768:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072615e00, rc 0) 00000100:00100000:2.0:1746065160.192812:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:3829:x1830881273309184:12345-192.168.202.8@tcp:101:checkstat.0 Request processed in 257us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.192817:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36595 00000100:00100000:0.0:1746065160.196892:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.198342:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.198479:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273309312 00000100:00100000:3.0:1746065160.198487:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273309312 00000100:00100000:3.0:1746065160.198528:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36596 00000100:00100000:3.0:1746065160.198534:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:3829:x1830881273309312:12345-192.168.202.8@tcp:101:checkstat.0 00010000:00010000:3.0:1746065160.198550:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065160.198563:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6dfe expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.198608:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f881540 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198617:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f881540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198625:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f881540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198634:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881547 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198640:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198645:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198695:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f88154e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198702:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f88154e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198708:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f88154e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:3.0:1746065160.198735:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4b:0x0]: returning size 26214400 00000004:00200000:3.0:1746065160.198738:0:21520:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065160.198759:0:21520:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f88154e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198767:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f88154e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198772:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f881540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198777:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f881540 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198782:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f881540 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198786:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072568a00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065160.198790:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f881540 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198795:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f881540 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198803:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065160.198805:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065160.198809:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f881540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198813:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f881540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198827:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198832:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198836:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198839:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072569e00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065160.198841:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198845:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881547 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198850:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:3.0:1746065160.198852:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065160.198854:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881547 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198858:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881547 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.198876:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dfe expref: 37 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.198885:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f88154e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dfe expref: 36 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.198890:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:3.0:1746065160.198892:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065160.198894:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072568600, rc 0) 00000100:00100000:0.0:1746065160.199074:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273309440 00000100:00100000:0.0:1746065160.199078:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273309440 00000100:00100000:0.0:1746065160.199114:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 684 00000100:00100000:0.0:1746065160.199120:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2005:x1830881273309440:12345-192.168.202.8@tcp:63:ll_sa.0 00010000:00010000:0.0:1746065160.199134:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065160.199140:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f881555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e05 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.199156:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88155c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199162:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88155c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199167:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88155c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199176:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f881563 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199181:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f881563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199185:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f881563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199198:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88155c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199203:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88155c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199206:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88155c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199210:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b20400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065160.199212:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88155c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199216:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88155c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199222:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065160.199224:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065160.199226:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88155c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199230:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20400/0x392ae0376f88155c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199252:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f881563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199258:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f881563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199262:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f881563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199265:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b21e00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:0.0:1746065160.199267:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f881563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199271:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f881563 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199276:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfe6ecf (ffff880089512800) 00010000:00010000:0.0:1746065160.199278:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065160.199280:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f881563 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199284:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b21e00/0x392ae0376f881563 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:0.0:1746065160.199302:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f881555 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e05 expref: 38 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.199309:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:0.0:1746065160.199311:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065160.199313:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b20c00/0x392ae0376f881555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e05 expref: 38 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.199319:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b20c00, rc -2) 00000100:00100000:3.0:1746065160.200339:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:3829:x1830881273309312:12345-192.168.202.8@tcp:101:checkstat.0 Request processed in 1801us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.200344:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36596 00000100:00100000:0.0:1746065160.201755:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2005:x1830881273309440:12345-192.168.202.8@tcp:63:ll_sa.0 Request processed in 2622us (3404us total) trans 0 rc -2/-2 00000100:00100000:0.0:1746065160.201764:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 684 00000100:00100000:0.0:1746065160.203829:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.204017:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273309568 00000100:00100000:1.0:1746065160.204468:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273309568 00000100:00100000:1.0:1746065160.204910:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 516 00000100:00100000:1.0:1746065160.204919:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2002:x1830881273309568:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065160.204932:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065160.204951:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f88154e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6dfe expref: 36 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.204983:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:1.0:1746065160.204987:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065160.205020:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2002:x1830881273309568:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 102us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.205025:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 516 00000100:00100000:2.0:1746065160.205376:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.205419:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.205480:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273309696 00000100:00100000:0.0:1746065160.205485:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273309696 00000100:00100000:0.0:1746065160.205506:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273309824 00000100:00100000:0.0:1746065160.205507:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273309824 00000100:00100000:0.0:1746065160.205522:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30890 00000100:00100000:0.0:1746065160.205526:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273309696:12345-192.168.202.8@tcp:101:checkstat.0 00010000:00010000:0.0:1746065160.205538:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065160.205550:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f88156a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e0c expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.205586:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267833088:192.168.202.8@tcp:106: 00000100:00100000:1.0:1746065160.205599:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30891 00000100:00100000:1.0:1746065160.205605:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273309824:12345-192.168.202.8@tcp:101:checkstat.0 00010000:00010000:1.0:1746065160.205612:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.205620:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fecf600/0x392ae0376f881571 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e13 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.205634:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065160.205641:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f98700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267833216:192.168.202.8@tcp:106: 00000100:00100000:1.0:1746065160.205661:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f805e40 going to sleep for 11 seconds 00002000:00010000:2.0:1746065160.207634:0:21550:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000401:0x1c:0x0] updating lvb size: 0 -> 13631488 00002000:00010000:2.0:1746065160.207639:0:21550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x1c:0x0] updating lvb mtime: 0 -> 1746065158 00002000:00010000:2.0:1746065160.207642:0:21550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x1c:0x0] updating lvb atime: 0 -> 1746065158 00002000:00010000:2.0:1746065160.207644:0:21550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x1c:0x0] updating lvb ctime: 0 -> 1746065158 00002000:00010000:2.0:1746065160.207646:0:21550:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x280000401:0x1c:0x0] updating lvb blocks: 0 -> 24576 00000100:00100000:2.0:1746065160.207661:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267833088:192.168.202.8@tcp:106: 00010000:00010000:2.0:1746065160.207683:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f88156a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e0c expref: 9 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.207695:0:21550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b21200/0x392ae0376f88156a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e0c expref: 9 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.207707:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b21200, rc 0) 00000100:00100000:2.0:1746065160.207779:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2005:x1830881273309696:12345-192.168.202.8@tcp:101:checkstat.0 Request processed in 2250us (2401us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065160.207785:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30890 00002000:00010000:1.0:1746065160.210192:0:9642:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb size: 0 -> 12582912 00002000:00010000:1.0:1746065160.210198:0:9642:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb mtime: 0 -> 1746065158 00002000:00010000:1.0:1746065160.210200:0:9642:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb atime: 0 -> 1746065158 00002000:00010000:1.0:1746065160.210201:0:9642:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb ctime: 0 -> 1746065158 00002000:00010000:1.0:1746065160.210203:0:9642:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb blocks: 0 -> 24576 00000100:00100000:1.0:1746065160.210220:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f98700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267833216:192.168.202.8@tcp:106: 00010000:00010000:1.0:1746065160.210244:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fecf600/0x392ae0376f881571 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e13 expref: 17 pid: 9642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065160.210262:0:9642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fecf600/0x392ae0376f881571 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e13 expref: 17 pid: 9642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065160.210272:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fecf600, rc 0) 00000100:00100000:1.0:1746065160.210326:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2005:x1830881273309824:12345-192.168.202.8@tcp:101:checkstat.0 Request processed in 4719us (4903us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065160.210332:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30891 00000100:00100000:0.0:1746065160.219006:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.219065:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273309952 00000100:00100000:3.0:1746065160.219073:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273309952 00000100:00100000:3.0:1746065160.219132:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36597 00000100:00100000:3.0:1746065160.219139:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+26:3830:x1830881273309952:12345-192.168.202.8@tcp:101:checkstat.0 00010000:00010000:3.0:1746065160.219155:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065160.219168:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881578 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e1a expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.219210:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.219219:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.219227:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:3.0:1746065160.219257:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1746065160.219260:0:21520:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065160.219271:0:21520:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:3.0:1746065160.219286:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e1a expref: 28 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.219300:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e1a expref: 27 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.219307:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065160.219310:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065160.219312:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072569e00, rc 0) 00000100:00100000:3.0:1746065160.219355:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+27:3830:x1830881273309952:12345-192.168.202.8@tcp:101:checkstat.0 Request processed in 216us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.219360:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36597 00000100:00080000:0.0:1746065160.219438:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065160.227013:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.227074:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273310080 00000100:00100000:1.0:1746065160.227112:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273310080 00000100:00100000:1.0:1746065160.227162:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 685 00000100:00100000:1.0:1746065160.227169:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+27:2002:x1830881273310080:12345-192.168.202.8@tcp:63:ll_sa.0 00010000:00010000:1.0:1746065160.227197:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.227211:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f881586 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e21 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.227248:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecf600/0x392ae0376f88158d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227259:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecf600/0x392ae0376f88158d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227267:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecf600/0x392ae0376f88158d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227277:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecfe00/0x392ae0376f881594 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227282:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecfe00/0x392ae0376f881594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227288:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecfe00/0x392ae0376f881594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227349:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecf600/0x392ae0376f88158d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227356:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecf600/0x392ae0376f88158d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227361:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecf600/0x392ae0376f88158d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227365:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fecf600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065160.227368:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecf600/0x392ae0376f88158d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227373:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecf600/0x392ae0376f88158d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227383:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065160.227385:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065160.227389:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecf600/0x392ae0376f88158d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227393:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecf600/0x392ae0376f88158d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227421:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecfe00/0x392ae0376f881594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227425:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecfe00/0x392ae0376f881594 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227429:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecfe00/0x392ae0376f881594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227433:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fecfe00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065160.227435:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecfe00/0x392ae0376f881594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227439:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecfe00/0x392ae0376f881594 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227445:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff88009ff21a00) 00010000:00010000:1.0:1746065160.227446:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065160.227449:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecfe00/0x392ae0376f881594 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227453:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fecfe00/0x392ae0376f881594 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.227474:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f881586 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e21 expref: 28 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.227481:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065160.227483:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065160.227486:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091064200/0x392ae0376f881586 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e21 expref: 28 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.227493:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091064200, rc -2) 00000100:00100000:1.0:1746065160.227655:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+27:2002:x1830881273310080:12345-192.168.202.8@tcp:63:ll_sa.0 Request processed in 485us (649us total) trans 0 rc -2/-2 00000100:00100000:1.0:1746065160.227662:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 685 00000100:00100000:0.0:1746065160.237793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.238282:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273310336 00000100:00100000:2.0:1746065160.238291:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273310336 00000100:00100000:2.0:1746065160.238421:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36598 00000100:00100000:2.0:1746065160.238428:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:3833:x1830881273310336:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:2.0:1746065160.238446:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.238462:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072614a00/0x392ae0376f88159b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e59 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.238541:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072615600/0x392ae0376f8815a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065160.238552:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072615600/0x392ae0376f8815a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065160.238564:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072615600/0x392ae0376f8815a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:2.0:1746065160.238572:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4b:0x0]: returning size 26214400 00010000:00010000:2.0:1746065160.238645:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072614a00/0x392ae0376f88159b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e59 expref: 38 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.238672:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072615600/0x392ae0376f8815a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e59 expref: 37 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.238678:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:2.0:1746065160.238681:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065160.238683:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072615600, rc 0) 00000100:00100000:2.0:1746065160.238731:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:3833:x1830881273310336:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 303us (945us total) trans 4294983644 rc 0/0 00000100:00100000:2.0:1746065160.238737:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36598 00000100:00100000:1.0:1746065160.243811:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.243839:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273310592 00000100:00100000:1.0:1746065160.243847:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273310592 00000100:00100000:1.0:1746065160.243893:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30892 00000100:00100000:1.0:1746065160.243900:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2003:x1830881273310592:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:1.0:1746065160.243914:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.243927:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f8815b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e60 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.243966:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267833344:192.168.202.8@tcp:106: 00000100:00100000:1.0:1746065160.244671:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065160.244707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.244808:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273310720 00000100:00100000:3.0:1746065160.244812:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273310720 00000100:00100000:3.0:1746065160.244841:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30893 00000100:00100000:3.0:1746065160.244850:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273310720:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:3.0:1746065160.244857:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065160.244865:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f8815b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e67 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.244889:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267833472:192.168.202.8@tcp:106: 00000100:00100000:3.0:1746065160.244968:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb84600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065160.245396:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.245436:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273310464 00000100:00100000:2.0:1746065160.245439:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273310464 00000100:00100000:2.0:1746065160.245476:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 517 00000100:00100000:2.0:1746065160.245481:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:2005:x1830881273310464:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065160.245488:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065160.245504:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072615600/0x392ae0376f8815a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e59 expref: 37 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.245526:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:2.0:1746065160.245530:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065160.245559:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:2005:x1830881273310464:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 78us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.245566:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 517 00000100:00100000:3.0:1746065160.246606:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267833472:192.168.202.8@tcp:106: 00010000:00010000:3.0:1746065160.246624:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f8815b7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e67 expref: 17 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.246635:0:21550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072568600/0x392ae0376f8815b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e67 expref: 17 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.246656:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072568600, rc 0) 00000100:00100000:3.0:1746065160.246679:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:2003:x1830881273310720:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 1830us (1972us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065160.246685:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30893 00000100:00100000:1.0:1746065160.247119:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267833344:192.168.202.8@tcp:106: 00010000:00010000:1.0:1746065160.247134:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f8815b0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e60 expref: 9 pid: 9642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065160.247144:0:9642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1000/0x392ae0376f8815b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e60 expref: 9 pid: 9642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065160.247153:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8c1000, rc 0) 00000100:00100000:1.0:1746065160.247168:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2003:x1830881273310592:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 3269us (3365us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065160.247173:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30892 00000100:00100000:0.0:1746065160.261551:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.262142:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273310848 00000100:00100000:1.0:1746065160.262150:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273310848 00000100:00100000:1.0:1746065160.262196:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30894 00000100:00100000:1.0:1746065160.262204:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:3833:x1830881273310848:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:1.0:1746065160.262223:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.262288:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e6e expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.262313:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 9 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.262319:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065160.262321:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065160.262324:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 4/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 9 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.262346:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 9 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.262356:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 9 pid: 9642 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746065160.262365:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267833600:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065160.262670:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065160.265648:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9642:1830881267833600:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065160.265673:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 9 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.265687:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:1.0:1746065160.265688:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8c1600, rc 0) 00000100:00100000:1.0:1746065160.265723:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:3833:x1830881273310848:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 3520us (4178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.265730:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30894 00000100:00100000:2.0:1746065160.265808:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273310976 00000100:00100000:2.0:1746065160.265814:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273310976 00002000:00100000:2.0:1746065160.265842:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (12582912->13631487) req@ffff88009f4e9500 x1830881273310976/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.265850:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9500 with x1830881273310976 ext(12582912->13631487) 00010000:00010000:2.0:1746065160.265855:0:27163:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 10 pid: 9642 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746065160.265864:0:27163:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 10 pid: 9642 timeout: 859 lvb_type: 0 00002000:00010000:2.0:1746065160.265870:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f4e9500 00000100:00100000:2.0:1746065160.265893:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 3163 00000100:00100000:2.0:1746065160.265898:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+10:2004:x1830881273310976:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065160.281392:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2004:x1830881273310976:12345-192.168.202.8@tcp:4:dd.0 Request processed in 15485us (15697us total) trans 4294970777 rc 0/0 00000100:00100000:0.0:1746065160.281405:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 3163 00002000:00100000:0.0:1746065160.281416:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (12582912->13631487) req@ffff88009f4e9500 x1830881273310976/t4294970777(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/448 e 0 to 0 dl 1746065171 ref 1 fl Complete:H/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.281431:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4e9500 with x1830881273310976 ext(12582912->13631487) 00010000:00010000:0.0:1746065160.281440:0:27163:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 12 pid: 9642 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746065160.281455:0:27163:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 12 pid: 9642 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746065160.281461:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f4e9500 00010000:00010000:2.0:1746065160.286743:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065160.318142:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.318206:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273311104 00000100:00100000:2.0:1746065160.318214:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273311104 00010000:00010000:2.0:1746065160.318246:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 12 pid: 9642 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746065160.318283:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14848 00000100:00100000:2.0:1746065160.318290:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2004:x1830881273311104:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065160.318301:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065160.318315:0:7198:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x1c:0x0] updating lvb blocks from disk: 24576 -> 26624 00010000:00010000:2.0:1746065160.318320:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 12 pid: 9642 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746065160.318331:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 12 pid: 9642 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746065160.318350:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0x392ae0376f881405 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ddb expref: 12 pid: 9642 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746065160.318365:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.318367:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.318372:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 8 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.318380:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 8 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.318404:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 8 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.318414:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267833728:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065160.318490:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065160.326073:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.326143:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273311360 00000100:00100000:1.0:1746065160.326151:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273311360 00002000:00100000:1.0:1746065160.326192:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (0->1048575) req@ffff88009f938700 x1830881273311360/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.326201:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938700 with x1830881273311360 ext(0->1048575) 00002000:00010000:1.0:1746065160.326205:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f938700 00000100:00100000:1.0:1746065160.326239:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14053 00000100:00100000:1.0:1746065160.326246:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273311360:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065160.326334:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7198:1830881267833728:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065160.326351:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065160.326386:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273311104:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 8096us (8250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065160.326395:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14848 00000100:00100000:1.0:1746065160.335307:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273311360:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 9054us (9234us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065160.335316:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14053 00002000:00100000:1.0:1746065160.335324:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (0->1048575) req@ffff88009f938700 x1830881273311360/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.335331:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938700 with x1830881273311360 ext(0->1048575) 00002000:00010000:1.0:1746065160.335335:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f938700 00000100:00100000:0.0:1746065160.341638:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.341695:0:9642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273311488 00000100:00100000:1.0:1746065160.341703:0:9642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273311488 00000100:00100000:1.0:1746065160.341762:0:9642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30895 00000100:00100000:1.0:1746065160.341770:0:9642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+16:3833:x1830881273311488:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:1.0:1746065160.341787:0:9642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.341802:0:9642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e75 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.341825:0:9642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 19 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.341831:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065160.341833:0:9642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065160.341836:0:9642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 17 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.341858:0:9642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 19 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.341868:0:9642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 19 pid: 9642 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746065160.341878:0:9642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267833856:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065160.341957:0:9642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f8056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065160.344975:0:9642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072f99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9642:1830881267833856:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065160.345001:0:9642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 17 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.345015:0:9642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8c0e00, rc 0) 00000100:00100000:1.0:1746065160.345592:0:9642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:3833:x1830881273311488:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 3820us (3956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.345600:0:9642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30895 00000100:00100000:0.0:1746065160.350864:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.350962:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273311616 00000100:00100000:2.0:1746065160.350970:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273311616 00010000:00010000:2.0:1746065160.351002:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 20 pid: 9642 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746065160.351347:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14849 00000100:00100000:2.0:1746065160.351356:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2005:x1830881273311616:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065160.351369:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065160.351386:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 20 pid: 9642 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746065160.351398:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 20 pid: 9642 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746065160.351418:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072b6c000/0x392ae0376f881428 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6de9 expref: 20 pid: 9642 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746065160.351433:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.351435:0:7198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.351441:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 16 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.351448:0:7198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 16 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.351476:0:7198:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 16 pid: 9642 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.351487:0:7198:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267833984:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065160.351560:0:7198:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065160.353524:0:7198:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7198:1830881267833984:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065160.353540:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065160.353566:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+19:2005:x1830881273311616:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 2211us (2709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.353576:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14849 00000100:00100000:0.0:1746065160.358686:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.358866:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273311872 00000100:00100000:1.0:1746065160.358874:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273311872 00002000:00100000:1.0:1746065160.358910:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (0->2097151) req@ffff88009d1e2d80 x1830881273311872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.358919:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2d80 with x1830881273311872 ext(0->2097151) 00002000:00010000:1.0:1746065160.358924:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e2d80 00000100:00100000:1.0:1746065160.358955:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14054 00000100:00100000:1.0:1746065160.358961:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881273311872:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065160.359757:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.360376:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273312128 00000100:00100000:3.0:1746065160.360381:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273312128 00002000:00100000:3.0:1746065160.360406:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1c:0x0] (1048576->2097151) req@ffff88009d1e0e00 x1830881273312128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.360413:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0e00 with x1830881273312128 ext(1048576->2097151) 00002000:00010000:3.0:1746065160.360417:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e0e00 00000100:00100000:3.0:1746065160.360441:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14055 00000100:00100000:3.0:1746065160.360446:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273312128:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065160.377398:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273312128:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 16943us (17644us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065160.377409:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14055 00002000:00100000:3.0:1746065160.377419:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1c:0x0] (1048576->2097151) req@ffff88009d1e0e00 x1830881273312128/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.377427:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0e00 with x1830881273312128 ext(1048576->2097151) 00002000:00010000:3.0:1746065160.377432:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e0e00 00000100:00100000:1.0:1746065160.380767:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881273311872:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 21797us (22081us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065160.380777:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14054 00002000:00100000:1.0:1746065160.380786:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (0->2097151) req@ffff88009d1e2d80 x1830881273311872/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.380794:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2d80 with x1830881273311872 ext(0->2097151) 00002000:00010000:1.0:1746065160.380798:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e2d80 00000100:00100000:0.0:1746065160.395768:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.395815:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.395894:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273312512 00000100:00100000:1.0:1746065160.395902:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273312512 00002000:00100000:1.0:1746065160.395939:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (2097152->4194303) req@ffff88009d1e3b80 x1830881273312512/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.395948:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3b80 with x1830881273312512 ext(2097152->4194303) 00002000:00010000:1.0:1746065160.395953:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e3b80 00000100:00100000:1.0:1746065160.395966:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273312640 00000100:00100000:1.0:1746065160.395969:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273312640 00002000:00100000:1.0:1746065160.395980:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (2097152->4194303) req@ffff88009d1e1f80 x1830881273312640/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.395986:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1f80 with x1830881273312640 ext(2097152->4194303) 00002000:00010000:1.0:1746065160.395988:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e1f80 00000100:00100000:1.0:1746065160.396006:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14056 00000100:00100000:1.0:1746065160.396011:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2002:x1830881273312512:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065160.396965:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14057 00000100:00100000:1.0:1746065160.396972:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2002:x1830881273312640:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065160.413146:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2002:x1830881273312512:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 17126us (17378us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065160.413156:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14056 00002000:00100000:1.0:1746065160.413165:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1c:0x0] (2097152->4194303) req@ffff88009d1e3b80 x1830881273312512/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.413174:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3b80 with x1830881273312512 ext(2097152->4194303) 00002000:00010000:1.0:1746065160.413179:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e3b80 00000100:00100000:1.0:1746065160.416189:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2002:x1830881273312640:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 19210us (20366us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065160.416198:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14057 00002000:00100000:1.0:1746065160.416207:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (2097152->4194303) req@ffff88009d1e1f80 x1830881273312640/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.416216:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1f80 with x1830881273312640 ext(2097152->4194303) 00002000:00010000:1.0:1746065160.416220:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e1f80 00000100:00100000:0.0:1746065160.440339:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.440386:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.440787:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273312896 00000100:00100000:2.0:1746065160.440796:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273312896 00002000:00100000:2.0:1746065160.440835:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1c:0x0] (4194304->6291455) req@ffff88009d1e3480 x1830881273312896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.440844:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3480 with x1830881273312896 ext(4194304->6291455) 00002000:00010000:2.0:1746065160.440849:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e3480 00000100:00100000:2.0:1746065160.440875:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273313152 00000100:00100000:2.0:1746065160.440878:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273313152 00002000:00100000:2.0:1746065160.440891:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1c:0x0] (4194304->6291455) req@ffff88009d1e1c00 x1830881273313152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.440897:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1c00 with x1830881273313152 ext(4194304->6291455) 00002000:00010000:2.0:1746065160.440900:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1c00 00000100:00100000:2.0:1746065160.442249:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14058 00000100:00100000:2.0:1746065160.442260:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273312896:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065160.448713:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14059 00000100:00100000:0.0:1746065160.448730:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881273313152:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065160.460066:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273312896:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 17802us (19726us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065160.460077:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14058 00002000:00100000:2.0:1746065160.460112:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1c:0x0] (4194304->6291455) req@ffff88009d1e3480 x1830881273312896/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.460121:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e3480 with x1830881273312896 ext(4194304->6291455) 00002000:00010000:2.0:1746065160.460127:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e3480 00000100:00100000:2.0:1746065160.466189:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881273313152:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 17457us (25793us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065160.466201:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14059 00002000:00100000:2.0:1746065160.466210:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1c:0x0] (4194304->6291455) req@ffff88009d1e1c00 x1830881273313152/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.466218:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1c00 with x1830881273313152 ext(4194304->6291455) 00002000:00010000:2.0:1746065160.466223:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1c00 00000100:00100000:0.0:1746065160.471826:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.473936:0:27161:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273313408 00000100:00100000:2.0:1746065160.473947:0:27161:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273313408 00002000:00100000:2.0:1746065160.473987:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x1c:0x0] (6291456->7340031) req@ffff88009d1e2300 x1830881273313408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.473996:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2300 with x1830881273313408 ext(6291456->7340031) 00002000:00010000:2.0:1746065160.474001:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e2300 00000100:00100000:2.0:1746065160.475544:0:27161:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14060 00000100:00100000:2.0:1746065160.475556:0:27161:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273313408:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065160.478926:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.479020:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.479091:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273313664 00000100:00100000:3.0:1746065160.479099:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273313664 00002000:00100000:3.0:1746065160.479134:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1c:0x0] (6291456->7340031) req@ffff880072f99180 x1830881273313664/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.479143:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99180 with x1830881273313664 ext(6291456->7340031) 00002000:00010000:3.0:1746065160.479147:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f99180 00000100:00100000:3.0:1746065160.479166:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273313920 00000100:00100000:3.0:1746065160.479170:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273313920 00002000:00100000:3.0:1746065160.479182:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (7340032->8388607) req@ffff880072f98a80 x1830881273313920/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.479189:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98a80 with x1830881273313920 ext(7340032->8388607) 00002000:00010000:3.0:1746065160.479192:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f98a80 00000100:00100000:3.0:1746065160.479212:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14061 00000100:00100000:3.0:1746065160.479219:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2004:x1830881273313664:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065160.479767:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14062 00000100:00100000:3.0:1746065160.479773:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2004:x1830881273313920:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065160.480399:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.481127:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273314176 00000100:00100000:1.0:1746065160.481132:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273314176 00002000:00100000:1.0:1746065160.481157:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (7340032->8388607) req@ffff88009d1e1880 x1830881273314176/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.481165:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1880 with x1830881273314176 ext(7340032->8388607) 00002000:00010000:1.0:1746065160.481169:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1880 00000100:00100000:1.0:1746065160.481186:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14063 00000100:00100000:1.0:1746065160.481191:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2004:x1830881273314176:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065160.496170:0:27161:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2004:x1830881273313408:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 20609us (24343us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.496181:0:27161:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14060 00002000:00100000:2.0:1746065160.496191:0:27161:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x1c:0x0] (6291456->7340031) req@ffff88009d1e2300 x1830881273313408/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.496199:0:27161:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2300 with x1830881273313408 ext(6291456->7340031) 00002000:00010000:2.0:1746065160.496204:0:27161:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e2300 00000100:00100000:3.0:1746065160.498542:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2004:x1830881273313664:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 19316us (19615us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065160.498552:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14061 00002000:00100000:3.0:1746065160.498559:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c:0x0] (6291456->7340031) req@ffff880072f99180 x1830881273313664/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.498567:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f99180 with x1830881273313664 ext(6291456->7340031) 00002000:00010000:3.0:1746065160.498571:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f99180 00000100:00100000:3.0:1746065160.503814:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2004:x1830881273313920:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 24028us (24781us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065160.503824:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14062 00002000:00100000:3.0:1746065160.503834:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1c:0x0] (7340032->8388607) req@ffff880072f98a80 x1830881273313920/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.503843:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f98a80 with x1830881273313920 ext(7340032->8388607) 00002000:00010000:3.0:1746065160.503848:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880072f98a80 00000100:00100000:1.0:1746065160.504097:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2004:x1830881273314176:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 22904us (23698us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065160.504103:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14063 00002000:00100000:1.0:1746065160.504109:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (7340032->8388607) req@ffff88009d1e1880 x1830881273314176/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.504117:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1880 with x1830881273314176 ext(7340032->8388607) 00002000:00010000:1.0:1746065160.504120:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1880 00000100:00100000:0.0:1746065160.520622:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.520672:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.520771:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273314560 00000100:00100000:1.0:1746065160.520779:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273314560 00000100:00100000:3.0:1746065160.520789:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273314688 00000100:00100000:3.0:1746065160.520793:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273314688 00002000:00100000:3.0:1746065160.520815:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1c:0x0] (8388608->10485759) req@ffff88009d1e2a00 x1830881273314688/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.520815:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (8388608->10485759) req@ffff88009d1e1180 x1830881273314560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.520824:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2a00 with x1830881273314688 ext(8388608->10485759) 00002000:00100000:1.0:1746065160.520824:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1180 with x1830881273314560 ext(8388608->10485759) 00002000:00010000:3.0:1746065160.520828:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e2a00 00002000:00010000:1.0:1746065160.520828:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1180 00000100:00100000:3.0:1746065160.521180:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14064 00000100:00100000:3.0:1746065160.521187:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2002:x1830881273314688:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065160.521614:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14065 00000100:00100000:2.0:1746065160.521622:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2003:x1830881273314560:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065160.539498:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2003:x1830881273314560:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 17868us (18874us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065160.539509:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14065 00002000:00100000:2.0:1746065160.539518:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c:0x0] (8388608->10485759) req@ffff88009d1e1180 x1830881273314560/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.539527:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e1180 with x1830881273314560 ext(8388608->10485759) 00002000:00010000:2.0:1746065160.539532:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1e1180 00000100:00100000:3.0:1746065160.542537:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2002:x1830881273314688:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 21343us (21857us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065160.542546:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14064 00002000:00100000:3.0:1746065160.542555:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1c:0x0] (8388608->10485759) req@ffff88009d1e2a00 x1830881273314688/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.542562:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e2a00 with x1830881273314688 ext(8388608->10485759) 00002000:00010000:3.0:1746065160.542567:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e2a00 00000100:00100000:0.0:1746065160.548708:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.548766:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.548825:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273315072 00000100:00100000:2.0:1746065160.548832:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273315072 00000100:00100000:3.0:1746065160.548840:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273315200 00000100:00100000:3.0:1746065160.548843:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273315200 00002000:00100000:3.0:1746065160.548866:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1c:0x0] (10485760->11534335) req@ffff88009fbbdf80 x1830881273315200/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.548866:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (10485760->11534335) req@ffff88009fbbd880 x1830881273315072/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.548875:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdf80 with x1830881273315200 ext(10485760->11534335) 00002000:00100000:2.0:1746065160.548875:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbd880 with x1830881273315072 ext(10485760->11534335) 00002000:00010000:3.0:1746065160.548879:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbdf80 00002000:00010000:2.0:1746065160.548879:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbbd880 00000100:00100000:2.0:1746065160.550104:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14066 00000100:00100000:2.0:1746065160.550116:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2003:x1830881273315200:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065160.556985:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14067 00000100:00100000:3.0:1746065160.557016:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2003:x1830881273315072:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065160.563834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.563863:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.563883:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.564005:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2003:x1830881273315200:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 13892us (15238us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065160.564015:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14066 00002000:00100000:0.0:1746065160.564024:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c:0x0] (10485760->11534335) req@ffff88009fbbdf80 x1830881273315200/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.564033:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbdf80 with x1830881273315200 ext(10485760->11534335) 00002000:00010000:0.0:1746065160.564037:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbdf80 00000100:00100000:0.0:1746065160.564057:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273315456 00000100:00100000:0.0:1746065160.564062:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273315456 00002000:00100000:0.0:1746065160.564103:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (11534336->12582911) req@ffff88009fbbf800 x1830881273315456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.564111:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881273315456 ext(11534336->12582911) 00002000:00010000:0.0:1746065160.564113:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbbf800 00000100:00100000:0.0:1746065160.564122:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273315712 00000100:00100000:0.0:1746065160.564123:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273315712 00002000:00100000:0.0:1746065160.564131:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c:0x0] (11534336->12582911) req@ffff88009fbbce00 x1830881273315712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.564137:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbce00 with x1830881273315712 ext(11534336->12582911) 00002000:00010000:0.0:1746065160.564139:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbce00 00000100:00100000:0.0:1746065160.564144:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273315968 00000100:00100000:0.0:1746065160.564146:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273315968 00002000:00100000:0.0:1746065160.564152:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (12582912->13631487) req@ffff88009fbbe300 x1830881273315968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.564157:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbe300 with x1830881273315968 ext(12582912->13631487) 00002000:00010000:0.0:1746065160.564160:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbbe300 00000100:00100000:0.0:1746065160.564168:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14068 00000100:00100000:0.0:1746065160.564172:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+12:2003:x1830881273315456:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065160.564852:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14069 00000100:00100000:2.0:1746065160.564861:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2003:x1830881273315712:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065160.565349:0:9563:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14070 00000100:00100000:0.0:1746065160.565356:0:9563:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2003:x1830881273315968:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065160.579154:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+13:2003:x1830881273315072:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 22143us (30445us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065160.579165:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14067 00002000:00100000:3.0:1746065160.579175:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1c:0x0] (10485760->11534335) req@ffff88009fbbd880 x1830881273315072/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.579182:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbd880 with x1830881273315072 ext(10485760->11534335) 00002000:00010000:3.0:1746065160.579187:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbbd880 00000100:00100000:1.0:1746065160.579536:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+11:2003:x1830881273315456:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 15362us (15708us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065160.579542:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14068 00002000:00100000:1.0:1746065160.579547:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (11534336->12582911) req@ffff88009fbbf800 x1830881273315456/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.579553:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbf800 with x1830881273315456 ext(11534336->12582911) 00002000:00010000:1.0:1746065160.579556:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbbf800 00000100:00100000:2.0:1746065160.581572:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2003:x1830881273315712:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 16706us (17700us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.581580:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14069 00002000:00100000:2.0:1746065160.581587:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (11534336->12582911) req@ffff88009fbbce00 x1830881273315712/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.581595:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbce00 with x1830881273315712 ext(11534336->12582911) 00002000:00010000:2.0:1746065160.581600:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbce00 00000100:00100000:0.0:1746065160.585592:0:9563:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2003:x1830881273315968:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 20227us (21698us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065160.585603:0:9563:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14070 00002000:00100000:0.0:1746065160.585611:0:9563:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x1c:0x0] (12582912->13631487) req@ffff88009fbbe300 x1830881273315968/t0(0) o3->b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.585620:0:9563:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbe300 with x1830881273315968 ext(12582912->13631487) 00002000:00010000:0.0:1746065160.585624:0:9563:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbbe300 00000100:00100000:0.0:1746065160.598174:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.598297:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273316224 00000100:00100000:2.0:1746065160.598305:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273316224 00000100:00100000:2.0:1746065160.599056:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 215 00000100:00100000:2.0:1746065160.599065:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:3833:x1830881273316224:12345-192.168.202.8@tcp:35:cmp.0 00000100:00100000:2.0:1746065160.599321:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:3833:x1830881273316224:12345-192.168.202.8@tcp:35:cmp.0 Request processed in 257us (1154us total) trans 4294983645 rc 0/0 00000100:00100000:2.0:1746065160.599327:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 215 00000100:00100000:0.0:1746065160.607387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.607468:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.607534:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273316480 00000100:00100000:2.0:1746065160.607542:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273316480 00000100:00100000:2.0:1746065160.607582:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36599 00000100:00100000:2.0:1746065160.607589:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+27:3835:x1830881273316480:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:2.0:1746065160.607605:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.607619:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9a00/0x392ae0376f8815cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e7c expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.607696:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f8815d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065160.607707:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f8815d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065160.607716:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f8815d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:2.0:1746065160.607724:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x47:0x0]: returning size 26214400 00010000:00010000:2.0:1746065160.607809:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9a00/0x392ae0376f8815cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e7c expref: 30 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.607825:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f8815d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e7c expref: 29 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.607833:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:2.0:1746065160.607835:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065160.607838:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a04b8600, rc 0) 00000100:00100000:2.0:1746065160.607874:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+29:3835:x1830881273316480:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 286us (495us total) trans 4294983646 rc 0/0 00000100:00100000:2.0:1746065160.607880:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36599 00000100:00100000:1.0:1746065160.608173:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273316608 00000100:00100000:1.0:1746065160.608176:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273316608 00000100:00100000:1.0:1746065160.608208:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 686 00000100:00100000:1.0:1746065160.608213:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+29:2003:x1830881273316608:12345-192.168.202.8@tcp:63:ll_sa.0 00010000:00010000:1.0:1746065160.608231:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.608243:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f8815e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6e83 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.608266:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f8815e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608272:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f8815e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608279:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f8815e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608289:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x392ae0376f8815ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608294:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x392ae0376f8815ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608299:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x392ae0376f8815ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608322:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f8815e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608327:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f8815e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608332:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f8815e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608336:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072b6ca00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065160.608338:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f8815e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608347:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f8815e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608354:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065160.608355:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065160.608358:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f8815e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608362:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6ca00/0x392ae0376f8815e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608383:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x392ae0376f8815ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608388:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x392ae0376f8815ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608393:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x392ae0376f8815ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608396:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065160.608398:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x392ae0376f8815ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608403:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x392ae0376f8815ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608409:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff88009ff21d00) 00010000:00010000:1.0:1746065160.608411:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065160.608413:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x392ae0376f8815ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.608417:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x392ae0376f8815ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.611185:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f8815e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e83 expref: 30 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.611198:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065160.611200:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065160.611204:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072b6c200/0x392ae0376f8815e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e83 expref: 30 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.611211:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072b6c200, rc -2) 00000100:00100000:1.0:1746065160.611277:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+29:2003:x1830881273316608:12345-192.168.202.8@tcp:63:ll_sa.0 Request processed in 3063us (3809us total) trans 0 rc -2/-2 00000100:00100000:1.0:1746065160.611285:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 686 00000100:00100000:2.0:1746065160.614652:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.614694:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.614714:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273316992 00000100:00100000:2.0:1746065160.614721:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273316992 00000100:00100000:2.0:1746065160.614768:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36600 00000100:00100000:2.0:1746065160.614775:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+29:3835:x1830881273316992:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:2.0:1746065160.614794:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.614808:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9a00/0x392ae0376f8815f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6eb4 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.614893:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727b7a00/0x392ae0376f8815fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00000100:00100000:3.0:1746065160.614896:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:2.0:1746065160.614903:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727b7a00/0x392ae0376f8815fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065160.614913:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727b7a00/0x392ae0376f8815fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000100:00100000:3.0:1746065160.614916:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273316736 00000100:00100000:3.0:1746065160.614920:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273316736 00000004:00200000:2.0:1746065160.614922:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4b:0x0]: returning size 26214400 00000100:00100000:3.0:1746065160.614944:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 518 00000100:00100000:3.0:1746065160.614949:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+31:2002:x1830881273316736:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065160.614956:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065160.614969:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b8600/0x392ae0376f8815d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e7c expref: 32 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.614983:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:3.0:1746065160.614986:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065160.614996:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9a00/0x392ae0376f8815f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6eb4 expref: 32 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.615015:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727b7a00/0x392ae0376f8815fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6eb4 expref: 31 pid: 7213 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.615016:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007297bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+31:2002:x1830881273316736:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 66us (121us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065160.615021:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00000100:00100000:3.0:1746065160.615022:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 518 00010000:00010000:2.0:1746065160.615023:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065160.615025:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727b7a00, rc 0) 00000100:00100000:2.0:1746065160.615043:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+30:3835:x1830881273316992:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 269us (349us total) trans 4294983647 rc 0/0 00000100:00100000:2.0:1746065160.615048:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36600 00000100:00100000:1.0:1746065160.615121:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273317120 00000100:00100000:1.0:1746065160.615125:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273317120 00000100:00100000:1.0:1746065160.615153:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 687 00000100:00100000:1.0:1746065160.615158:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+30:2003:x1830881273317120:12345-192.168.202.8@tcp:63:ll_sa.0 00010000:00010000:1.0:1746065160.615173:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.615179:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x392ae0376f88160b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6ebb expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.615201:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f881612 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615208:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f881612 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615214:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f881612 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615227:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x392ae0376f881619 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615232:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x392ae0376f881619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615237:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x392ae0376f881619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615259:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f881612 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615264:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f881612 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615269:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f881612 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615274:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065160.615276:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f881612 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615282:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f881612 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615289:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065160.615291:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065160.615294:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f881612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615298:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f881612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615305:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x392ae0376f881619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615310:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x392ae0376f881619 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615314:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x392ae0376f881619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615318:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb07400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065160.615320:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x392ae0376f881619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615324:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x392ae0376f881619 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615328:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfe6ecf (ffff88009ff21500) 00010000:00010000:1.0:1746065160.615330:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065160.615332:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x392ae0376f881619 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615336:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x392ae0376f881619 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.615610:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x392ae0376f88160b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ebb expref: 31 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.615617:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065160.615619:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065160.615621:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x392ae0376f88160b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6ebb expref: 31 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.615628:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06200, rc -2) 00000100:00100000:0.0:1746065160.616664:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+30:2003:x1830881273317120:12345-192.168.202.8@tcp:63:ll_sa.0 Request processed in 1504us (2016us total) trans 0 rc -2/-2 00000100:00100000:0.0:1746065160.616673:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 687 00000100:00100000:3.0:1746065160.620185:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.620210:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.620232:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273317376 00000100:00100000:0.0:1746065160.620239:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273317376 00000100:00100000:3.0:1746065160.620243:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.620360:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273317504 00000100:00100000:2.0:1746065160.620364:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273317504 00000100:00100000:2.0:1746065160.620387:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273317248 00000100:00100000:2.0:1746065160.620389:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273317248 00000100:00100000:0.0:1746065160.620933:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 519 00000100:00100000:0.0:1746065160.620940:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+30:2003:x1830881273317376:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065160.620952:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065160.620971:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30896 00010000:00010000:0.0:1746065160.620972:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727b7a00/0x392ae0376f8815fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6eb4 expref: 30 pid: 7213 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.620976:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+19:2005:x1830881273317504:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:2.0:1746065160.620988:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065160.620988:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:0.0:1746065160.620991:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065160.620998:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f881620 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f01 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.621011:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.621012:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.621018:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f881620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f01 expref: 20 pid: 21550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065160.621024:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+29:2003:x1830881273317376:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 85us (846us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065160.621029:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f881620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f01 expref: 20 pid: 21550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065160.621029:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 519 00010000:00010000:2.0:1746065160.621041:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f02c400, rc 0) 00000100:00100000:2.0:1746065160.621058:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2005:x1830881273317504:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 83us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.621063:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30896 00000100:00100000:2.0:1746065160.621071:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30897 00000100:00100000:2.0:1746065160.621076:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2005:x1830881273317248:12345-192.168.202.8@tcp:101:cmp.0 00010000:00010000:2.0:1746065160.621098:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.621106:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f881627 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6efa expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.621115:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.621116:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.621120:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f881627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6efa expref: 12 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.621128:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f881627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6efa expref: 12 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.621134:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f02d400, rc 0) 00000100:00100000:2.0:1746065160.621148:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273317248:12345-192.168.202.8@tcp:101:cmp.0 Request processed in 72us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.621153:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30897 00000100:00100000:2.0:1746065160.648410:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.648442:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.648705:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273317760 00000100:00100000:3.0:1746065160.648713:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273317760 00002000:00100000:3.0:1746065160.648775:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (0->2097151) req@ffff88009f7c3b80 x1830881273317760/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.648790:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3b80 with x1830881273317760 ext(0->2097151) 00002000:00010000:3.0:1746065160.648794:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7c3b80 00000100:00100000:3.0:1746065160.648821:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273318016 00000100:00100000:3.0:1746065160.648824:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273318016 00002000:00100000:3.0:1746065160.648836:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (0->2097151) req@ffff88009f7c2680 x1830881273318016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.648842:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2680 with x1830881273318016 ext(0->2097151) 00002000:00010000:3.0:1746065160.648845:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c2680 00000100:00100000:3.0:1746065160.648855:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14071 00000100:00100000:3.0:1746065160.648860:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273317760:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065160.648862:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14072 00000100:00100000:1.0:1746065160.648870:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2005:x1830881273318016:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065160.670928:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2005:x1830881273318016:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 22052us (22478us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065160.670939:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14072 00002000:00100000:1.0:1746065160.670947:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c:0x0] (0->2097151) req@ffff88009f7c2680 x1830881273318016/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.670955:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c2680 with x1830881273318016 ext(0->2097151) 00002000:00010000:1.0:1746065160.670959:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7c2680 00000100:00100000:3.0:1746065160.671069:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273317760:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 22208us (22666us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065160.671074:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14071 00002000:00100000:3.0:1746065160.671094:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (0->2097151) req@ffff88009f7c3b80 x1830881273317760/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.671100:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7c3b80 with x1830881273317760 ext(0->2097151) 00002000:00010000:3.0:1746065160.671103:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f7c3b80 00000100:00100000:2.0:1746065160.709440:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.709486:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.711133:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273318272 00000100:00100000:3.0:1746065160.711143:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273318272 00002000:00100000:3.0:1746065160.711184:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (2097152->4194303) req@ffff88009d79fb80 x1830881273318272/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.711194:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79fb80 with x1830881273318272 ext(2097152->4194303) 00002000:00010000:3.0:1746065160.711199:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d79fb80 00000100:00100000:3.0:1746065160.712216:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273318528 00000100:00100000:3.0:1746065160.712220:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273318528 00002000:00100000:3.0:1746065160.712239:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (2097152->4194303) req@ffff88009d79c000 x1830881273318528/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.712247:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79c000 with x1830881273318528 ext(2097152->4194303) 00002000:00010000:3.0:1746065160.712251:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79c000 00000100:00100000:1.0:1746065160.712376:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14073 00000100:00100000:1.0:1746065160.712384:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2003:x1830881273318272:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065160.715098:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14074 00000100:00100000:3.0:1746065160.715113:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2003:x1830881273318528:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065160.740202:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2003:x1830881273318272:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 27813us (30762us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065160.740211:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14073 00002000:00100000:1.0:1746065160.740221:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (2097152->4194303) req@ffff88009d79fb80 x1830881273318272/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.740229:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79fb80 with x1830881273318272 ext(2097152->4194303) 00002000:00010000:1.0:1746065160.740234:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d79fb80 00000100:00100000:3.0:1746065160.746035:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2003:x1830881273318528:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 30918us (36540us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065160.746045:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14074 00002000:00100000:3.0:1746065160.746055:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (2097152->4194303) req@ffff88009d79c000 x1830881273318528/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.746063:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79c000 with x1830881273318528 ext(2097152->4194303) 00002000:00010000:3.0:1746065160.746068:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79c000 00000100:00100000:0.0:1746065160.778871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.779559:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.779637:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273318784 00000100:00100000:3.0:1746065160.779645:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273318784 00002000:00100000:3.0:1746065160.779680:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (4194304->6291455) req@ffff88009fbbc000 x1830881273318784/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.779688:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc000 with x1830881273318784 ext(4194304->6291455) 00002000:00010000:3.0:1746065160.779692:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbbc000 00000100:00100000:3.0:1746065160.779719:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14075 00000100:00100000:3.0:1746065160.779726:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273318784:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065160.780662:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273319040 00000100:00100000:1.0:1746065160.780667:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273319040 00002000:00100000:1.0:1746065160.780688:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c:0x0] (4194304->6291455) req@ffff88009fbbd500 x1830881273319040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.780694:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbd500 with x1830881273319040 ext(4194304->6291455) 00002000:00010000:1.0:1746065160.780697:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbd500 00000100:00100000:1.0:1746065160.780709:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14076 00000100:00100000:1.0:1746065160.780713:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2004:x1830881273319040:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065160.819607:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273318784:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 39875us (40736us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065160.819617:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14075 00002000:00100000:3.0:1746065160.819627:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (4194304->6291455) req@ffff88009fbbc000 x1830881273318784/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.819635:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbc000 with x1830881273318784 ext(4194304->6291455) 00002000:00010000:3.0:1746065160.819640:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbbc000 00000100:00100000:1.0:1746065160.819923:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2004:x1830881273319040:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 39207us (40363us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065160.819930:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14076 00002000:00100000:1.0:1746065160.819935:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c:0x0] (4194304->6291455) req@ffff88009fbbd500 x1830881273319040/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.819942:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbbd500 with x1830881273319040 ext(4194304->6291455) 00002000:00010000:1.0:1746065160.819953:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbbd500 00000100:00100000:2.0:1746065160.836405:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.836503:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273319296 00000100:00100000:1.0:1746065160.836511:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273319296 00000100:00100000:2.0:1746065160.836533:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00002000:00100000:1.0:1746065160.836541:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (6291456->7340031) req@ffff88009d79ca80 x1830881273319296/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.836548:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ca80 with x1830881273319296 ext(6291456->7340031) 00002000:00010000:1.0:1746065160.836551:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d79ca80 00000100:00100000:1.0:1746065160.836567:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273319552 00000100:00100000:1.0:1746065160.836569:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273319552 00002000:00100000:1.0:1746065160.836576:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c:0x0] (6291456->7340031) req@ffff88009d79d880 x1830881273319552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.836580:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d880 with x1830881273319552 ext(6291456->7340031) 00002000:00010000:1.0:1746065160.836581:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79d880 00000100:00100000:1.0:1746065160.836594:0:9563:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14077 00000100:00100000:1.0:1746065160.836598:0:9563:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2003:x1830881273319296:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065160.836605:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14078 00000100:00100000:0.0:1746065160.836612:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2002:x1830881273319552:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065160.857953:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.858011:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.858151:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273319808 00000100:00100000:2.0:1746065160.858160:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273319808 00002000:00100000:2.0:1746065160.858196:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (7340032->8388607) req@ffff88009ea74a80 x1830881273319808/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.858204:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea74a80 with x1830881273319808 ext(7340032->8388607) 00002000:00010000:2.0:1746065160.858208:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea74a80 00000100:00100000:2.0:1746065160.858222:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273320064 00000100:00100000:0.0:1746065160.858222:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2002:x1830881273319552:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 21608us (21687us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.858224:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273320064 00000100:00100000:0.0:1746065160.858228:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14078 00002000:00100000:0.0:1746065160.858234:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1c:0x0] (6291456->7340031) req@ffff88009d79d880 x1830881273319552/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.858235:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c:0x0] (7340032->8388607) req@ffff88009ea76d80 x1830881273320064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.858241:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79d880 with x1830881273319552 ext(6291456->7340031) 00002000:00100000:2.0:1746065160.858242:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76d80 with x1830881273320064 ext(7340032->8388607) 00002000:00010000:2.0:1746065160.858244:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea76d80 00002000:00010000:0.0:1746065160.858244:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79d880 00000100:00100000:2.0:1746065160.858255:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14079 00000100:00100000:0.0:1746065160.858259:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14080 00000100:00100000:2.0:1746065160.858260:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2002:x1830881273319808:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065160.858265:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2002:x1830881273320064:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065160.858856:0:9563:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2003:x1830881273319296:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 22256us (22458us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065160.858862:0:9563:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14077 00002000:00100000:1.0:1746065160.858867:0:9563:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x1c:0x0] (6291456->7340031) req@ffff88009d79ca80 x1830881273319296/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.858873:0:9563:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79ca80 with x1830881273319296 ext(6291456->7340031) 00002000:00010000:1.0:1746065160.858875:0:9563:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d79ca80 00000100:00100000:2.0:1746065160.871489:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2002:x1830881273319808:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 13220us (13536us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.871499:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14079 00002000:00100000:2.0:1746065160.871508:0:20722:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1c:0x0] (7340032->8388607) req@ffff88009ea74a80 x1830881273319808/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.871516:0:20722:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea74a80 with x1830881273319808 ext(7340032->8388607) 00002000:00010000:2.0:1746065160.871521:0:20722:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea74a80 00000100:00100000:2.0:1746065160.875181:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2002:x1830881273320064:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 16908us (17175us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.875191:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14080 00002000:00100000:2.0:1746065160.875201:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1c:0x0] (7340032->8388607) req@ffff88009ea76d80 x1830881273320064/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.875209:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76d80 with x1830881273320064 ext(7340032->8388607) 00002000:00010000:2.0:1746065160.875214:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea76d80 00000100:00100000:0.0:1746065160.896907:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.899414:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273320320 00000100:00100000:2.0:1746065160.899426:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273320320 00000100:00100000:1.0:1746065160.899468:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00002000:00100000:2.0:1746065160.899469:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1c:0x0] (8388608->10485759) req@ffff88009ea75f80 x1830881273320320/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.899481:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881273320320 ext(8388608->10485759) 00002000:00010000:2.0:1746065160.899486:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea75f80 00000100:00100000:2.0:1746065160.899510:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273320576 00000100:00100000:2.0:1746065160.899512:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273320576 00000100:00100000:1.0:1746065160.899517:0:9563:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14081 00002000:00100000:2.0:1746065160.899525:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1c:0x0] (8388608->10485759) req@ffff880072f9aa00 x1830881273320576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00000100:00100000:1.0:1746065160.899525:0:9563:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2004:x1830881273320320:12345-192.168.202.8@tcp:3:cmp.0 00002000:00100000:2.0:1746065160.899531:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9aa00 with x1830881273320576 ext(8388608->10485759) 00002000:00010000:2.0:1746065160.899533:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f9aa00 00000100:00100000:2.0:1746065160.899544:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14082 00000100:00100000:2.0:1746065160.899549:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2004:x1830881273320576:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:1.0:1746065160.910077:0:9563:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2004:x1830881273320320:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 10544us (13167us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065160.910196:0:9563:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14081 00002000:00100000:1.0:1746065160.910208:0:9563:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x1c:0x0] (8388608->10485759) req@ffff88009ea75f80 x1830881273320320/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.910216:0:9563:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea75f80 with x1830881273320320 ext(8388608->10485759) 00002000:00010000:1.0:1746065160.910221:0:9563:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea75f80 00000100:00100000:2.0:1746065160.913146:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2004:x1830881273320576:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 13589us (13673us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065160.913156:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14082 00002000:00100000:2.0:1746065160.913165:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1c:0x0] (8388608->10485759) req@ffff880072f9aa00 x1830881273320576/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.913178:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880072f9aa00 with x1830881273320576 ext(8388608->10485759) 00002000:00010000:2.0:1746065160.913183:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880072f9aa00 00000100:00100000:0.0:1746065160.913631:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.913679:0:27162:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273320832 00000100:00100000:2.0:1746065160.913685:0:27162:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273320832 00002000:00100000:2.0:1746065160.913712:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1c:0x0] (10485760->11534335) req@ffff88009ea77800 x1830881273320832/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.913719:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77800 with x1830881273320832 ext(10485760->11534335) 00002000:00010000:2.0:1746065160.913722:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea77800 00000100:00100000:2.0:1746065160.913935:0:27162:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14083 00000100:00100000:2.0:1746065160.913942:0:27162:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273320832:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065160.915531:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.915620:0:9563:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273321088 00000100:00100000:1.0:1746065160.915631:0:9563:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273321088 00002000:00100000:1.0:1746065160.915664:0:9563:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1c:0x0] (10485760->11534335) req@ffff88009d79dc00 x1830881273321088/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.915673:0:9563:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79dc00 with x1830881273321088 ext(10485760->11534335) 00002000:00010000:1.0:1746065160.915678:0:9563:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79dc00 00000100:00100000:1.0:1746065160.915708:0:9563:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14084 00000100:00100000:1.0:1746065160.915715:0:9563:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2005:x1830881273321088:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:0.0:1746065160.921206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.921244:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.921277:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.921311:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273321344 00000100:00100000:0.0:1746065160.921319:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273321344 00002000:00100000:0.0:1746065160.921359:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (11534336->12582911) req@ffff88009ea76680 x1830881273321344/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.921369:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76680 with x1830881273321344 ext(11534336->12582911) 00002000:00010000:0.0:1746065160.921374:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea76680 00000100:00100000:0.0:1746065160.921388:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273321600 00000100:00100000:0.0:1746065160.921389:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273321600 00002000:00100000:0.0:1746065160.921401:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1c:0x0] (11534336->12582911) req@ffff88009ea76300 x1830881273321600/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.921407:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76300 with x1830881273321600 ext(11534336->12582911) 00002000:00010000:0.0:1746065160.921410:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea76300 00000100:00100000:0.0:1746065160.921417:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273321856 00000100:00100000:0.0:1746065160.921418:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273321856 00002000:00100000:0.0:1746065160.921425:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (12582912->13631487) req@ffff88009ea77100 x1830881273321856/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/0 e 0 to 0 dl 1746065171 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746065160.921431:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77100 with x1830881273321856 ext(12582912->13631487) 00002000:00010000:0.0:1746065160.921434:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea77100 00000100:00100000:0.0:1746065160.921444:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14085 00000100:00100000:0.0:1746065160.921451:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2005:x1830881273321344:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:3.0:1746065160.921794:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14086 00000100:00100000:3.0:1746065160.921802:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:2005:x1830881273321600:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065160.922185:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14087 00000100:00100000:2.0:1746065160.922193:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2005:x1830881273321856:12345-192.168.202.8@tcp:3:cmp.0 00000100:00100000:2.0:1746065160.926400:0:27162:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+16:2005:x1830881273320832:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 12450us (12761us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.926409:0:27162:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14083 00002000:00100000:2.0:1746065160.926419:0:27162:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1c:0x0] (10485760->11534335) req@ffff88009ea77800 x1830881273320832/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.926428:0:27162:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77800 with x1830881273320832 ext(10485760->11534335) 00002000:00010000:2.0:1746065160.926432:0:27162:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea77800 00000100:00100000:1.0:1746065160.928095:0:9563:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+22:2005:x1830881273321088:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 12359us (12547us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065160.928105:0:9563:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14084 00002000:00100000:1.0:1746065160.928112:0:9563:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1c:0x0] (10485760->11534335) req@ffff88009d79dc00 x1830881273321088/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746065160.928119:0:9563:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d79dc00 with x1830881273321088 ext(10485760->11534335) 00002000:00010000:1.0:1746065160.928123:0:9563:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d79dc00 00000100:00100000:2.0:1746065160.937669:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2005:x1830881273321856:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 15469us (16382us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065160.937675:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:2005:x1830881273321600:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 15874us (16430us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.937682:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14087 00000100:00100000:3.0:1746065160.937688:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14086 00002000:00100000:3.0:1746065160.937691:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1c:0x0] (11534336->12582911) req@ffff88009ea76300 x1830881273321600/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.937691:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x1c:0x0] (12582912->13631487) req@ffff88009ea77100 x1830881273321856/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746065160.937700:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76300 with x1830881273321600 ext(11534336->12582911) 00002000:00100000:2.0:1746065160.937700:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea77100 with x1830881273321856 ext(12582912->13631487) 00002000:00010000:3.0:1746065160.937704:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea76300 00002000:00010000:2.0:1746065160.937704:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea77100 00000100:00100000:2.0:1746065160.939520:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2005:x1830881273321344:12345-192.168.202.8@tcp:3:cmp.0 Request processed in 18063us (18318us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.939528:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14085 00002000:00100000:2.0:1746065160.939536:0:27163:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x1c:0x0] (11534336->12582911) req@ffff88009ea76680 x1830881273321344/t0(0) o3->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:76/0 lens 488/440 e 0 to 0 dl 1746065171 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746065160.939543:0:27163:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea76680 with x1830881273321344 ext(11534336->12582911) 00002000:00010000:2.0:1746065160.939547:0:27163:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea76680 00000100:00100000:2.0:1746065160.953599:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.953653:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273322112 00000100:00100000:1.0:1746065160.953660:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273322112 00000100:00100000:1.0:1746065160.953705:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 216 00000100:00100000:1.0:1746065160.953711:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+29:3835:x1830881273322112:12345-192.168.202.8@tcp:35:cmp.0 00000100:00100000:1.0:1746065160.953890:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+30:3835:x1830881273322112:12345-192.168.202.8@tcp:35:cmp.0 Request processed in 179us (298us total) trans 4294983648 rc 0/0 00000100:00100000:1.0:1746065160.953896:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 216 00000100:00100000:0.0:1746065160.954920:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065160.954975:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273322368 00000100:00100000:2.0:1746065160.954978:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273322368 00000100:00100000:2.0:1746065160.955005:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 217 00000100:00100000:2.0:1746065160.955010:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+30:3835:x1830881273322368:12345-192.168.202.8@tcp:35:cmp.0 00000100:00100000:2.0:1746065160.956325:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+31:3835:x1830881273322368:12345-192.168.202.8@tcp:35:cmp.0 Request processed in 1310us (1402us total) trans 4294983649 rc 0/0 00000100:00100000:2.0:1746065160.956332:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 217 00000100:00100000:0.0:1746065160.966907:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.967474:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273322624 00000100:00100000:3.0:1746065160.967483:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273322624 00000100:00100000:2.0:1746065160.967537:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36601 00000100:00100000:2.0:1746065160.967548:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:3838:x1830881273322624:12345-192.168.202.8@tcp:36:rm.0 00010000:00010000:2.0:1746065160.967590:0:7213:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065160.967612:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079da5400/0x392ae0376f8813d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d95 expref: 37 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.967691:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f847200/0x392ae0376f881356 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d6b expref: 36 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.967703:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:2.0:1746065160.967712:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072615e00/0x392ae0376f881532 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6df7 expref: 35 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.967718:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065160.967720:0:7213:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065160.967735:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065160.967755:0:7213:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e1a expref: 30 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.967761:0:7213:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065160.967784:0:7213:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e1a expref: 30 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.967794:0:7213:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e1a expref: 30 pid: 21520 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746065160.967805:0:7213:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7213:1830881267834112:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065160.967881:0:7213:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065160.967919:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065160.968029:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273322752 00000100:00100000:1.0:1746065160.968033:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273322752 00000100:00100000:1.0:1746065160.968057:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 688 00000100:00100000:1.0:1746065160.968062:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2003:x1830881273322752:12345-192.168.202.8@tcp:63:ll_sa.0 00010000:00010000:1.0:1746065160.968078:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.968100:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f881635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f08 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.968124:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f88163c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968132:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f88163c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968140:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f88163c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968151:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f881643 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968156:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f881643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968161:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f881643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968188:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f88163c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968193:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f88163c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968199:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f88163c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968203:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072569400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065160.968207:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f88163c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968213:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f88163c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968219:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065160.968221:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065160.968223:0:7216:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065160.968229:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f88163c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968234:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f88163c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968255:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f881643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968259:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f881643 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968264:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f881643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968267:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072568800 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065160.968270:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f881643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968274:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f881643 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968279:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff88009ff21d00) 00010000:00010000:1.0:1746065160.968281:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065160.968283:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f881643 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968286:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f881643 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065160.968307:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f881635 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f08 expref: 36 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.968313:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065160.968315:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065160.968318:0:7216:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065160.968323:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f881635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f08 expref: 36 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.968330:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072568600, rc -2) 00000100:00100000:1.0:1746065160.968370:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+35:2003:x1830881273322752:12345-192.168.202.8@tcp:63:ll_sa.0 Request processed in 307us (455us total) trans 0 rc -2/-2 00000100:00100000:1.0:1746065160.968376:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 688 00000100:00100000:2.0:1746065160.973623:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065160.973712:0:7213:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7213:1830881267834112:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065160.973729:0:7213:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000100:00100000:1.0:1746065160.973838:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273322880 00000100:00100000:1.0:1746065160.973844:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273322880 00010000:00010000:1.0:1746065160.973872:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e1a expref: 31 pid: 21520 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746065160.974349:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14850 00000100:00100000:1.0:1746065160.974356:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+31:2005:x1830881273322880:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065160.974368:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065160.974373:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e1a expref: 31 pid: 21520 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746065160.974383:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e1a expref: 31 pid: 21520 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746065160.974400:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f88157f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e1a expref: 31 pid: 21520 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746065160.974410:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065160.974414:0:8359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065160.974422:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065160.974427:0:8359:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065160.974446:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065160.974479:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+30:2005:x1830881273322880:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 124us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.974484:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14850 00010000:00010000:0.0:1746065160.974677:0:7213:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:0.0:1746065160.974683:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:0.0:1746065160.974696:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:0.0:1746065160.974703:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:0.0:1746065160.974708:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:0.0:1746065160.974783:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:0.0:1746065160.974791:0:7213:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d87 expref: 29 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.974798:0:7213:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:0.0:1746065160.974819:0:7213:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d87 expref: 29 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.974835:0:7213:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d87 expref: 29 pid: 21520 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746065160.974845:0:7213:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ea75880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7213:1830881267834240:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065160.975799:0:7213:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065160.980762:0:7213:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ea75880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7213:1830881267834240:192.168.202.8@tcp:104: 00010000:00010000:2.0:1746065160.981122:0:7213:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000100:00100000:0.0:1746065160.981563:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065160.981674:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273323008 00000100:00100000:3.0:1746065160.981681:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273323008 00010000:00010000:3.0:1746065160.981707:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d87 expref: 30 pid: 21520 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746065160.981748:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14851 00000100:00100000:3.0:1746065160.981755:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+30:2004:x1830881273323008:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065160.981766:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065160.981771:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d87 expref: 30 pid: 21520 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746065160.981780:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d87 expref: 30 pid: 21520 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746065160.981797:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09fae00/0x392ae0376f8813a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d87 expref: 30 pid: 21520 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746065160.981820:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:3.0:1746065160.981825:0:7198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.981831:0:7198:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.981837:0:7198:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.981851:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065160.981884:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+29:2004:x1830881273323008:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 129us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.981890:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14851 00010000:00010000:3.0:1746065160.981952:0:7213:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.981957:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000040:00080000:3.0:1746065160.982160:0:7213:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9216 00000004:00080000:3.0:1746065160.982166:0:7213:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760102084662ns, next at 761102083126ns, rc = 0 00000040:00080000:3.0:1746065160.982182:0:7213:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].15, 64 off9152 00000004:00080000:3.0:1746065160.982187:0:7213:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760102105302ns, next at 761102104684ns, rc = 0 00010000:00010000:3.0:1746065160.982222:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982230:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982236:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982241:0:7213:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982246:0:7213:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982251:0:7213:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982261:0:7213:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065160.982274:0:7213:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982278:0:7213:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982282:0:7213:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982286:0:7213:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe71c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065160.982289:0:7213:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982294:0:7213:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982303:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:3.0:1746065160.982305:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065160.982307:0:7213:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982311:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71c00/0x392ae0376f881651 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982389:0:7213:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982394:0:7213:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982398:0:7213:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982401:0:7213:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982404:0:7213:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d184c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065160.982406:0:7213:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982410:0:7213:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982416:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065160.982417:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065160.982419:0:7213:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982423:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f88162e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00000004:00010000:3.0:1746065160.982429:0:7213:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ea74380 reply state ffff88012f0a3000 transno 4294983650 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982436:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982440:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:3.0:1746065160.982442:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065160.982444:0:7213:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065160.982490:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:3838:x1830881273322624:12345-192.168.202.8@tcp:36:rm.0 Request processed in 14945us (15591us total) trans 4294983650 rc 0/0 00000100:00100000:3.0:1746065160.982496:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36601 00010000:00010000:3.0:1746065160.982513:0:7201:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065160.982516:0:7201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982521:0:7201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd10c00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065160.982523:0:7201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982527:0:7201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982533:0:7201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4b:0x0].0x0 (ffff880072c11800) 00010000:00010000:3.0:1746065160.982534:0:7201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1746065160.982536:0:7201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982540:0:7201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881658 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065160.982549:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.982551:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.982552:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065161.052167:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.052359:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273323136 00000100:00100000:3.0:1746065161.052366:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273323136 00000100:00100000:3.0:1746065161.052452:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36602 00000100:00100000:3.0:1746065161.052459:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+36:3841:x1830881273323136:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:3.0:1746065161.052477:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065161.052490:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f88165f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f40 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.052539:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f881666 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.052548:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f881666 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.052556:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f881666 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:3.0:1746065161.052585:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1746065161.052587:0:7213:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065161.052613:0:7213:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f881666 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.052630:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f88165f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f40 expref: 38 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.052779:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f881666 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f40 expref: 37 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.052786:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065161.052789:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065161.052792:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd10e00, rc 0) 00000100:00100000:3.0:1746065161.052832:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:3841:x1830881273323136:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 374us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065161.052837:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36602 00000100:00100000:0.0:1746065161.056191:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.056282:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273323392 00000100:00100000:3.0:1746065161.056289:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273323392 00000100:00100000:3.0:1746065161.056324:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36603 00000100:00100000:3.0:1746065161.056330:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+37:3841:x1830881273323392:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:3.0:1746065161.056343:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065161.056346:0:7213:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065161.056495:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f881666 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f40 expref: 37 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.056523:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065161.056527:0:7213:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065161.056537:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f88166d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f47 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.056626:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056636:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056643:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056652:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056658:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056664:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056922:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056928:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056933:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:3.0:1746065161.056939:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4c:0x0]: returning size 0 00010000:00010000:3.0:1746065161.056953:0:7213:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056958:0:7213:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056963:0:7213:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056969:0:7213:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056973:0:7213:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd10c00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:3.0:1746065161.056976:0:7213:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056982:0:7213:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056988:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065161.056991:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065161.056994:0:7213:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.056998:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f881674 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00000004:00010000:3.0:1746065161.057005:0:7213:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c323480 reply state ffff88012fb9f000 transno 4294983651 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.057011:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.057016:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:3.0:1746065161.057018:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065161.057020:0:7213:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065161.057036:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f88166d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f47 expref: 39 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.057046:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f47 expref: 38 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.057051:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4c:0x0].0x0 (ffff88009fd0d300) 00010000:00010000:3.0:1746065161.057052:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065161.057054:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:3.0:1746065161.057131:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:3841:x1830881273323392:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 799us (946us total) trans 4294983651 rc 0/0 00000100:00100000:3.0:1746065161.057137:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36603 00000100:00100000:0.0:1746065161.064759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.064861:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273323648 00000100:00100000:3.0:1746065161.064869:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273323648 00000100:00100000:3.0:1746065161.065183:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36604 00000100:00100000:3.0:1746065161.065190:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:3841:x1830881273323648:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:3.0:1746065161.065212:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065161.065226:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x392ae0376f881690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f4e expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.065303:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.065313:0:7213:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f47 expref: 40 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.065319:0:7213:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:3.0:1746065161.065341:0:7213:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f47 expref: 40 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.065350:0:7213:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f47 expref: 40 pid: 7213 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746065161.065360:0:7213:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f6a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7213:1830881267834368:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065161.065442:0:7213:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb84600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065161.067076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.067194:0:7213:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f6a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7213:1830881267834368:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065161.067210:0:7213:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000100:00100000:1.0:1746065161.067276:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273323776 00000100:00100000:1.0:1746065161.067281:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273323776 00010000:00010000:1.0:1746065161.067303:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f47 expref: 41 pid: 7213 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746065161.067323:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14852 00000100:00100000:1.0:1746065161.067329:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:2005:x1830881273323776:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065161.067337:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065161.067342:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f47 expref: 41 pid: 7213 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746065161.067351:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f47 expref: 41 pid: 7213 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746065161.067366:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x392ae0376f881682 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f47 expref: 41 pid: 7213 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746065161.067380:0:8359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4c:0x0].0x0 (ffff88009fd0d300) 00010000:00010000:1.0:1746065161.067384:0:8359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065161.067391:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065161.067397:0:8359:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065161.067425:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065161.067454:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:2005:x1830881273323776:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 125us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065161.067459:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14852 00010000:00010000:2.0:1746065161.067909:0:7213:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065161.067916:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:2.0:1746065161.067931:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4c:0x0]: returning size 0 00000004:00080000:2.0:1746065161.068041:0:7213:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d:0x0], index 1: 0 00000004:00080000:2.0:1746065161.068046:0:7213:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1d:0x0], index 0: 0 00010000:00010000:2.0:1746065161.068517:0:7213:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065161.068524:0:7213:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065161.068529:0:7213:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065161.068533:0:7213:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd11600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065161.068536:0:7213:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065161.068542:0:7213:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065161.068550:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4c:0x0].0x0 (ffff88009fd0d300) 00010000:00010000:2.0:1746065161.068552:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065161.068555:0:7213:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065161.068560:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11600/0x392ae0376f881697 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065161.068608:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x392ae0376f881690 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f4e expref: 40 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.068614:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x392ae0376f881690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f4e expref: 40 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.068622:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:2.0:1746065161.068663:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:3841:x1830881273323648:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 3473us (3923us total) trans 4294983652 rc 301/301 00000100:00100000:2.0:1746065161.068669:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36604 00000100:00100000:0.0:1746065161.070234:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065161.070691:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273324032 00000100:00100000:2.0:1746065161.070698:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273324032 00000100:00100000:2.0:1746065161.070731:0:7214:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 218 00000100:00100000:2.0:1746065161.070753:0:7214:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+39:3841:x1830881273324032:12345-192.168.202.8@tcp:35:lfs.0 00000100:00100000:2.0:1746065161.070912:0:7214:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:3841:x1830881273324032:12345-192.168.202.8@tcp:35:lfs.0 Request processed in 174us (682us total) trans 4294983653 rc 0/0 00000100:00100000:2.0:1746065161.070918:0:7214:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 218 00000100:00100000:0.0:1746065161.073072:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065161.073205:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273324160 00000100:00100000:2.0:1746065161.073211:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273324160 00000100:00100000:2.0:1746065161.073362:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36605 00000100:00100000:2.0:1746065161.073370:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+40:3841:x1830881273324160:12345-192.168.202.8@tcp:101:lfs.0 00010000:00010000:2.0:1746065161.073385:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065161.073401:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f8816a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f55 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.073444:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f8816a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f55 expref: 41 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.073455:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184c00/0x392ae0376f8816a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f55 expref: 41 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.073467:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4c:0x0].0x0 (ffff880072c20e00) 00010000:00010000:2.0:1746065161.073470:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065161.073472:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d184c00, rc 0) 00000100:00100000:2.0:1746065161.073503:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:3841:x1830881273324160:12345-192.168.202.8@tcp:101:lfs.0 Request processed in 134us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065161.073508:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36605 00000100:00100000:3.0:1746065161.078719:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065161.078754:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273324416 00000100:00100000:1.0:1746065161.078762:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273324416 00000100:00100000:1.0:1746065161.078807:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 219 00000100:00100000:1.0:1746065161.078814:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+41:3841:x1830881273324416:12345-192.168.202.8@tcp:35:lfs.0 00000100:00100000:1.0:1746065161.078985:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:3841:x1830881273324416:12345-192.168.202.8@tcp:35:lfs.0 Request processed in 170us (272us total) trans 4294983654 rc 0/0 00000100:00100000:1.0:1746065161.078991:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 219 00000100:00100000:0.0:1746065161.089596:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065161.089805:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273324544 00000100:00100000:2.0:1746065161.089812:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273324544 00000100:00100000:2.0:1746065161.089854:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36606 00000100:00100000:2.0:1746065161.089859:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+42:3842:x1830881273324544:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065161.089876:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065161.089889:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f8816ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f5c expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.089931:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184200/0x392ae0376f8816b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.089939:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184200/0x392ae0376f8816b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.089947:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184200/0x392ae0376f8816b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:2.0:1746065161.089979:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1746065161.089982:0:21520:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065161.089993:0:21520:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184200/0x392ae0376f8816b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.090006:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f8816ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f5c expref: 44 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.090033:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184200/0x392ae0376f8816b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f5c expref: 43 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.090039:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065161.090041:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065161.090043:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d184200, rc 0) 00000100:00100000:2.0:1746065161.090075:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:3842:x1830881273324544:12345-192.168.202.8@tcp:101:dd.0 Request processed in 216us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065161.090095:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36606 00000100:00100000:0.0:1746065161.091122:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065161.091350:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273324672 00000100:00100000:1.0:1746065161.091354:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273324672 00000100:00100000:1.0:1746065161.091379:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36607 00000100:00100000:1.0:1746065161.091384:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+29:3843:x1830881273324672:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:1.0:1746065161.091396:0:7213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065161.091404:0:7213:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x392ae0376f8816ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f63 expref: -99 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065161.091432:0:7213:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f8816c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065161.091440:0:7213:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f8816c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065161.091447:0:7213:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f8816c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00000004:00200000:1.0:1746065161.091467:0:7213:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1746065161.091469:0:7213:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065161.091477:0:7213:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f8816c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7213 initiator: MDT0 00010000:00010000:1.0:1746065161.091490:0:7213:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x392ae0376f8816ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f63 expref: 31 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065161.091503:0:7213:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f8816c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f63 expref: 30 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065161.091509:0:7213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065161.091511:0:7213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065161.091514:0:7213:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06400, rc 0) 00000100:00100000:1.0:1746065161.091535:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+30:3843:x1830881273324672:12345-192.168.202.8@tcp:101:dd.0 Request processed in 151us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065161.091539:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36607 00000100:00100000:2.0:1746065161.094737:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065161.094771:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273324928 00000100:00100000:2.0:1746065161.094777:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273324928 00000100:00100000:2.0:1746065161.094807:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36608 00000100:00100000:2.0:1746065161.094813:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+30:3843:x1830881273324928:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065161.094827:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065161.094840:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185c00/0x392ae0376f8816c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f6a expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.094906:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x392ae0376f8816cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.094920:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x392ae0376f8816cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x47:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.094929:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x392ae0376f8816cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x47:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:2.0:1746065161.094937:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x47:0x0]: returning size 26214400 00010000:00010000:2.0:1746065161.095009:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185c00/0x392ae0376f8816c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f6a expref: 33 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.095020:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x392ae0376f8816cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x47:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f6a expref: 32 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.095027:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x47:0x0].0x0 (ffff88009ffab900) 00010000:00010000:2.0:1746065161.095029:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065161.095031:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:2.0:1746065161.095064:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+32:3843:x1830881273324928:12345-192.168.202.8@tcp:101:dd.0 Request processed in 251us (333us total) trans 4294983655 rc 0/0 00000100:00100000:2.0:1746065161.095070:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36608 00000100:00100000:1.0:1746065161.095328:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.095445:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273325184 00000100:00100000:3.0:1746065161.095449:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273325184 00000100:00100000:3.0:1746065161.095469:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36609 00000100:00100000:3.0:1746065161.095474:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+43:3842:x1830881273325184:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1746065161.095481:0:8367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065161.095483:0:8367:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065161.095495:0:8367:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184200/0x392ae0376f8816b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f5c expref: 43 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.095505:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:3.0:1746065161.095508:0:8367:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065161.095512:0:8367:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f8816dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f71 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.095552:0:8367:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f8816e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8367 initiator: MDT0 00010000:00010000:3.0:1746065161.095560:0:8367:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f8816e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8367 initiator: MDT0 00010000:00010000:3.0:1746065161.095566:0:8367:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f8816e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8367 initiator: MDT0 00000004:00200000:3.0:1746065161.095572:0:8367:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4a:0x0]: returning size 26214400 00010000:00010000:3.0:1746065161.095610:0:8367:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10c00/0x392ae0376f8816dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f71 expref: 45 pid: 8367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.095620:0:8367:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f8816e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f71 expref: 44 pid: 8367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.095625:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4a:0x0].0x0 (ffff88009ffabb00) 00010000:00010000:3.0:1746065161.095627:0:8367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065161.095629:0:8367:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd10e00, rc 0) 00000100:00100000:3.0:1746065161.095650:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:3842:x1830881273325184:12345-192.168.202.8@tcp:101:dd.0 Request processed in 176us (322us total) trans 4294983656 rc 0/0 00000100:00100000:3.0:1746065161.095655:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36609 00000100:00100000:2.0:1746065161.096768:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065161.099329:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273325312 00000100:00100000:1.0:1746065161.099337:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273325312 00000100:00100000:1.0:1746065161.099382:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 689 00000100:00100000:1.0:1746065161.099388:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2004:x1830881273325312:12345-192.168.202.8@tcp:63:ll_sa.0 00010000:00010000:1.0:1746065161.099413:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065161.099425:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x392ae0376f8816f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f78 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065161.099458:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x392ae0376f8816f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099467:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x392ae0376f8816f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099475:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x392ae0376f8816f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099483:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881700 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099489:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099493:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099558:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f881707 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099564:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f881707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099568:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f881707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00000004:00200000:1.0:1746065161.099582:0:7216:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4c:0x0]: returning size 0 00000004:00200000:1.0:1746065161.099585:0:7216:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065161.099595:0:7216:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f881707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099602:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f881707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099608:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x392ae0376f8816f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099613:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x392ae0376f8816f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099618:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x392ae0376f8816f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099623:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06a00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065161.099626:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x392ae0376f8816f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099632:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x392ae0376f8816f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099647:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065161.099650:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065161.099653:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x392ae0376f8816f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099658:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x392ae0376f8816f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099669:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099674:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099678:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099682:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072569e00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065161.099685:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099689:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881700 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099693:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:1.0:1746065161.099695:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065161.099696:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881700 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099700:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072569e00/0x392ae0376f881700 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099715:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x392ae0376f8816f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f78 expref: 46 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065161.099724:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568600/0x392ae0376f881707 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f78 expref: 45 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065161.099730:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4c:0x0].0x0 (ffff880072c20e00) 00010000:00010000:1.0:1746065161.099731:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065161.099733:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072568600, rc 0) 00010000:00010000:1.0:1746065161.099736:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065161.099752:0:7216:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f88170e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6f7f expref: -99 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065161.099766:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099772:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099781:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099789:0:7216:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88171c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099794:0:7216:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88171c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099798:0:7216:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88171c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099809:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099814:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881715 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099818:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099822:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072569400 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065161.099824:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099829:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881715 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099834:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065161.099836:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065161.099838:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099842:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072569400/0x392ae0376f881715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099849:0:7216:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88171c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099853:0:7216:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88171c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099858:0:7216:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88171c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099861:0:7216:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880072568a00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:1.0:1746065161.099864:0:7216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88171c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099868:0:7216:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88171c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099872:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff88009ff21a00) 00010000:00010000:1.0:1746065161.099874:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065161.099876:0:7216:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88171c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099880:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568a00/0x392ae0376f88171c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 00010000:00010000:1.0:1746065161.099896:0:7216:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f88170e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f7f expref: 46 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065161.099902:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:1.0:1746065161.099904:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065161.099906:0:7216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880072568800/0x392ae0376f88170e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f7f expref: 46 pid: 7216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065161.099916:0:7216:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072568800, rc -2) 00000100:00100000:1.0:1746065161.100263:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2004:x1830881273325312:12345-192.168.202.8@tcp:63:ll_sa.0 Request processed in 874us (3495us total) trans 0 rc -2/-2 00000100:00100000:1.0:1746065161.100270:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 689 00000100:00100000:1.0:1746065161.100813:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065161.101945:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.102029:0:27163:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273325952 00000100:00100000:3.0:1746065161.102035:0:27163:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273325952 00000100:00100000:3.0:1746065161.102072:0:27163:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14088 00000100:00100000:3.0:1746065161.102095:0:27163:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2004:x1830881273325952:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:3.0:1746065161.102117:0:27163:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f881723 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.102126:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065161.102127:0:27163:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065161.102131:0:27163:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f881723 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.102141:0:27163:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f881723 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065161.103639:0:21520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273325568 00000100:00100000:2.0:1746065161.103646:0:21520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273325568 00000100:00100000:2.0:1746065161.103677:0:21520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 36610 00000100:00100000:2.0:1746065161.103683:0:21520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+32:3843:x1830881273325568:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:2.0:1746065161.103696:0:21520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065161.103699:0:21520:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065161.103715:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x392ae0376f8816c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f63 expref: 32 pid: 7213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.103736:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065161.103753:0:21520:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065161.103760:0:21520:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185c00/0x392ae0376f88172a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6fb0 expref: -99 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.103846:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f881731 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.103854:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f881731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.103861:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f881731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.103873:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f881738 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.103880:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f881738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.103885:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f881738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.103922:0:21520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b15800/0x392ae0376f88173f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.103928:0:21520:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b15800/0x392ae0376f88173f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.103934:0:21520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b15800/0x392ae0376f88173f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21520 initiator: MDT0 00000004:00200000:2.0:1746065161.103940:0:21520:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000402:0x4c:0x0]: returning size 0 00010000:00010000:2.0:1746065161.103990:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f881731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.103996:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f881731 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104001:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f881731 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104006:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d184e00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065161.104009:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f881731 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104013:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f881731 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104019:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880072821e00) 00010000:00010000:2.0:1746065161.104022:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065161.104024:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f881731 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104029:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d184e00/0x392ae0376f881731 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104035:0:21520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f881738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104039:0:21520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f881738 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104043:0:21520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f881738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104047:0:21520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d185200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065161.104049:0:21520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f881738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104053:0:21520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f881738 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104057:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:2.0:1746065161.104059:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065161.104061:0:21520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f881738 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104065:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185200/0x392ae0376f881738 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065161.104102:0:21520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d185c00/0x392ae0376f88172a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb0 expref: 34 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.104112:0:21520:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0b15800/0x392ae0376f88173f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb0 expref: 33 pid: 21520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.104117:0:21520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4c:0x0].0x0 (ffff880072c20e00) 00010000:00010000:2.0:1746065161.104119:0:21520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065161.104121:0:21520:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0b15800, rc 0) 00000100:00100000:2.0:1746065161.104150:0:21520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+33:3843:x1830881273325568:12345-192.168.202.8@tcp:101:dd.0 Request processed in 467us (3338us total) trans 4294983657 rc 0/0 00000100:00100000:2.0:1746065161.104155:0:21520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 36610 00000100:00100000:1.0:1746065161.104688:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065161.104717:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065161.105106:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273326080 00000100:00100000:2.0:1746065161.105110:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273326080 00000100:00100000:2.0:1746065161.105140:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30898 00000100:00100000:2.0:1746065161.105145:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+19:2004:x1830881273326080:12345-192.168.202.8@tcp:101:ll_agl.0 00010000:00010000:2.0:1746065161.105154:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065161.105166:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f88174d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6fb7 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065161.105180:0:21550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065161.105192:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065161.105194:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065161.105200:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f88174d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb7 expref: 20 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065161.105210:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f88174d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb7 expref: 20 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065161.105217:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f835000, rc 0) 00000100:00100000:2.0:1746065161.105239:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+20:2004:x1830881273326080:12345-192.168.202.8@tcp:101:ll_agl.0 Request processed in 94us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065161.105244:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30898 00000100:00100000:2.0:1746065161.105260:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273325824 00000100:00100000:2.0:1746065161.105263:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273325824 00000100:00100000:2.0:1746065161.105284:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 520 00000100:00100000:2.0:1746065161.105290:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:2002:x1830881273325824:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065161.105296:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065161.105306:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd10e00/0x392ae0376f8816e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f71 expref: 45 pid: 8367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.105314:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4a:0x0].0x0 (ffff88009ffabb00) 00010000:00010000:2.0:1746065161.105317:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065161.105328:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:2002:x1830881273325824:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 39us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065161.105336:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 520 00000100:00100000:0.0:1746065161.105857:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065161.105914:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273326208 00000100:00100000:1.0:1746065161.105918:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273326208 00000100:00100000:1.0:1746065161.105947:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30899 00000100:00100000:1.0:1746065161.105952:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273326208:12345-192.168.202.8@tcp:101:ll_agl.0 00010000:00010000:1.0:1746065161.105959:0:9560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065161.105968:0:9560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881754 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6fbe expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065161.105981:0:9560:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065161.105989:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065161.105990:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065161.105994:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881754 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fbe expref: 10 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065161.106004:0:9560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881754 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fbe expref: 10 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065161.106010:0:9560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f85ce00, rc 0) 00000100:00100000:1.0:1746065161.106029:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273326208:12345-192.168.202.8@tcp:101:ll_agl.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065161.106033:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30899 00000100:00100000:0.0:1746065161.112586:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065161.112694:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273326464 00000100:00100000:2.0:1746065161.112701:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273326464 00000100:00100000:2.0:1746065161.112774:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14089 00000100:00100000:2.0:1746065161.112781:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881273326464:12345-192.168.202.8@tcp:3:dd.0 00010000:00010000:2.0:1746065161.112812:0:28841:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d185c00/0x392ae0376f88175b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.112822:0:28841:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065161.112824:0:28841:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065161.112828:0:28841:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d185c00/0x392ae0376f88175b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.112838:0:28841:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d185c00/0x392ae0376f88175b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065161.113809:0:27163:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f881723 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065161.113820:0:27163:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f881723 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065161.113825:0:27163:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f881723 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065161.113831:0:27163:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd11600 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065161.113834:0:27163:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f881723 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065161.113841:0:27163:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f881723 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065161.113854:0:27163:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f881723 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065161.113858:0:27163:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd11600/0x392ae0376f881723 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065161.113907:0:27163:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2004:x1830881273325952:12345-192.168.202.8@tcp:3:dd.0 Request processed in 11828us (11962us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065161.113914:0:27163:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14088 00000100:00100000:0.0:1746065161.114836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.115182:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273326592 00000100:00100000:3.0:1746065161.115189:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273326592 00000100:00100000:3.0:1746065161.116265:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30900 00000100:00100000:3.0:1746065161.116272:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+20:3843:x1830881273326592:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1746065161.116286:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065161.116300:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f525200/0x392ae0376f881762 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6fc5 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.116328:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f88174d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb7 expref: 17 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065161.116339:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065161.116340:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065161.116343:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f525200/0x392ae0376f881762 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fc5 expref: 21 pid: 21550 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746065161.116357:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746065161.116366:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f88174d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb7 expref: 17 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065161.116376:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f88174d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb7 expref: 17 pid: 21550 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746065161.116386:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f6ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267834496:192.168.202.8@tcp:104: 00000100:00100000:3.0:1746065161.116461:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065161.119338:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f6ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:21550:1830881267834496:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065161.119362:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f525200/0x392ae0376f881762 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fc5 expref: 21 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.119376:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f525200, rc 0) 00000100:00100000:3.0:1746065161.119724:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+21:3843:x1830881273326592:12345-192.168.202.8@tcp:101:dd.0 Request processed in 3450us (4888us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065161.119731:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30900 00000100:00100000:0.0:1746065161.119863:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:3.0:1746065161.120209:0:28841:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d185c00/0x392ae0376f88175b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.120218:0:28841:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d185c00/0x392ae0376f88175b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.120225:0:28841:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d185c00/0x392ae0376f88175b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.120230:0:28841:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d185c00 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065161.120234:0:28841:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d185c00/0x392ae0376f88175b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.120240:0:28841:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d185c00/0x392ae0376f88175b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.120253:0:28841:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d185c00/0x392ae0376f88175b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.120259:0:28841:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d185c00/0x392ae0376f88175b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28841 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065161.120412:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273326720 00000100:00100000:2.0:1746065161.120418:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273326720 00010000:00010000:2.0:1746065161.120438:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f88174d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb7 expref: 18 pid: 21550 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746065161.120455:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14853 00000100:00100000:2.0:1746065161.120459:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+18:2005:x1830881273326720:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065161.120467:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065161.120480:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f88174d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb7 expref: 18 pid: 21550 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746065161.120492:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f88174d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb7 expref: 18 pid: 21550 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746065161.120504:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f835000/0x392ae0376f88174d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fb7 expref: 18 pid: 21550 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746065161.120524:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065161.120526:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065161.120531:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f525200/0x392ae0376f881762 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fc5 expref: 20 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.120538:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f525200/0x392ae0376f881762 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fc5 expref: 20 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.120564:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f525200/0x392ae0376f881762 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fc5 expref: 20 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065161.120575:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267834624:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065161.120626:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065161.120707:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2004:x1830881273326464:12345-192.168.202.8@tcp:3:dd.0 Request processed in 7927us (8129us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065161.120715:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14089 00000100:00100000:0.0:1746065161.125666:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8359:1830881267834624:192.168.202.8@tcp:105: 00010000:00010000:0.0:1746065161.125686:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065161.125718:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+17:2005:x1830881273326720:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 5257us (5854us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065161.125727:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14853 00000100:00100000:0.0:1746065161.139968:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.140240:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273326848 00000100:00100000:3.0:1746065161.140248:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273326848 00000100:00100000:3.0:1746065161.140885:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 30901 00000100:00100000:3.0:1746065161.140894:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:3843:x1830881273326848:12345-192.168.202.8@tcp:101:dd.0 00010000:00010000:3.0:1746065161.140909:0:21550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065161.140923:0:21550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f881769 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6f97fe59d2e6fcc expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.140954:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881754 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fbe expref: 9 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065161.140960:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065161.140961:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065161.140964:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f881769 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fcc expref: 13 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.140989:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881754 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fbe expref: 9 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065161.140999:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881754 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fbe expref: 9 pid: 9560 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746065161.141009:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f6ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267834752:192.168.202.8@tcp:104: 00000100:00080000:1.0:1746065161.141800:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065161.142273:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fb846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065161.143955:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f6ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267834752:192.168.202.8@tcp:104: 00010000:00010000:3.0:1746065161.143976:0:21550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f881769 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fcc expref: 13 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065161.143989:0:21550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130641c00, rc 0) 00000100:00100000:3.0:1746065161.144029:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:3843:x1830881273326848:12345-192.168.202.8@tcp:101:dd.0 Request processed in 3136us (4080us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065161.144036:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 30901 00000100:00100000:0.0:1746065161.145145:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065161.145236:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273326976 00000100:00100000:2.0:1746065161.145246:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273326976 00010000:00010000:2.0:1746065161.145270:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881754 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fbe expref: 10 pid: 9560 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746065161.145300:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14854 00000100:00100000:2.0:1746065161.145306:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2005:x1830881273326976:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065161.145317:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065161.145332:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881754 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fbe expref: 10 pid: 9560 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746065161.145342:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881754 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fbe expref: 10 pid: 9560 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746065161.145359:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f85ce00/0x392ae0376f881754 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fbe expref: 10 pid: 9560 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746065161.145384:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065161.145386:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065161.145393:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f881769 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fcc expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.145400:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f881769 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fcc expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065161.145424:0:8359:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130641c00/0x392ae0376f881769 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6fcc expref: 12 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065161.145433:0:8359:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267834880:192.168.202.8@tcp:105: 00000100:00100000:2.0:1746065161.145491:0:8359:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ea58b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065161.149619:0:8359:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8359:1830881267834880:192.168.202.8@tcp:105: 00010000:00010000:2.0:1746065161.149641:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065161.149683:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2005:x1830881273326976:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 4377us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065161.149694:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14854 00000100:00100000:1.0:1746065161.208414:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:2.0:1746065161.208492:0:20704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273327232 00000100:00100000:2.0:1746065161.208500:0:20704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273327232 00000100:00100000:2.0:1746065161.208542:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 220 00000100:00100000:2.0:1746065161.208548:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+44:3842:x1830881273327232:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:2.0:1746065161.208689:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+45:3842:x1830881273327232:12345-192.168.202.8@tcp:35:dd.0 Request processed in 140us (280us total) trans 4294983658 rc 0/0 00000100:00100000:2.0:1746065161.208694:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 220 00000100:00100000:0.0:1746065161.242938:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.243973:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273327488 00000100:00100000:3.0:1746065161.244106:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273327488 00002000:00100000:3.0:1746065161.244143:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1d:0x0] (0->4194303) req@ffff88009c321f80 x1830881273327488/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/0 e 0 to 0 dl 1746065172 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065161.244153:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321f80 with x1830881273327488 ext(0->4194303) 00002000:00010000:3.0:1746065161.244157:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c321f80 00000100:00100000:3.0:1746065161.244181:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14090 00000100:00100000:3.0:1746065161.244187:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+21:2004:x1830881273327488:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065161.246934:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065161.247003:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273327744 00000100:00100000:1.0:1746065161.247010:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273327744 00002000:00100000:1.0:1746065161.247041:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1d:0x0] (0->4194303) req@ffff88009c323100 x1830881273327744/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/0 e 0 to 0 dl 1746065172 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065161.247050:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323100 with x1830881273327744 ext(0->4194303) 00002000:00010000:1.0:1746065161.247055:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c323100 00000100:00100000:1.0:1746065161.247078:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14091 00000100:00100000:1.0:1746065161.247097:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2005:x1830881273327744:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:3.0:1746065161.285428:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+23:2004:x1830881273327488:12345-192.168.202.8@tcp:4:dd.0 Request processed in 41233us (42488us total) trans 4294972171 rc 0/0 00000100:00100000:3.0:1746065161.285439:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14090 00002000:00100000:3.0:1746065161.285450:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1d:0x0] (0->4194303) req@ffff88009c321f80 x1830881273327488/t4294972171(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/448 e 0 to 0 dl 1746065172 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065161.285460:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c321f80 with x1830881273327488 ext(0->4194303) 00002000:00010000:3.0:1746065161.285501:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c321f80 00000001:00080000:2.0:1746065161.287112:0:10896:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294972171 is committed 00000001:00080000:2.0:1746065161.287140:0:10896:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294972164 is committed 00010000:00010000:3.0:1746065161.289628:0:8891:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065161.304442:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2005:x1830881273327744:12345-192.168.202.8@tcp:4:dd.0 Request processed in 57336us (57506us total) trans 4294970778 rc 0/0 00000100:00100000:1.0:1746065161.304453:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14091 00002000:00100000:1.0:1746065161.304463:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1d:0x0] (0->4194303) req@ffff88009c323100 x1830881273327744/t4294970778(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/448 e 0 to 0 dl 1746065172 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065161.304472:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c323100 with x1830881273327744 ext(0->4194303) 00002000:00010000:1.0:1746065161.304478:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c323100 00000100:00100000:0.0:1746065161.312954:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:1.0:1746065161.314128:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273328000 00000100:00100000:1.0:1746065161.314137:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273328000 00002000:00100000:1.0:1746065161.314174:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1d:0x0] (4194304->8388607) req@ffff88009fac9f80 x1830881273328000/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/0 e 0 to 0 dl 1746065172 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065161.314183:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac9f80 with x1830881273328000 ext(4194304->8388607) 00002000:00010000:1.0:1746065161.314188:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac9f80 00000100:00100000:1.0:1746065161.314216:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14092 00000100:00100000:1.0:1746065161.314222:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+9:2004:x1830881273328000:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:0.0:1746065161.323340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.323409:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273328256 00000100:00100000:3.0:1746065161.323416:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273328256 00002000:00100000:3.0:1746065161.323448:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x1d:0x0] (4194304->8388607) req@ffff88009faca680 x1830881273328256/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/0 e 0 to 0 dl 1746065172 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065161.323458:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faca680 with x1830881273328256 ext(4194304->8388607) 00002000:00010000:3.0:1746065161.323463:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faca680 00000100:00100000:3.0:1746065161.323480:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14093 00000100:00100000:3.0:1746065161.323487:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+15:2004:x1830881273328256:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:1.0:1746065161.361763:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2004:x1830881273328000:12345-192.168.202.8@tcp:4:dd.0 Request processed in 47533us (48808us total) trans 4294972172 rc 0/0 00000100:00100000:1.0:1746065161.361774:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14092 00002000:00100000:1.0:1746065161.361785:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1d:0x0] (4194304->8388607) req@ffff88009fac9f80 x1830881273328000/t4294972172(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/448 e 0 to 0 dl 1746065172 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065161.361794:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac9f80 with x1830881273328000 ext(4194304->8388607) 00002000:00010000:1.0:1746065161.361798:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac9f80 00000100:00100000:3.0:1746065161.377487:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2004:x1830881273328256:12345-192.168.202.8@tcp:4:dd.0 Request processed in 53993us (54146us total) trans 4294970779 rc 0/0 00000100:00100000:3.0:1746065161.377502:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14093 00002000:00100000:3.0:1746065161.377513:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x1d:0x0] (4194304->8388607) req@ffff88009faca680 x1830881273328256/t4294970779(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/448 e 0 to 0 dl 1746065172 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065161.377523:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faca680 with x1830881273328256 ext(4194304->8388607) 00002000:00010000:3.0:1746065161.377527:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faca680 00000100:00100000:0.0:1746065161.393940:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:3.0:1746065161.394054:0:28841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273328512 00000100:00100000:3.0:1746065161.394061:0:28841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273328512 00002000:00100000:3.0:1746065161.394221:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1d:0x0] (8388608->12582911) req@ffff88009facbb80 x1830881273328512/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/0 e 0 to 0 dl 1746065172 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746065161.394231:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009facbb80 with x1830881273328512 ext(8388608->12582911) 00002000:00010000:3.0:1746065161.394235:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009facbb80 00000100:00100000:2.0:1746065161.394512:0:28841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14094 00000100:00100000:2.0:1746065161.394522:0:28841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009facbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+11:2003:x1830881273328512:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:1.0:1746065161.404005:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065161.404617:0:27166:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273328768 00000100:00100000:0.0:1746065161.404624:0:27166:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273328768 00002000:00100000:0.0:1746065161.404656:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1d:0x0] (8388608->12582911) req@ffff88009d1e0380 x1830881273328768/t0(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/0 e 0 to 0 dl 1746065172 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746065161.404666:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0380 with x1830881273328768 ext(8388608->12582911) 00002000:00010000:0.0:1746065161.404670:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e0380 00000100:00100000:0.0:1746065161.405949:0:27166:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14095 00000100:00100000:0.0:1746065161.405957:0:27166:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2003:x1830881273328768:12345-192.168.202.8@tcp:4:dd.0 00000100:00100000:2.0:1746065161.412383:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065161.412746:0:7214:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273329024 00000100:00100000:0.0:1746065161.412754:0:7214:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273329024 00000100:00100000:2.0:1746065161.413562:0:20704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 221 00000100:00100000:2.0:1746065161.413570:0:20704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+33:3843:x1830881273329024:12345-192.168.202.8@tcp:35:dd.0 00000100:00100000:2.0:1746065161.413941:0:20704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+34:3843:x1830881273329024:12345-192.168.202.8@tcp:35:dd.0 Request processed in 370us (1568us total) trans 4294983659 rc 0/0 00000100:00100000:2.0:1746065161.413947:0:20704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 221 00000100:00100000:2.0:1746065161.441995:0:28841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009facbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2003:x1830881273328512:12345-192.168.202.8@tcp:4:dd.0 Request processed in 47467us (48053us total) trans 4294972173 rc 0/0 00000100:00100000:2.0:1746065161.442007:0:28841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14094 00002000:00100000:2.0:1746065161.442017:0:28841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x1d:0x0] (8388608->12582911) req@ffff88009facbb80 x1830881273328512/t4294972173(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/448 e 0 to 0 dl 1746065172 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746065161.442031:0:28841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009facbb80 with x1830881273328512 ext(8388608->12582911) 00002000:00010000:2.0:1746065161.442036:0:28841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009facbb80 00000100:00100000:1.0:1746065161.458217:0:27166:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+19:2003:x1830881273328768:12345-192.168.202.8@tcp:4:dd.0 Request processed in 52251us (54209us total) trans 4294970780 rc 0/0 00000100:00100000:1.0:1746065161.458228:0:27166:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14095 00002000:00100000:1.0:1746065161.458237:0:27166:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x1d:0x0] (8388608->12582911) req@ffff88009d1e0380 x1830881273328768/t4294970780(0) o4->eb9e1243-8634-4680-83fd-4b7a1b6b07ce@192.168.202.8@tcp:77/0 lens 488/448 e 0 to 0 dl 1746065172 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746065161.458245:0:27166:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1e0380 with x1830881273328768 ext(8388608->12582911) 00002000:00010000:1.0:1746065161.458250:0:27166:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1e0380 00000001:02000400:3.0:1746065162.186528:0:28888:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_16j: @@@@@@ FAIL: dio copy 1 w/bsize 1049600 failed: 1 00010000:00010000:2.0:1746065162.291594:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065162.639334:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267835264:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639381:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065162.639417:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3766:1830881267835776:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639432:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065162.639442:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3766:1830881267836288:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639452:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065162.639465:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1746065162.639468:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3766:1830881267835136:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639479:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065162.639486:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3766:1830881267835648:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639497:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065162.639504:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3766:1830881267836160:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639513:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065162.639531:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267835776 00000100:00100000:2.0:1746065162.639536:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267835776 00000100:00100000:2.0:1746065162.639562:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267836288 00000100:00100000:2.0:1746065162.639564:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267836288 00000100:00100000:2.0:1746065162.639572:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267835136 00000100:00100000:2.0:1746065162.639573:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267835136 00000100:00100000:2.0:1746065162.639579:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267835648 00000100:00100000:2.0:1746065162.639580:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267835648 00000100:00100000:2.0:1746065162.639586:0:7213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267836160 00000100:00100000:2.0:1746065162.639587:0:7213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267836160 00000100:00100000:2.0:1746065162.639596:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:2.0:1746065162.639601:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3766:x1830881267835776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639629:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3766:x1830881267835776:12345-0@lo:400:kworker.0 Request processed in 28us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065162.639633:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:2.0:1746065162.639643:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1746065162.639646:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3766:x1830881267836288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639657:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3766:x1830881267836288:12345-0@lo:400:kworker.0 Request processed in 11us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065162.639661:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1746065162.639666:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:2.0:1746065162.639669:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3766:x1830881267835136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639680:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3766:x1830881267835136:12345-0@lo:400:kworker.0 Request processed in 11us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065162.639684:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:2.0:1746065162.639689:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1746065162.639693:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3766:x1830881267835648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639708:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3766:x1830881267835648:12345-0@lo:400:kworker.0 Request processed in 14us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065162.639712:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1746065162.639719:0:7213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1746065162.639722:0:7213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3766:x1830881267836160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639750:0:7213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3766:x1830881267836160:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065162.639754:0:7213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1746065162.639785:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3766:1830881267835136:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639792:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3766:1830881267835648:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639798:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3766:1830881267836160:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639803:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3766:1830881267835776:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639808:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3766:1830881267836288:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639851:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267835264 00000100:00100000:2.0:1746065162.639854:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267835264 00000100:00100000:2.0:1746065162.639870:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1746065162.639874:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801352cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3766:x1830881267835264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.639899:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801352cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3766:x1830881267835264:12345-0@lo:400:kworker.0 Request processed in 24us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065162.639903:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00080000:2.0:1746065162.639915:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746065162.639918:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746065162.639931:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267835264:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640107:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ea75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830881267835392:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640130:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.640154:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267835904:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640177:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.640189:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267836416:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640203:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.640215:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746065162.640219:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c4d7531-7474-4559-997c-c1b3824c301a:3767:1830881267835008:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640243:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.640266:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267835520:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640280:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.640292:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267836032:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640306:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.640315:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801352cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267836544:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640326:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.640344:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267835904 00000100:00100000:0.0:1746065162.640347:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267835904 00000100:00100000:0.0:1746065162.640366:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267836416 00000100:00100000:0.0:1746065162.640368:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267836416 00000100:00100000:0.0:1746065162.640377:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267836032 00000100:00100000:0.0:1746065162.640378:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267836032 00000100:00100000:0.0:1746065162.640387:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267836544 00000100:00100000:0.0:1746065162.640389:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267836544 00000100:00100000:0.0:1746065162.640396:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1746065162.640400:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267835904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640423:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267835904:12345-0@lo:400:kworker.0 Request processed in 23us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.640427:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1746065162.640436:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1746065162.640440:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267836416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640457:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830881267836416:12345-0@lo:400:kworker.0 Request processed in 17us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.640461:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1746065162.640468:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1746065162.640471:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009facb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267836032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640485:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009facb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267836032:12345-0@lo:400:kworker.0 Request processed in 15us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.640489:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1746065162.640495:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:0.0:1746065162.640497:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009facaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267836544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640510:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009facaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267836544:12345-0@lo:400:kworker.0 Request processed in 13us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.640516:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00080000:0.0:1746065162.640527:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065162.640529:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065162.640540:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267836032:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640546:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267836544:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640552:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267835904:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640558:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267836416:0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640589:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267835008 00000100:00100000:0.0:1746065162.640596:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267835008 00000100:00100000:0.0:1746065162.640615:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1746065162.640623:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3767:x1830881267835008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.640638:0:8373:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267835520 00000100:00100000:2.0:1746065162.640640:0:8373:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267835520 00000100:00100000:0.0:1746065162.640645:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c4d7531-7474-4559-997c-c1b3824c301a+23:3767:x1830881267835008:12345-0@lo:400:kworker.0 Request processed in 22us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.640649:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1746065162.640655:0:8373:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1746065162.640658:0:8373:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267835520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065162.640669:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c4d7531-7474-4559-997c-c1b3824c301a:3767:1830881267835008:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.640678:0:8373:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830881267835520:12345-0@lo:400:kworker.0 Request processed in 20us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.640680:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801352cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3767:1830881267835520:0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.640682:0:8373:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1746065162.640693:0:8367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267835392 00000100:00100000:2.0:1746065162.640695:0:8367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267835392 00000100:00100000:2.0:1746065162.640707:0:8367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:2.0:1746065162.640712:0:8367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3767:x1830881267835392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065162.640746:0:8367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3767:x1830881267835392:12345-0@lo:400:kworker.0 Request processed in 34us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065162.640751:0:8367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1746065162.640897:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ea75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830881267835392:0@lo:400:kworker.0 00000004:00080000:1.0:1746065162.707189:0:11427:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761827106187ns, next at 762827104497ns, rc = 0 00000100:00100000:2.0:1746065162.707635:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267836672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065162.707687:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.707864:0:9561:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267836672 00000100:00100000:0.0:1746065162.707872:0:9561:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267836672 00000100:00100000:0.0:1746065162.707901:0:9561:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1746065162.707907:0:9561:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267836672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746065162.707925:0:9561:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 545004352 pending 8437760 free 3882074112 avail 3607289856 00000100:00100000:0.0:1746065162.707958:0:9561:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3765:x1830881267836672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.707964:0:9561:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1746065162.708237:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267836672:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1746065162.709392:0:7194:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 23 committed 00000001:00080000:0.0:1746065162.709416:0:7194:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983659 is committed 00010000:00010000:2.0:1746065162.710381:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065162.710391:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065162.710397:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065162.710402:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091065200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065162.710405:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065162.710411:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065162.710424:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:2.0:1746065162.710426:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065162.710428:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065162.710433:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091065200/0x392ae0376f8812fb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 00010000:00010000:2.0:1746065162.710454:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065162.710459:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065162.710462:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065162.710466:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f846e00 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065162.710467:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065162.710471:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065162.710475:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:2.0:1746065162.710477:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065162.710479:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065162.710482:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f846e00/0x392ae0376f88132c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21520 initiator: MDT0 00010000:00010000:2.0:1746065162.710488:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710492:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710495:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710502:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe71600 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065162.710504:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710507:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710512:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:2.0:1746065162.710513:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065162.710515:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710518:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe71600/0x392ae0376f88164a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710524:0:3752:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710528:0:3752:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710531:0:3752:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710534:0:3752:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd11200 already unused, calling callback (ffffffffa0f34690) 00010000:00010000:2.0:1746065162.710536:0:3752:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710539:0:3752:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710543:0:3752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a08cfb00) 00010000:00010000:2.0:1746065162.710545:0:3752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065162.710547:0:3752:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00010000:00010000:2.0:1746065162.710551:0:3752:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd11200/0x392ae0376f88167b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7213 initiator: MDT0 00000001:00080000:0.0:1746065162.710754:0:7194:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983658 is committed 00000004:00080000:0.0:1746065162.710769:0:7194:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 22 committed 00000004:00080000:0.0:1746065162.710771:0:7194:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000004:00080000:0.0:1746065162.712339:0:7194:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 21 committed 00000004:00080000:0.0:1746065162.712343:0:7194:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000020:00080000:0.0:1746065162.712361:0:7194:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 9 batchid updated 00000020:00080000:0.0:1746065162.712374:0:7241:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 9 00000004:00080000:0.0:1746065162.712416:0:7241:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012e572c00 with version 21 00000020:00080000:0.0:1746065162.712422:0:7241:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 9 cancel update log [0x240000401:0x2:0x0].9: rc = 0 00000020:00080000:0.0:1746065162.712473:0:7241:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 9 cancel update log [0x200000400:0x2:0x0].9: rc = 0 00000020:00080000:0.0:1746065162.712480:0:7241:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 9 00000004:00080000:0.0:1746065162.712504:0:8655:0:(osp_trans.c:1327:osp_get_next_request()) ou ffff880081c7d240 version 21 rpc_version 21 00000020:00100000:0.0:1746065162.712519:0:8655:0:(genops.c:2421:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1746065162.712526:0:8655:0:(client.c:764:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009facb800 x1830881267837056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1746065162.712542:0:8655:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009facb800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8655:1830881267837056:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1746065162.712590:0:8655:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.712625:0:8655:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065162.712643:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267837056 00000100:00100000:0.0:1746065162.712649:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267837056 00000100:00100000:0.0:1746065162.712977:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1746065162.712982:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f6ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267836800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1746065162.712984:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8655:x1830881267837056:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1746065162.713009:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065162.713016:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007297bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267837312:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1746065162.713040:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065162.713058:0:3768:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065162.713062:0:3768:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880072979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267837184:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1746065162.713075:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8655:x1830881267837056:12345-0@lo:1000:osp_up1-0.0 Request processed in 91us (485us total) trans 4294967405 rc 0/0 00000100:00100000:1.0:1746065162.713077:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.713116:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1746065162.713126:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267836800 00000100:00100000:1.0:1746065162.713130:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267836800 00000100:00100000:0.0:1746065162.713137:0:9635:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267837312 00000100:00100000:0.0:1746065162.713140:0:9635:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267837312 00000100:00100000:1.0:1746065162.713148:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267837184 00000100:00100000:1.0:1746065162.713150:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267837184 00000100:00100000:0.0:1746065162.713156:0:9635:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30902 00000100:00100000:0.0:1746065162.713161:0:9635:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3766:x1830881267836800:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1746065162.713164:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30903 00000100:00100000:1.0:1746065162.713169:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3768:x1830881267837312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1746065162.713176:0:9635:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:27 count 1 00002000:00080000:1.0:1746065162.713180:0:21550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:28 count 1 00010000:00010000:0.0:1746065162.713191:0:9635:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713193:0:21550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713206:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 8 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.713212:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713213:0:21550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f881627 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6efa expref: 18 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065162.713219:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065162.713219:0:9635:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x392ae0376f8812d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d17 expref: 12 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065162.713221:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065162.713223:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.713224:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065162.713226:0:9635:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065162.713228:0:9635:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713252:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f881627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6efa expref: 18 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065162.713262:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f881627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6efa expref: 18 pid: 21550 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746065162.713271:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267837440:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065162.713320:0:21550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 8 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713328:0:21550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 8 pid: 9642 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746065162.713334:0:21550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267837696:192.168.202.8@tcp:104: 00000100:00100000:2.0:1746065162.713343:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267837568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1746065162.713348:0:21550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f805240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065162.713360:0:9558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30904 00000100:00100000:2.0:1746065162.713363:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065162.713365:0:9558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3768:x1830881267837184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1746065162.713375:0:9558:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:26 count 1 00010000:00010000:1.0:1746065162.713384:0:9558:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713392:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713397:0:9558:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8812d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d10 expref: 18 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065162.713401:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065162.713403:0:9558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065162.713404:0:9558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713416:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8812d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d10 expref: 18 pid: 9560 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065162.713423:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8812d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d10 expref: 18 pid: 9560 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746065162.713431:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9558:1830881267837824:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065162.713450:0:9558:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 8 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713457:0:9558:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 8 pid: 9560 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746065162.713463:0:9558:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9558:1830881267837952:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065162.713472:0:9558:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f805540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065162.713483:0:9560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267837568 00000100:00100000:1.0:1746065162.713485:0:9560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267837568 00000100:00100000:1.0:1746065162.713496:0:9560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30905 00000100:00100000:1.0:1746065162.713500:0:9560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3765:x1830881267837568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1746065162.713507:0:9560:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:28 count 1 00010000:00010000:1.0:1746065162.713516:0:9560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713524:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 7 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713530:0:9560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f881620 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f01 expref: 12 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065162.713535:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065162.713536:0:9560:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065162.713539:0:9560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713550:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f881620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f01 expref: 12 pid: 21550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065162.713557:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f881620 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f01 expref: 12 pid: 21550 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746065162.713564:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267838080:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065162.713590:0:9560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 7 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.713597:0:9560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 7 pid: 9642 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746065162.713604:0:9560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267838208:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065162.713615:0:9560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f805d80 going to sleep for 11 seconds 00010000:00010000:0.0:1746065162.713739:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x392ae0376f8812d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d17 expref: 12 pid: 9558 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065162.713748:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x392ae0376f8812d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d17 expref: 12 pid: 9558 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746065162.713757:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d651500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267838336:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065162.713935:0:9635:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 7 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.713943:0:9635:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 7 pid: 9560 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746065162.713950:0:9635:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267838464:192.168.202.8@tcp:104: 00000100:00100000:0.0:1746065162.713965:0:9635:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e572a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065162.713994:0:8655:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009facb800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8655:1830881267837056:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1746065162.720966:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267837440:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065162.745763:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9558:1830881267837824:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065162.748134:0:9558:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9558:1830881267837952:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065162.748161:0:9558:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065162.748196:0:21550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:21550:1830881267837696:192.168.202.8@tcp:104: 00010000:00010000:1.0:1746065162.748207:0:21550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065162.751310:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065162.751339:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065162.751353:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065162.751365:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065162.751376:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065162.751398:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065162.751418:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273329280 00000100:00100000:0.0:1746065162.751424:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273329280 00010000:00010000:0.0:1746065162.751461:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 9 pid: 9560 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746065162.751478:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273329408 00000100:00100000:0.0:1746065162.751480:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273329408 00010000:00010000:0.0:1746065162.751488:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f881620 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f01 expref: 13 pid: 21550 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746065162.751496:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273329536 00000100:00100000:0.0:1746065162.751586:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273329536 00000100:00100000:1.0:1746065162.751591:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d651500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267838336:192.168.202.8@tcp:104: 00000100:00100000:1.0:1746065162.751601:0:9635:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9635:1830881267838464:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065162.751603:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 8 pid: 9642 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746065162.751613:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273329152 00000100:00100000:0.0:1746065162.751615:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273329152 00010000:00010000:1.0:1746065162.751616:0:9635:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.751622:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 10 pid: 9642 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746065162.751630:0:7198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273329664 00000100:00100000:0.0:1746065162.751631:0:7198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273329664 00010000:00010000:0.0:1746065162.751637:0:7198:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 9 pid: 9560 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746065162.751641:0:9574:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273329792 00000100:00100000:1.0:1746065162.751644:0:9574:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273329792 00000100:00100000:0.0:1746065162.751646:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14855 00000100:00100000:0.0:1746065162.751652:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+10:2002:x1830881273329280:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065162.751657:0:9574:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x392ae0376f8812d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d17 expref: 14 pid: 9558 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746065162.751663:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065162.751667:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 10 pid: 9560 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746065162.751670:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14856 00000100:00100000:1.0:1746065162.751675:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fae7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2002:x1830881273329408:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065162.751680:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 10 pid: 9560 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746065162.751681:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065162.751684:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f881620 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f01 expref: 14 pid: 21550 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746065162.751691:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f881620 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f01 expref: 14 pid: 21550 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746065162.751702:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x392ae0376f881299 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cf4 expref: 10 pid: 9560 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746065162.751704:0:9574:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065162.751715:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065162.751745:0:9574:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fae7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+14:2002:x1830881273329408:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 69us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.751748:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2002:x1830881273329280:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 96us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065162.751751:0:9574:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14856 00000100:00100000:0.0:1746065162.751757:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14855 00000100:00100000:1.0:1746065162.751765:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14857 00000100:00100000:1.0:1746065162.751770:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2002:x1830881273329536:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065162.751776:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065162.751780:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 9 pid: 9642 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746065162.751787:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 9 pid: 9642 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746065162.751788:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14858 00000100:00100000:0.0:1746065162.751793:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273329152:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065162.751797:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065162.751799:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065162.751799:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065162.751802:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.751802:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 8 pid: 9642 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746065162.751809:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.751809:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 8 pid: 9642 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746065162.751819:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8c1600/0x392ae0376f8815be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e6e expref: 8 pid: 9642 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746065162.751821:0:9574:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065162.751827:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065162.751834:0:9574:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+9:2002:x1830881273329536:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 64us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065162.751839:0:9574:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14857 00000100:00100000:0.0:1746065162.751840:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+7:2004:x1830881273329152:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 48us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.751845:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14858 00000100:00100000:1.0:1746065162.751848:0:9574:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14859 00000100:00100000:1.0:1746065162.751853:0:9574:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+8:2004:x1830881273329664:12345-192.168.202.8@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065162.751855:0:7198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14860 00010000:00010000:1.0:1746065162.751857:0:9574:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065162.751860:0:7198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+13:2002:x1830881273329792:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065162.751861:0:9574:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 8 pid: 9560 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746065162.751865:0:7198:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065162.751868:0:7198:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x392ae0376f8812d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d17 expref: 13 pid: 9558 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746065162.751872:0:9574:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 8 pid: 9560 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746065162.751887:0:7198:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x392ae0376f8812d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d17 expref: 13 pid: 9558 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746065162.751901:0:7198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x392ae0376f8812d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d17 expref: 13 pid: 9558 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746065162.751908:0:7198:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065162.751923:0:7198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+12:2002:x1830881273329792:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 63us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.751928:0:7198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14860 00010000:00010000:0.0:1746065162.751956:0:9560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f02c400/0x392ae0376f881620 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6f01 expref: 11 pid: 21550 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746065162.751963:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267838080:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065162.751970:0:9560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8c0e00/0x392ae0376f8815c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6e75 expref: 8 pid: 9642 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746065162.751977:0:9560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9560:1830881267838208:192.168.202.8@tcp:104: 00010000:00010000:0.0:1746065162.751987:0:9560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.751993:0:9560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065162.751994:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00010000:00010000:0.0:1746065162.751999:0:9560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.752005:0:9560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.752012:0:9560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.752446:0:9560:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065162.752450:0:8359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273329920 00000100:00100000:2.0:1746065162.752454:0:8359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273329920 00010000:00010000:2.0:1746065162.752468:0:8359:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f881627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6efa expref: 19 pid: 21550 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746065162.752483:0:8359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14861 00000100:00100000:2.0:1746065162.752488:0:8359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+19:2003:x1830881273329920:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065162.752494:0:8359:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065162.752497:0:8359:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f881627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6efa expref: 19 pid: 21550 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746065162.752504:0:8359:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f881627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6efa expref: 19 pid: 21550 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746065162.752514:0:8359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f02d400/0x392ae0376f881627 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6efa expref: 19 pid: 21550 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746065162.752530:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065162.752532:0:8359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065162.752534:0:8359:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752540:0:8359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752553:0:8359:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065162.752570:0:8359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+18:2003:x1830881273329920:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 82us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065162.752575:0:8359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14861 00010000:00010000:2.0:1746065162.752588:0:10903:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065162.752593:0:10903:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752599:0:10903:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06400 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:2.0:1746065162.752602:0:10903:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752609:0:10903:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752618:0:10903:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752623:0:10903:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb06400/0x392ae0376f881785 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752635:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065162.752637:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065162.752638:0:10903:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1746065162.752658:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746065162.752661:0:7209:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746065162.752669:0:21550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752675:0:21550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752682:0:21550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752687:0:21550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065162.752702:0:21550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065162.752993:0:9574:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10e00/0x392ae0376f8812a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6cfb expref: 7 pid: 9560 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746065162.753010:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065162.753011:0:9574:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065162.753014:0:9574:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.753020:0:9574:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.753031:0:9574:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065162.753052:0:9574:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52bf789-9c5d-4da8-a2d6-bdaf6bfefaeb+6:2004:x1830881273329664:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 1193us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065162.753057:0:9574:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14859 00010000:00010000:1.0:1746065162.753075:0:9635:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.753095:0:9635:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.753101:0:9635:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.753110:0:9635:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065162.753119:0:9635:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1746065162.753446:0:7201:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065162.753450:0:7201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.753456:0:7201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd10200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065162.753458:0:7201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.753464:0:7201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.753473:0:7201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.753479:0:7201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10200/0x392ae0376f881777 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.753494:0:7201:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065162.753497:0:7201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.753502:0:7201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb68200 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:3.0:1746065162.753504:0:7201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.753510:0:7201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.753518:0:7201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.753523:0:7201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb68200/0x392ae0376f881770 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.753531:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065162.753533:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065162.753534:0:7201:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065162.775654:0:9560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3765:x1830881267837568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 62147us (62284us total) trans 4294972174 rc 0/0 00000100:00100000:0.0:1746065162.775664:0:9560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30905 00010000:00010000:1.0:1746065162.777109:0:8891:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065162.783924:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f6a8700/2, rc 0, transno 4294972174 00000100:00100000:0.0:1746065162.783935:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3765:1830881267837568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1746065162.784012:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.8@tcp (source: 12345-192.168.202.8@tcp) 00000100:00100000:0.0:1746065162.784033:0:7200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881273330048 00000100:00100000:0.0:1746065162.784038:0:7200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881273330048 00010000:00010000:0.0:1746065162.784061:0:7200:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8812d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d10 expref: 18 pid: 9560 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746065162.784102:0:7200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.8@tcp, seq: 14862 00000100:00100000:0.0:1746065162.784109:0:7200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+18:2004:x1830881273330048:12345-192.168.202.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065162.784122:0:7200:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065162.784127:0:7200:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8812d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d10 expref: 18 pid: 9560 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746065162.784138:0:7200:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8812d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d10 expref: 18 pid: 9560 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746065162.784156:0:7200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f847400/0x392ae0376f8812d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.8@tcp remote: 0xa6f97fe59d2e6d10 expref: 18 pid: 9560 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746065162.784206:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065162.784208:0:7200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065162.784212:0:7200:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.784219:0:7200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.784235:0:7200:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065162.784263:0:7200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb9e1243-8634-4680-83fd-4b7a1b6b07ce+17:2004:x1830881273330048:12345-192.168.202.8@tcp:103:ldlm_bl.0 Request processed in 154us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.784268:0:7200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.8@tcp, seq: 14862 00000100:00100000:2.0:1746065162.784398:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3768:x1830881267837312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 71227us (71355us total) trans 4294970781 rc 0/0 00000100:00100000:2.0:1746065162.784406:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30903 00000004:00080000:2.0:1746065162.784436:0:3768:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007297bb80/2, rc 0, transno 4294970781 00000100:00100000:2.0:1746065162.784440:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007297bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267837312:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1746065162.784455:0:9558:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.784463:0:9558:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.784471:0:9558:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.784478:0:9558:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065162.784488:0:9558:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065162.784684:0:7202:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065162.784690:0:7202:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.784697:0:7202:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130640000 already unused, calling callback (ffffffffa0882d70) 00010000:00010000:0.0:1746065162.784700:0:7202:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.784707:0:7202:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.784716:0:7202:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.784721:0:7202:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130640000/0x392ae0376f88177e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065162.784748:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065162.784749:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065162.784751:0:7202:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065162.790485:0:9635:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3766:x1830881267836800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 77318us (77470us total) trans 4294972175 rc 0/0 00000100:00100000:0.0:1746065162.790495:0:9635:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30902 00000100:00100000:3.0:1746065162.791646:0:9558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3768:x1830881267837184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 78278us (78565us total) trans 4294970782 rc 0/0 00000100:00100000:3.0:1746065162.791653:0:9558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30904 00000004:00080000:3.0:1746065162.791697:0:3768:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880072979500/2, rc 0, transno 4294970782 00000100:00100000:3.0:1746065162.791702:0:3768:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880072979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3768:1830881267837184:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1746065162.791813:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f6ab480/2, rc 0, transno 4294972175 00000100:00100000:2.0:1746065162.791817:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f6ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3766:1830881267836800:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1746065162.802274:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267838592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746065162.802342:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065162.802375:0:9562:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267838592 00000100:00100000:0.0:1746065162.802381:0:9562:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267838592 00000100:00100000:0.0:1746065162.802411:0:9562:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1746065162.802416:0:9562:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267838592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746065162.802434:0:9562:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 545004352 pending 8437760 free 3882074112 avail 3607289856 00000100:00100000:0.0:1746065162.802475:0:9562:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3766:x1830881267838592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065162.802480:0:9562:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:2.0:1746065162.802491:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3766:1830881267838592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065162.879357:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d54aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267838720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065162.879410:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065162.879432:0:7216:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881267838720 00000100:00100000:2.0:1746065162.879439:0:7216:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881267838720 00000100:00100000:2.0:1746065162.879472:0:7216:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1746065162.879485:0:7216:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3767:x1830881267838720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1746065162.879511:0:7216:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1445957632 avail 1316495360 00000100:00100000:2.0:1746065162.879564:0:7216:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3767:x1830881267838720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065162.879569:0:7216:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1746065162.879583:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d54aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3767:1830881267838720:0@lo:41:osp-pre-0-1.0 Debug log: 68339 lines, 68339 kept, 0 dropped, 0 bad.